Join a high‑impact data engineering team building large‑scale batch and real‑time pipelines for global payments. You’ll design, develop, and operate Spark, Kafka, and NiFi platforms that power secure, fast transactions.
What You’ll Do
- Design, develop, and maintain Spark, Kafka, and NiFi data pipelines.
- Build validation suites for batch and streaming Spark applications.
- Create and support NiFi ingestion, transformation, and routing workflows.
- Optimize performance, scalability, and resource utilization of distributed jobs.
- Automate deployment, monitoring, and operational tooling for data platform reliability.
- Participate in code reviews, documentation, and CI/CD processes.
- Mentor junior engineers and drive engineering best practices.
What You Need
- Bachelor’s degree in Computer Science or related field.
- 6+ years developing large‑scale data‑intensive applications.
- Expert in Apache Spark (batch & Structured Streaming).
- Strong experience with Apache Kafka event‑driven architectures.
- Proficiency in Scala, PySpark or Python.
- Solid SQL and data modeling skills.
- Hands‑on Linux, Git, shell scripting, CI/CD pipelines.
Good to Have
- Experience building observability solutions with monitoring/logging platforms.
- Knowledge of containerization (Docker) and orchestration (Kubernetes).
- Familiarity with data governance, metadata management, and regulated environments.
The Opportunity
Mastercard powers economies in over 200 countries, aiming to build a sustainable digital economy. The role sits within a culture driven by “the Mastercard Way” – ownership, speed, thoughtful risk‑taking, and inclusion.