Principal Data Engineer (Data Platforms)

Full Time

Mastercard

11 open roles Website

  • Full Time
  • Pune

Join a fast‑moving team that unlocks Mastercard’s data assets, delivering secure, scalable platforms that power billions of digital transactions worldwide. You’ll work with cutting‑edge cloud technologies to shape the future of global payments. What You'll Do Design and build scalable, secure cloud‑native and hybrid data platforms. Architect large‑scale distributed lakehouse environments across regions and clouds. Define control‑plane services for metadata, policy, provisioning, and observability. Establish federated metadata, catalog, identity, and secure data‑sharing patterns. Create reference architectures, decision records, and reusable golden‑path components. Mentor engineers and drive engineering culture through code reviews and best practices. What You Need 10+ years of data and software engineering, strong Java/Python and PySpark. Proven design of large‑scale distributed or lakehouse platforms across multiple clouds. Experience building control‑plane APIs using REST, gRPC, and asynchronous messaging. Deep knowledge of federated metadata, catalog, access, and secure data‑sharing patterns. Hands‑on expertise with AWS (S3, IAM, Glue, EKS) and Azure (ADLS, Entra, AKS). Proficient with Databricks, Snowflake, Spark, Kubernetes, Iceberg, Delta Lake, and Trino. Good to Have Experience with Unity Catalog or Apache Polaris open catalog patterns. Familiarity with medallion architecture and data lifecycle management. Knowledge of CI/CD, IaC, and automated testing in cloud environments. The Opportunity The role sits in Mastercard’s Services Technology team, driving platform standards across public‑cloud and on‑premises environments while supporting the company’s mission of building a sustainable, inclusive digital economy.

Similar Jobs to Apply
  • Capco
    India

    Join a leading global consulting firm as a Python Backend Developer, driving data‑intensive solutions for top banks and financial institutions. You'll build FastAPI services on Azure and Databricks,
  • ProfoundIQ
    Kolkata

    You’ll own an end‑to‑end restaurant analytics platform, handling data pipelines, backend services, and mobile‑first frontends. The role demands full‑stack ownership from database migration t
  • Broadridge
    India

    Join a fast‑moving team building end‑to‑end data solutions that power financial services. You’ll work on modern Python stacks, cloud platforms, and agile processes to deliver scalable ETL syst
  • Cognisol
    India

    You’ll join a fast‑moving engineering team that builds end‑to‑end product features on a Java/Spring Boot backend and a React frontend, deploying and monitoring them on AWS. The platform hand