Principal Data Engineer (Data Platforms)

Full Time
  • Full Time
  • Pune
  • Applications have closed

Join a fast‑moving team that unlocks Mastercard’s data assets, delivering secure, scalable platforms that power billions of digital transactions worldwide. You’ll work with cutting‑edge cloud technologies to shape the future of global payments. What You'll Do Design and build scalable, secure cloud‑native and hybrid data platforms. Architect large‑scale distributed lakehouse environments across regions and clouds. Define control‑plane services for metadata, policy, provisioning, and observability. Establish federated metadata, catalog, identity, and secure data‑sharing patterns. Create reference architectures, decision records, and reusable golden‑path components. Mentor engineers and drive engineering culture through code reviews and best practices. What You Need 10+ years of data and software engineering, strong Java/Python and PySpark. Proven design of large‑scale distributed or lakehouse platforms across multiple clouds. Experience building control‑plane APIs using REST, gRPC, and asynchronous messaging. Deep knowledge of federated metadata, catalog, access, and secure data‑sharing patterns. Hands‑on expertise with AWS (S3, IAM, Glue, EKS) and Azure (ADLS, Entra, AKS). Proficient with Databricks, Snowflake, Spark, Kubernetes, Iceberg, Delta Lake, and Trino. Good to Have Experience with Unity Catalog or Apache Polaris open catalog patterns. Familiarity with medallion architecture and data lifecycle management. Knowledge of CI/CD, IaC, and automated testing in cloud environments. The Opportunity The role sits in Mastercard’s Services Technology team, driving platform standards across public‑cloud and on‑premises environments while supporting the company’s mission of building a sustainable, inclusive digital economy.

Similar Jobs to Apply
  • Blob Infotech Private Limited
    India

    Join a fast‑growing tech team dedicated to building robust backend platforms that power modern applications. You’ll collaborate with skilled engineers to deliver reliable services, while continuou
  • Genpact
    India

    Join a fast‑moving, innovation‑driven team building cutting‑edge AI‑enabled backend solutions for global enterprises. You’ll lead design, development, and delivery of Java‑based microservi
  • S&P Global
    India

    Join a high‑impact TechOps team that ensures seamless operation of cloud‑hosted financial data platforms. You’ll help maintain critical services, drive incident resolution, and elevate client sa
  • AstraZeneca
    India

    Join a team shaping secure, scalable software delivery for a global pharma leader. You'll create reusable pipelines, infrastructure modules, and automation that embed security‑by‑design and accele