Principal Data Engineer

Full Time

Mastercard

18 open roles Website

  • Full Time
  • Pune

You’ll drive the architecture and modernization of a global rewards data platform, shaping how millions of transactions are processed daily for hundreds of customers worldwide.

What You’ll Do

  • Define enterprise‑scale data platform architecture and modernization roadmap.
  • Lead migration from legacy systems to cloud‑native, scalable solutions.
  • Design and optimize high‑volume batch and real‑time processing pipelines.
  • Establish standards for data quality, lineage, monitoring, and error handling.
  • Build resilient workflow orchestration and integration across internal and partner systems.
  • Ensure data security, privacy, and compliance throughout the platform.
  • Mentor engineers and drive engineering best practices across teams.

What You Need

  • Proven Principal/Lead Data Engineer or Data Architect experience at enterprise scale.
  • Deep expertise in Apache Spark, Databricks, Hadoop, and Kafka/streaming.
  • Strong background in data lakes, lakehouse, and multi‑tenant data platforms.
  • Hands‑on experience with cloud platforms (Azure, AWS, or GCP) and Kubernetes.
  • Mastery of ETL/ELT pipelines, workflow orchestration, and distributed processing.
  • Ability to define architecture standards, governance, and security controls.

Good to Have

  • Experience with large‑scale financial services, payments, loyalty, or rewards platforms.
  • Led enterprise Data Lake/Lakehouse migrations and cloud modernization initiatives.
  • Familiarity with analytics, AI/ML data enablement, and regulated environments.

The Opportunity

This role offers the chance to influence a platform serving 400+ customers, handling millions of daily transactions, and to mentor a high‑performing engineering team.

Similar Jobs to Apply