Principal, Data Engineer

Full Time
  • Full Time
  • India
  • Applications have closed

Join a high‑impact team building Walmart’s next‑generation data platforms that power AI, analytics and real‑time decision making across the enterprise. You’ll work on large‑scale batch and streaming pipelines, shaping the core infrastructure used by thousands of downstream teams. What You'll Do Design and operate scalable batch and streaming pipelines with Spark, Java, Python. Implement clean architecture, automated testing, CI/CD, and rigorous code reviews. Conduct domain‑oriented and low‑level design to evaluate trade‑offs and scalability. Build and maintain services, APIs, and distributed systems supporting pipelines. Embed AI/GenAI features like embeddings, LLM‑assisted quality checks, and self‑healing monitoring. Collaborate with data scientists and ML engineers on feature and model‑serving pipelines. Lead architecture reviews and set platform engineering best practices. What You Need 12+ years of software engineering with hands‑on data engineering at scale. Expert in Java and Python; strong proficiency with Apache Spark. Deep experience with Hadoop/HDFS, Hive, Kafka, and workflow orchestration (Airflow or similar). Strong knowledge of data modeling, ETL/ELT design, data quality, and lakehouse technologies (Delta Lake, Databricks). Operational Excellence mindset: SLO/SLA ownership, incident management, proactive reliability metrics. Platform engineering fluency: microservices, APIs, Kubernetes, CI/CD, cloud‑native practices. Distributed systems expertise: event‑driven patterns, fault tolerance, scalability analysis. Good to Have Experience with Go, C++, or Scala. Hands‑on work integrating LLM APIs, embeddings, and vector search. Familiarity with feature stores and MLOps pipelines. The Opportunity At Walmart Global Tech, a single line of code can improve the lives of hundreds of millions, and you’ll

Similar Jobs to Apply
  • Genpact
    India

    Join a fast‑moving, innovation‑driven team building cutting‑edge AI‑enabled backend solutions for global enterprises. You’ll lead design, development, and delivery of Java‑based microservi
  • thinkbridge
    India

    Join a six‑month contract as a Full Stack Engineer, building and enhancing web applications using C#, .NET, and Claude Code. The role blends front‑end and back‑end work, with three days a week o
  • Cloudesign
    India

    Join a fast‑growing AI team building production‑grade shopping assistants and multimodal experiences for e‑commerce platforms. Own the full stack—from backend agents to interactive front‑end
  • S&P Global
    Hyderabad

    Join a team that builds scalable data pipelines for financial markets. You’ll shape the data lifecycle to accelerate insights across banking, real‑estate, and insurance sectors. Your work will ena