Principal, Data Engineer

Join a high‑impact team building Walmart’s next‑generation data platforms that power AI, analytics and real‑time decision making across the enterprise. You’ll work on large‑scale batch and streaming pipelines, shaping the core infrastructure used by thousands of downstream teams. What You'll Do Design and operate scalable batch and streaming pipelines with Spark, Java, Python. Implement clean architecture, automated testing, CI/CD, and rigorous code reviews. Conduct domain‑oriented and low‑level design to evaluate trade‑offs and scalability. Build and maintain services, APIs, and distributed systems supporting pipelines. Embed AI/GenAI features like embeddings, LLM‑assisted quality checks, and self‑healing monitoring. Collaborate with data scientists and ML engineers on feature and model‑serving pipelines. Lead architecture reviews and set platform engineering best practices. What You Need 12+ years of software engineering with hands‑on data engineering at scale. Expert in Java and Python; strong proficiency with Apache Spark. Deep experience with Hadoop/HDFS, Hive, Kafka, and workflow orchestration (Airflow or similar). Strong knowledge of data modeling, ETL/ELT design, data quality, and lakehouse technologies (Delta Lake, Databricks). Operational Excellence mindset: SLO/SLA ownership, incident management, proactive reliability metrics. Platform engineering fluency: microservices, APIs, Kubernetes, CI/CD, cloud‑native practices. Distributed systems expertise: event‑driven patterns, fault tolerance, scalability analysis. Good to Have Experience with Go, C++, or Scala. Hands‑on work integrating LLM APIs, embeddings, and vector search. Familiarity with feature stores and MLOps pipelines. The Opportunity At Walmart Global Tech, a single line of code can improve the lives of hundreds of millions, and you’ll