Senior, Data Engineer

Join a fast‑growing team that builds the data foundations enabling AI, analytics, and decision‑making across a global retail giant. You’ll create reliable, high‑throughput pipelines and platform capabilities that serve countless downstream services. What You'll Do Design and operate batch and streaming pipelines with Spark, Java, and Python. Apply software engineering best practices: clean architecture, automated testing, CI/CD, code reviews. Conduct system and low‑level design, evaluating trade‑offs, scalability, and cost. Contribute to platform services, APIs, and distributed systems as needed. Integrate AI/GenAI features like embeddings, LLM‑assisted quality checks, and agentic monitoring. Partner with data scientists and ML engineers to build feature and model‑serving pipelines. Own data quality, observability, and governance for your pipelines. What You Need 5+ years of hands‑on software and data engineering at scale. Strong Java and Python coding skills; Spark expertise required. Experience with Hadoop/HDFS, Hive, Kafka, and workflow orchestration (Airflow or similar). Proficiency in data modeling, ETL/ELT design, and lakehouse platforms (Delta Lake, Databricks). Operational Excellence mindset: SLO/SLA ownership, incident management, and reliability metrics. Ability to design distributed, event‑driven systems with fault tolerance and cost awareness. Good to Have Knowledge of Go, C++, or Scala. Experience with Kubernetes, microservices, and CI/CD pipelines. Hands‑on work with GenAI, LLM APIs, and vector search. The Opportunity You’ll join Walmart Global Tech’s AI & Data organization, building next‑generation data infrastructure that powers AI across the company, based in the Bangalore/Chennai office with flexibility to balance personal life.