Manager – Data Engineering

Manager – Data Engineering — Manager – Data Engineering – Noida A fast‑growing data team at Marsh is looking for a seasoned engineer to build scalable pipelines and AI‑driven analytics on Databricks. The role supports the “Restart” initiative, welcoming professionals returning after a career break and offering a collaborative, hybrid workplace. What You’ll Do Design end‑to‑end data pipelines using Databricks Medallion Architecture. Develop AI solutions with Databricks Genie and integrate them via APIs. Write transformation scripts in Python and PySpark for batch and streaming data. Store, manage, and stream real‑time data in AWS S3, linking to other cloud services. Query, clean, and reshape large datasets using SQL. Collaborate with architects, business stakeholders, and cross‑functional teams. Monitor, troubleshoot, and document pipelines for reliability and scalability. What You Need 3+ years building Databricks pipelines (Bronze, Silver, Gold layers). Strong Python, PySpark, and SQL skills for data processing. Hands‑on experience with AWS S3 and related cloud storage services. Ability to expose/consume Databricks features via RESTful APIs. Knowledge of data governance, security, and job compute configuration in Databricks. Proficiency with version control (Git) and documentation best practices. Good to Have Experience with Databricks Unity Catalog, Data Warehouse, and scheduled/event jobs. Familiarity with Delta Lake and additional AWS tools (Athena, Glue, Lambda, DMS). The Opportunity This hybrid role (minimum three days onsite) places you in Marsh’s Mercer team, tackling cutting‑edge cloud‑data projects while benefiting from a supportive, inclusive culture that actively encourages career re‑entry.