Data Engineer (Data Bricks) Manager / Consultant (Bengaluru)

Data Engineer (Data Bricks) Manager / Consultant (Bengaluru) — Data Engineer (Data Bricks) Manager / Consultant – Bengaluru

You will shape the next‑generation cloud data platform for a fast‑growing tech group. The role combines hands‑on Databricks expertise with leadership to define architecture, enforce governance, and deliver reliable, scalable pipelines that power data‑driven decisions.

What You’ll Do
Design end‑to‑end data architecture using Databricks, Delta Lake, and Unity Catalog.
Lead creation of scalable, governed data pipelines across cloud environments.
Implement Unity Catalog frameworks to enforce data security and lineage.
Mentor engineering teams on Spark optimisation, PySpark best practices, and performance tuning.
Ensure platform reliability, security, and cost‑effective scalability.
Review and sign off technical designs and architectural decisions.
Collaborate with senior leadership to align data strategy with business goals.

What You Need
Strong hands‑on experience with Databricks and Delta Lake.
Proficiency in PySpark, Spark SQL, and SQL querying.
Deep understanding of data architecture principles and governance.
Expertise in Unity Catalog implementation and management.
Ability to design and optimise large‑scale Spark workloads.

Good to Have
Experience with Kafka for real‑time data ingestion.
Familiarity with Airflow and CI/CD pipelines.
Knowledge of MLflow for model tracking.
Exposure to Power BI or Tableau for visual analytics.

The Opportunity
Lead a cross‑functional data engineering team and influence the strategic roadmap of a high‑velocity data platform, working directly with senior stakeholders to drive tangible business impact.