Lead Databricks Data Engineer

Full Time
  • Full Time
  • Telangana
  • Applications have closed

Lead Databricks Data Engineer – Telangana

Join a cutting‑edge data platform team building scalable, AI‑enhanced pipelines on the Databricks Lakehouse. You’ll create reusable frameworks and automation that power analytics, reporting and machine‑learning workloads across Qualcomm.

What You’ll Do
Design and operate batch and streaming pipelines on Databricks Lakehouse.
Build reusable frameworks, libraries, and templates for data ingestion and transformation.
Apply AI‑driven schema inference, quality checks, and self‑healing automation.
Define and monitor SLIs/SLOs; lead incident response and post‑mortems.
Optimize performance and cost with automated resource‑utilization recommendations.

What You Need
7+ years building and operating data platforms or distributed data systems.
Hands‑on experience with AWS services, IAM, networking, and multi‑account setups.
Deep knowledge of Databricks Lakehouse, Delta Lake and Unity Catalog.
Proficient in Python for data‑engineer frameworks and AI‑assisted automation.
Experience using Fivetran for ingestion and Acceldata for observability.

Good to Have
Passion for emerging technologies and delivering proof‑of‑concepts.
Experience working in regulated or compliance‑driven environments.

The Opportunity
You will be part of Qualcomm’s India IT Data Engineering group, influencing platform architecture and serving multiple internal product teams.

Similar Jobs to Apply
  • AstraZeneca
    India

    You will build and scale a DevOps infrastructure that 20,000–30,000 users depend on to accelerate life‑changing science. You will set strategy for tools that boost developer productivity, speed de
  • S&P Global
    India

    Join a team building next‑gen data pipelines on AWS and Databricks, ensuring reliable, scalable ingestion for financial datasets. You’ll partner with platform and offshore teams to transition, opt
  • CME Group
    India

    Join a fast‑moving team that builds the core infrastructure enabling engineers to ship applications quickly and securely. You’ll work with Kubernetes, GitOps and Google Cloud to create self‑serv
  • S&P Global
    Hyderabad

    You’ll help build the core engineering platform that makes enterprise‑scale AI agents reliable, secure and easy to ship across the organization. The role focuses on automating deployment, integrat