Lead Cloud Data Engineer – Manager – Hyderabad |
Drive digital transformation by designing scalable cloud data solutions for a global financial leader. This role focuses on building high-performance Databricks pipelines while mentoring junior engineers. Join a team that values innovation and technical excellence in a hybrid environment.
What You’ll Do
Design end-to-end data pipelines using Databricks and Spark.
Implement Lakehouse architecture with Delta tables.
Develop high-performance PySpark and SQL transformations.
Lead troubleshooting and performance tuning of pipelines.
Support CI/CD implementation for Databricks jobs and notebooks.
Mentor junior engineers on code quality.
Ensure adherence to security and governance standards.
What You Need
10-14 years of AWS Cloud Data Engineering experience.
Strong expertise in Databricks platform and Spark.
Advanced SQL and Python programming skills.
Experience with Git, Jenkins, and Airflow or Autosys.
Proficiency in Data Modeling and database design.
Background in ETL concepts and data warehousing.
Experience working in Agile delivery environments.
Good to Have
Experience in regulatory or financial services industries.
Databricks or cloud-related certifications.
Experience with visualization tools like PowerBI or Tableau.
The Opportunity
This hybrid leadership role allows you to impact global digital transformation initiatives while working with diverse teams across Hyderabad.