Data Engineer with Expertise in Databricks and Cloud Platforms

Data Engineer with Expertise in Databricks and Cloud Platforms — Data Engineer – Bengaluru You’ll join a high‑impact analytics team building modern data platforms that power critical banking solutions. The role focuses on designing, developing, and scaling data pipelines on Databricks and cloud services. This is an opportunity to work with cutting‑edge lakehouse architecture and deliver real‑time insights across the enterprise. What You’ll Do Design and implement end‑to‑end ETL/ELT pipelines on Azure Databricks. Build and maintain Spark jobs using PySpark, Scala, and SQL. Integrate streaming sources such as Kafka and Structured Streaming. Orchestrate workflows with Airflow or Azure Data Factory. Develop CI/CD pipelines for automated data‑engineer deployments. Create data models and warehousing solutions for large‑scale datasets. Support BI reporting by delivering clean data to Power BI and Tableau. What You Need 2–5 years of hands‑on Data Engineering / Big Data experience. Strong expertise with Databricks and Apache Spark (PySpark/Scala/SQL). Proficiency in Python and SQL for data manipulation. Experience building pipelines on Azure (or AWS/GCP) cloud platforms. Familiarity with Delta Lake and Lakehouse architecture. Working knowledge of workflow tools (Airflow or Azure Data Factory). Understanding of data modeling, warehousing, and distributed systems. The Opportunity You’ll be part of a rapidly expanding analytics hub, collaborating with senior engineers to modernize the data stack while handling high‑volume, real‑time financial data. This role offers deep exposure to cloud‑native technologies and a chance to influence the next generation of data products.