Senior Data Engineer Databricks (PySpark) (Kochi)

Senior Data Engineer Databricks — Senior Data Engineer Databricks (PySpark) – Kochi, India A senior‑level data engineer is needed to lead the design and delivery of high‑performance data pipelines on Databricks. The role focuses on building scalable ETL/ELT solutions that power analytics and AI initiatives. If you thrive on turning massive data sets into reliable, production‑ready workflows, this is a chance to apply deep Spark expertise at a fast‑growing tech firm. What You’ll Do Architect and implement end‑to‑end data pipelines on Databricks. Optimize PySpark jobs for speed, cost, and reliability. Develop and maintain ETL/ELT processes that ingest, cleanse, and transform data. Collaborate with data scientists and analysts to provide clean, ready‑to‑use datasets. Mentor junior engineers on Spark best practices and code quality. Monitor production workloads and troubleshoot performance bottlenecks. Document pipeline design, data lineage, and operational procedures. What You Need ≥ 23 years of hands‑on experience with Databricks and Apache Spark. ≥ 48 years of overall data‑engineering experience. Advanced proficiency in PySpark for large‑scale data processing. Strong Python programming skills applied to data pipelines. Proven track record building robust ETL/ELT solutions. Experience with cloud‑based data platforms (e.g., Azure, AWS). Ability to write clean, maintainable code and enforce coding standards. The Opportunity This senior role sits at the core of a rapidly expanding data team, offering the chance to shape the company’s data architecture while working with some of the most experienced engineers in the field.