Senior Data Engineer Databricks (PySpark) (Kochi)

Full Time
  • Full Time
  • India
  • Applications have closed

Senior Data Engineer Databricks — Senior Data Engineer Databricks (PySpark) – Kochi, India A senior‑level data engineer is needed to lead the design and delivery of high‑performance data pipelines on Databricks. The role focuses on building scalable ETL/ELT solutions that power analytics and AI initiatives. If you thrive on turning massive data sets into reliable, production‑ready workflows, this is a chance to apply deep Spark expertise at a fast‑growing tech firm. What You’ll Do Architect and implement end‑to‑end data pipelines on Databricks. Optimize PySpark jobs for speed, cost, and reliability. Develop and maintain ETL/ELT processes that ingest, cleanse, and transform data. Collaborate with data scientists and analysts to provide clean, ready‑to‑use datasets. Mentor junior engineers on Spark best practices and code quality. Monitor production workloads and troubleshoot performance bottlenecks. Document pipeline design, data lineage, and operational procedures. What You Need ≥ 23 years of hands‑on experience with Databricks and Apache Spark. ≥ 48 years of overall data‑engineering experience. Advanced proficiency in PySpark for large‑scale data processing. Strong Python programming skills applied to data pipelines. Proven track record building robust ETL/ELT solutions. Experience with cloud‑based data platforms (e.g., Azure, AWS). Ability to write clean, maintainable code and enforce coding standards. The Opportunity This senior role sits at the core of a rapidly expanding data team, offering the chance to shape the company’s data architecture while working with some of the most experienced engineers in the field.

Similar Jobs to Apply
  • Genpact
    India

    Join a fast‑moving, innovation‑driven team building cutting‑edge AI‑enabled backend solutions for global enterprises. You’ll lead design, development, and delivery of Java‑based microservi
  • Runmap Infotech
    India

    Join a cutting‑edge AI initiative where you’ll shape the backend foundation for intelligent sales agents, document processing, and frontend‑friendly services. This remote, full‑time/contract r
  • HSBC
    India

    You’ll design and deliver automated solutions that boost operational efficiency. You’ll lead development from concept to production, ensuring quality and resilience. This role blends deep Python e
  • EliteRecruitments
    India

    Join a leading Big 4 firm as a senior Java backend engineer, driving cloud‑native solutions for mission‑critical applications. You’ll work on cutting‑edge technologies while collaborating wi