Data Engineer – Lakehouse Migration & Modernization [6+yrs]

Full Time
  • Full Time
  • Bengaluru
  • Applications have closed

Data Engineer – Lakehouse Migration & Modernization [6+yrs] — Data Engineer – Lakehouse Migration & Modernization – Bengaluru

Join a fast‑growing data team to redesign enterprise data pipelines using modern Lakehouse platforms. The role drives large‑scale migration and modernization projects, delivering high‑performance, scalable solutions for global stakeholders.

What You’ll Do
Design and implement end‑to‑end Lakehouse data pipelines.
Optimize SQL queries and tune performance for massive datasets.
Build and maintain Spark jobs and Kafka integrations.
Deploy data services on Kubernetes with CI/CD automation.
Collaborate with global product and analytics teams to meet delivery targets.
Troubleshoot and resolve issues in distributed data workflows.
Document architecture and best‑practice guidelines.

What You Need
6+ years of hands‑on data engineering experience.
Proven expertise with Lakehouse architectures and large‑scale migrations.
Strong Python or Java coding skills; solid DSA foundation.
Advanced SQL proficiency, including query optimization.
Experience with Apache Spark, Kafka, and CI/CD pipelines.
Kubernetes (K8s) deployment and management experience.
Good grasp of SDLC and software engineering best practices.

Good to Have
Experience with Snowflake, Apache Iceberg, or Hadoop ecosystem.
Knowledge of JSON, Avro, Parquet, and schema evolution.
Familiarity with SCD Type 2, data partitioning, and clustering.

The Opportunity
You’ll work in a tightly‑knit, globally distributed team delivering mission‑critical data migration projects that shape the company’s future data strategy.

Similar Jobs to Apply
  • Desirous Global Consulting
    Chennai

    Join a fast‑growing consultancy delivering software products, where you’ll build and scale backend services for diverse desktop and mobile applications. You’ll work with Python‑centric stacks,
  • Info Origin Inc.
    India

    We are looking for a seasoned full‑stack engineer to drive the design and delivery of cloud‑connected IoT platforms. The role blends hands‑on development with team leadership, focusing on highâ€
  • QuinStreet
    India

    Join the team driving the Quest v2 platform modernization, a high‑volume event and workflow‑processing system handling millions of events daily. You’ll collaborate with senior engineers to desig
  • Vowels of the People Association
    India

    Join a mission‑driven team building the backend that powers education and government platforms used by millions across India. You’ll create production‑grade APIs, data pipelines, and reliable se