GCP, Hadoop Data Engineer (Kolkata)

Full Time
  • Full Time
  • Kolkata
  • Applications have closed

GCP, Hadoop Data Engineer – Kolkata Building and scaling data pipelines for enterprise clients on Google Cloud, this role lets you shape end‑to‑end big‑data solutions while collaborating with global teams. Join a fast‑growing tech practice that values rapid prototyping, automation and strong stakeholder relationships. What You’ll Do Design and deploy large‑scale distributed processing systems using Hadoop, Spark and SQL. Create architecturally sound solutions and data models for relational and non‑relational stores. Implement automated unit, integration and deployment pipelines with Jenkins, Ansible and Git. Work closely with business stakeholders to translate requirements into technical specifications. Conduct code debugging, issue triage and deliver clear findings to architects and developers. Participate in Agile ceremonies (Scrum/Kanban) and maintain work items in JIRA. Develop and monitor data migration workflows on the Google Cloud stack. What You Need 3+ years experience with Hadoop, Hive, HDFS and Apache Spark. Strong SQL skills; familiarity with PostgreSQL or equivalent databases. Proficiency in Scala programming and cloud‑native design patterns. Hands‑on experience with GCP services (BigQuery, Dataflow, Dataproc, Storage, Pub/Sub). Solid DevOps background: Git/GitHub, Jenkins, Ansible, automated testing. Exposure to Enterprise Data Warehouse concepts and Tableau reporting. Comfortable working in global, customer‑facing environments. Good to Have Google Cloud Professional certification. Experience with Airflow/Cloud Composer for workflow orchestration. Knowledge of data‑prep tools such as Cloud DataPrep. The Opportunity The role sits in Kolkata’s dynamic tech hub, supporting enterprise accounts and offering rapid exposure to cutting‑edge GCP data services within a collaborative, Agile team.

Similar Jobs to Apply
  • Adobe
    Noida

    Join a fast‑moving, startup‑like team building AI‑native creative experiences. You’ll design and deliver reliable backend services that power Adobe’s flagship products.What You'll DoBuil
  • Accenture
    Pune

    You’ll design, develop and support data pipelines that drive reliable data generation, collection, and processing. The role focuses on implementing robust ETL processes and ensuring data quality acr
  • IQVIA
    Bangalore

    Join a fast‑moving team that ensures the reliability, security, and efficiency of critical enterprise applications. You’ll be at the forefront of production support, deployment automation, and clo
  • Vowels of the People Association
    India

    Join a mission‑driven team building the backend that powers education and government platforms used by millions across India. You’ll create production‑grade APIs, data pipelines, and reliable se