GCP, Hadoop Data Engineer (Kolkata)

Full Time
  • Full Time
  • Kolkata

Website Purview Services

GCP, Hadoop Data Engineer – Kolkata Building and scaling data pipelines for enterprise clients on Google Cloud, this role lets you shape end‑to‑end big‑data solutions while collaborating with global teams. Join a fast‑growing tech practice that values rapid prototyping, automation and strong stakeholder relationships. What You’ll Do Design and deploy large‑scale distributed processing systems using Hadoop, Spark and SQL. Create architecturally sound solutions and data models for relational and non‑relational stores. Implement automated unit, integration and deployment pipelines with Jenkins, Ansible and Git. Work closely with business stakeholders to translate requirements into technical specifications. Conduct code debugging, issue triage and deliver clear findings to architects and developers. Participate in Agile ceremonies (Scrum/Kanban) and maintain work items in JIRA. Develop and monitor data migration workflows on the Google Cloud stack. What You Need 3+ years experience with Hadoop, Hive, HDFS and Apache Spark. Strong SQL skills; familiarity with PostgreSQL or equivalent databases. Proficiency in Scala programming and cloud‑native design patterns. Hands‑on experience with GCP services (BigQuery, Dataflow, Dataproc, Storage, Pub/Sub). Solid DevOps background: Git/GitHub, Jenkins, Ansible, automated testing. Exposure to Enterprise Data Warehouse concepts and Tableau reporting. Comfortable working in global, customer‑facing environments. Good to Have Google Cloud Professional certification. Experience with Airflow/Cloud Composer for workflow orchestration. Knowledge of data‑prep tools such as Cloud DataPrep. The Opportunity The role sits in Kolkata’s dynamic tech hub, supporting enterprise accounts and offering rapid exposure to cutting‑edge GCP data services within a collaborative, Agile team.

To apply for this job please visit www.shine.com.

Similar Jobs to Apply
  • EY
    Chennai

    Archiving Squad Data Engineer – Chennai | Contract Join a fast‑growing team that modernises EY’s data‑archival landscape. You’ll build migration pipelines that retire legacy applications and
  • Zorba AI
    Bengaluru

    Data Engineer_Spark/Scala – Bengaluru You’ll design and optimize large‑scale data pipelines that power Zorba AI’s analytics and AI models. The role combines hands‑on Spark development with A
  • Opcito Technologies
    India

    Job Description Opcito is seeking a highly skilled Backend Engineer with strong experience in Golang and modern AI-driven application development. The ideal candidate should have hands-on expertise i
  • Talent500
    Hyderabad

    Lead Data Engineer - SQL, Oracle — Lead Data Engineer – Hyderabad | Full‑time You’ll shape the data backbone of a global manufacturing leader that’s building a high‑impact technology hub i