Website Purview Services
GCP, Hadoop Data Engineer – Kolkata Building and scaling data pipelines for enterprise clients on Google Cloud, this role lets you shape end‑to‑end big‑data solutions while collaborating with global teams. Join a fast‑growing tech practice that values rapid prototyping, automation and strong stakeholder relationships. What You’ll Do Design and deploy large‑scale distributed processing systems using Hadoop, Spark and SQL. Create architecturally sound solutions and data models for relational and non‑relational stores. Implement automated unit, integration and deployment pipelines with Jenkins, Ansible and Git. Work closely with business stakeholders to translate requirements into technical specifications. Conduct code debugging, issue triage and deliver clear findings to architects and developers. Participate in Agile ceremonies (Scrum/Kanban) and maintain work items in JIRA. Develop and monitor data migration workflows on the Google Cloud stack. What You Need 3+ years experience with Hadoop, Hive, HDFS and Apache Spark. Strong SQL skills; familiarity with PostgreSQL or equivalent databases. Proficiency in Scala programming and cloud‑native design patterns. Hands‑on experience with GCP services (BigQuery, Dataflow, Dataproc, Storage, Pub/Sub). Solid DevOps background: Git/GitHub, Jenkins, Ansible, automated testing. Exposure to Enterprise Data Warehouse concepts and Tableau reporting. Comfortable working in global, customer‑facing environments. Good to Have Google Cloud Professional certification. Experience with Airflow/Cloud Composer for workflow orchestration. Knowledge of data‑prep tools such as Cloud DataPrep. The Opportunity The role sits in Kolkata’s dynamic tech hub, supporting enterprise accounts and offering rapid exposure to cutting‑edge GCP data services within a collaborative, Agile team.
To apply for this job please visit www.shine.com.
