Python, Scala, Spark ,AWS — Python, Scala, Spark, AWS – Bangalore/Kolkata, India
Looking for seasoned data engineers to build and scale high‑performance analytics platforms. You’ll work on end‑to‑end pipelines, leveraging Python, Scala, Spark and AWS to drive business insights for a leading global services firm.
What You’ll Do
Design and implement robust data pipelines using Python and Scala.
Optimize Spark jobs for speed and resource efficiency.
Deploy and manage AWS services (EC2, S3, Lambda) for production workloads.
Collaborate with data scientists and product teams to translate requirements into code.
Conduct code reviews and enforce best‑practice standards.
Monitor, troubleshoot, and resolve production issues promptly.
Document architecture and technical decisions for team knowledge sharing.
What You Need
4 + years of professional IT experience.
Strong proficiency in Python and Scala programming.
Hands‑on experience with Apache Spark (batch & streaming).
Working knowledge of AWS cloud services and infrastructure-as-code tools.
Proven ability to build end‑to‑end ETL pipelines at scale.
Familiarity with version control (Git) and CI/CD pipelines.
Experience delivering enterprise‑grade solutions in fast‑paced environments.
Good to Have
Exposure to Kubernetes or container orchestration.
Understanding of data warehousing concepts (e.g., Redshift, Snowflake).
The Opportunity
Join TCS’s fast‑growing data engineering team, where you’ll immediately impact mission‑critical projects and collaborate with senior technologists across Bangalore and Kolkata.