Hitachi Careers
Hitachi Careers is seeking a highly experienced Data Engineer to join our product organization full-time in Pune, Maharashtra, India. This role centers on Big Data systems design and data architecture, with a strong focus on Spark and Delta/Data Lake technologies.
As a Data Engineer, you will design, develop, enhance, and maintain complex data pipelines and API products crucial for business operations and large-scale analytics. We value candidates who quickly grasp new concepts and possess a strong background in data or software engineering.
Responsibilities include collaborating with engineers to implement complex systems, designing and maintaining data pipelines, supporting analytics, data science, and engineering teams, continuous learning to stay current with data engineering advancements, and contributing to the organization’s technical maturity with a high degree of autonomy.
Candidates must have 5+ years of Data Engineering experience, including 4+ years specifically designing and building Databricks data pipelines. Azure cloud experience is preferred, but experience with AWS, GCP, or other cloud platforms will be considered.
Required skills include 4+ years of hands-on experience with Python, Pyspark, or SparkSQL (Scala experience is a plus), 4+ years with Big Data pipelines or DAG Tools (Airflow, Dbt, Data Factory, or similar), 4+ years of Spark experience with Databricks Spark and Delta Lake, and 4+ years implementing Big Data solutions in a cloud ecosystem, including Data/Delta Lakes. Additionally, 5+ years of software development experience with Python 3.x, Django/Flask Frameworks, FastAPI, and relational databases (SQL/ORM) is necessary.
Beneficial skills include experience with Microsoft Fabric (Pyspark on Fabric and Fabric Pipelines), conceptual/logical/physical database designs, strong SQL skills for optimized queries, data modeling/profiling with Kimball/star schema and medallion architecture, experience with Kafka/EventHub or other live streaming technologies, familiarity with database deployment pipelines, and experience with unit testing or data quality frameworks.
Hitachi Solutions offers a competitive compensation and benefits package, regular performance reviews, performance bonuses, and ongoing training. We foster a dynamic and rewarding work environment where employees can grow professionally and personally.
To apply, please visit the Hitachi Careers website and search for the Databricks Data Engineer position in Pune, Maharashtra, India. Be aware that all legitimate communications and offers will come from @hitachisolutions.com or [email protected].
To apply for this job please visit careers.hitachi.com.