Join a fast‑moving data engineering team focused on building scalable pipelines on Databricks and AWS. You’ll translate complex eCommerce and enterprise data into reliable analytics products that drive business decisions.
What You’ll Do
- Design and maintain scalable data pipelines for multi‑source ingestion and transformation.
- Build ELT/ETL workflows using Databricks, Spark, Python, SQL, and dbt.
- Implement Medallion Architecture data models and ensure data quality.
- Collaborate with stakeholders to convert requirements into technical solutions.
- Prepare datasets for Power BI and other reporting tools.
- Troubleshoot pipeline failures and performance bottlenecks.
- Drive continuous improvement of engineering standards and governance.
What You Need
- 4+ years experience as a Data Engineer.
- Expert SQL skills for analysis, transformation, and modeling.
- Proven ability to build pipelines with Python and Apache Spark.
- Hands‑on experience with Databricks for large‑scale processing.
- Proficiency using dbt for data transformation testing and deployment.
- Knowledge of data warehousing, dimensional modeling, and Medallion Architecture.
- Experience with AI‑assisted development tools like Copilot or Databricks Genie.
Good to Have
- Experience with eCommerce or digital commerce data domains.
- Familiarity with Scala for distributed processing workloads.
- Exposure to real‑time streaming or event‑driven architectures.
- Working knowledge of AWS cloud services and cloud‑native data engineering.
The Opportunity
YASH promotes a hyperlearning culture with flexible work arrangements, trust‑based collaboration, and a focus on continuous upskilling.