We are looking for a skilled Databricks Developer/Data Engineer with strong hands-on experience in Databricks, SQL, Python, ETL, and Apache Spark. The candidate should have expertise in building scalable data pipelines, handling large datasets, and ensuring data quality and reliability across enterprise data platforms.
Key Responsibilities
• Design, develop, and optimize ETL/ELT pipelines using Databricks and Apache Spark.
• Develop scalable data processing solutions using Python and SQL.
• Work with structured and unstructured data from multiple data sources.
• Build and maintain analytical data stores/data lakes on Databricks.
• Ensure data quality, reliability, governance, and performance optimization.
• Collaborate with cross-functional teams including Data Analysts, Architects, and Business stakeholders.
• Perform data validation, troubleshooting, and performance tuning.
• Work with RDBMS systems and cloud-based data platforms.
Required Skills
• Strong hands-on experience in Databricks
• Strong coding skills in Python and SQL
• Experience in Apache Spark / PySpark
• Strong understanding of ETL/ELT concepts
• Experience with RDBMS databases
• Experience with Analytical Data Stores/Data Warehousing
• Knowledge of data quality, reliability, and monitoring
• Good understanding of data engineering best practices
Good to Have
• Azure/AWS/GCP cloud exposure
• Experience with ADF, Synapse, Snowflake, or Delta Lake
• CI/CD and DevOps knowledge
• Airflow or orchestration tools experience
Skills: apache spark,python,rdbms