Virtusa
As a Data Engineer at our organization, you will be responsible for designing and developing robust ETL pipelines using Python, PySpark, and various Google Cloud Platform (GCP) services. Your primary focus will be on building and optimizing data models and queries in BigQuery for analytics and reporting purposes.
You will be expected to work on ingesting, transforming, and loading structured and semi-structured data from multiple sources. Collaboration with data analysts, scientists, and business teams will be essential to understand data requirements and ensure data quality, integrity, and security across cloud-based data platforms.
In this role, you will monitor and troubleshoot data workflows and performance issues while also automating data validation and transformation processes using scripting and orchestration tools. Required skills and qualifications include hands-on experience with GCP, proficiency in Python and/or PySpark, expertise in designing and implementing ETL workflows, as well as familiarity with SQL and data modeling for analytics.
Additionally, you should have knowledge of GCP services like Cloud Storage, Dataflow, Pub/Sub, and Composer, along with an understanding of data governance, security, and compliance in cloud environments. Experience with version control (Git) and agile development practices will be beneficial.
Joining our team means becoming part of a global workforce that values teamwork, quality of life, and both professional and personal development. At Virtusa, we prioritize collaboration and provide an environment where great minds can thrive, innovate, and work with cutting-edge technologies. If you are looking for exciting projects and opportunities to grow your career, Virtusa is the place for you.,