Lead Software Engineer (Data Engineer)

Join a fast‑growing data platform team and help bring new data assets into production, while gaining hands‑on experience with AWS‑native services. You’ll work under senior engineers, tackling data onboarding, pipeline support, and basic platform tasks. What You'll Do Assist in onboarding new data assets following documented procedures. Monitor, troubleshoot, and maintain existing data pipelines on a daily basis. Ensure data quality and consistency using validation checks and lineage docs. Support storage and processing in Amazon S3, maintaining security and accessibility. Maintain Python scripts and big‑data transformations for ingestion and automation. Help automate deployments and operations with AWS CloudFormation or similar tools. Document onboarding steps, pipeline configs, and operational procedures for team use. What You Need 5+ years in data engineering, data support, or related roles. Proficiency in SQL and Python for data processing and automation. Hands‑on experience with big‑data processing engines (e.g., Spark, Flink). Familiarity with cloud data platforms such as Databricks. Practical knowledge of AWS services: S3, Glue Catalog, IAM, CloudWatch. Understanding of data onboarding, quality, metadata, and lineage concepts. Strong problem‑solving skills and attention to detail. Good to Have Experience with Delta Lake, Iceberg, or similar storage formats. Knowledge of data governance and security best practices. Relevant AWS or data‑engineering certifications. The Opportunity You’ll be part of S&P Dow Jones Indices, the creator of market‑defining benchmarks like the S&P 500 and Dow Jones Industrial Average, supporting data that underpins trillions of dollars in assets. The role offers early‑career exposure