Lead Software Engineer (Data Engineer)

Software Development
  • Software Development
  • India

Join a fast‑growing data platform team and help bring new data assets into production, while gaining hands‑on experience with AWS‑native services. You’ll work under senior engineers, tackling data onboarding, pipeline support, and basic platform tasks. What You'll Do Assist in onboarding new data assets following documented procedures. Monitor, troubleshoot, and maintain existing data pipelines on a daily basis. Ensure data quality and consistency using validation checks and lineage docs. Support storage and processing in Amazon S3, maintaining security and accessibility. Maintain Python scripts and big‑data transformations for ingestion and automation. Help automate deployments and operations with AWS CloudFormation or similar tools. Document onboarding steps, pipeline configs, and operational procedures for team use. What You Need 5+ years in data engineering, data support, or related roles. Proficiency in SQL and Python for data processing and automation. Hands‑on experience with big‑data processing engines (e.g., Spark, Flink). Familiarity with cloud data platforms such as Databricks. Practical knowledge of AWS services: S3, Glue Catalog, IAM, CloudWatch. Understanding of data onboarding, quality, metadata, and lineage concepts. Strong problem‑solving skills and attention to detail. Good to Have Experience with Delta Lake, Iceberg, or similar storage formats. Knowledge of data governance and security best practices. Relevant AWS or data‑engineering certifications. The Opportunity You’ll be part of S&P Dow Jones Indices, the creator of market‑defining benchmarks like the S&P 500 and Dow Jones Industrial Average, supporting data that underpins trillions of dollars in assets. The role offers early‑career exposure

Similar Jobs to Apply
  • Mastercard
    India

    Join a global payments leader building cloud‑native data platforms that power secure, digital transactions for millions. You’ll design, develop, and maintain high‑performance ETL pipelines and s
  • Global Payments
    PUNE

    Join a fast‑growing payments technology team building end‑to‑end software that powers global transactions. You’ll work across the full development lifecycle, from design to deployment, using m
  • Setoo
    India

    Join a fast‑growing tech team building cutting‑edge AI‑enabled platforms. You'll craft end‑to‑end solutions that blend robust distributed back‑ends with sleek modern front‑ends, lev
  • S&P Global
    Hyderabad

    Join a team that builds scalable data pipelines for financial markets. You’ll shape the data lifecycle to accelerate insights across banking, real‑estate, and insurance sectors. Your work will ena