# Senior Data Engineer - Data Pipeline Transition and Platform Delivery

**Company**: S&P Dow Jones Indices
**Location**: Hyderabad, Telangana
**Work arrangement**: hybrid
**Experience**: senior
**Job type**: full-time
**Category**: Engineering
**Industry**: Finance

**Apply**: https://spgi.wd5.myworkdayjobs.com/en-US/SPGI_Careers/job/Hyderabad-Telangana/Associate-Director--Data-Platforms---Technical-Lead_330901-2?utm_source=yubhub.co&utm_medium=jobs_feed&utm_campaign=apply
**Canonical**: https://yubhub.co/jobs/job_a4e167ee-da0

## Description

We are seeking a Senior Data Engineer to lead the transition of existing data pipelines to a target data platform, leveraging Databricks and AWS services.

**Key Responsibilities:**

- Partner with the Databricks team to plan and execute pipeline transitions

- Drive implementation of repeatable engineering patterns for ingestion, transformation, testing, deployment, and monitoring

- Ensure pipelines support long-term platform consistency, reliability, observability, and ease of support

- Guide the design and operation of cloud-native data pipelines using AWS services such as S3, Glue, Lambda, Kinesis, and Lake Formation

- Promote secure access to platform resources and data products using IAM, encryption, and environment-level controls

- Support lakehouse technologies and concepts such as Delta Lake, Apache Iceberg, and Databricks Unity Catalog

**Requirements:**

- 8+ years of experience in data engineering, data platforms, or related domains

- Proven ability to drive technical initiatives and influence engineering outcomes

- Experience with Databricks-based data platforms and AWS cloud-native data engineering

- Strong familiarity with technologies such as Delta Lake, Apache Iceberg, and lakehouse architecture

- Experience with AI tooling and LLM-enabled engineering

**Benefits:**

- Competitive salary

- Opportunities for growth and development

- Collaborative and dynamic work environment

## Skills

### Required
- Databricks
- AWS
- Data Engineering
- Cloud Computing
- Lakehouse Architecture
- Delta Lake
- Apache Iceberg
- Databricks Unity Catalog
- AI Tooling
- LLM-Enabled Engineering

---

Source: [Apply at spgi.wd5.myworkdayjobs.com](https://spgi.wd5.myworkdayjobs.com/en-US/SPGI_Careers/job/Hyderabad-Telangana/Associate-Director--Data-Platforms---Technical-Lead_330901-2?utm_source=yubhub.co&utm_medium=jobs_feed&utm_campaign=apply)