# Senior Data Platform Engineer

**Company**: Komodo Health
**Location**: San Francisco, CA
**Work arrangement**: hybrid
**Experience**: senior
**Job type**: full-time
**Salary**: $196,000-$230,000 USD
**Category**: Engineering
**Industry**: Healthcare

**Apply**: https://job-boards.greenhouse.io/komodohealth/jobs/8912047002?utm_source=yubhub.co&utm_medium=jobs_feed&utm_campaign=apply
**Canonical**: https://yubhub.co/jobs/job_d9c1d34d-c62

## Description

At Komodo Health, the mission is to reduce the global burden of disease through smarter use of data. The company has created the Healthcare Map, the largest and most precise view of the U.S. healthcare system, combining de-identified patient data with innovative algorithms and clinical experience.

The Senior Data Platform Engineer will be part of Komodo Health's Data Foundations team, playing a crucial role in shaping the core data products that fuel the Healthcare Map. The engineer will transform complex healthcare datasets into reliable data assets that power customer-facing products, internal innovation, and AI/ML use cases.

Key responsibilities include:

- Building, operating, and optimizing large-scale batch pipelines using Python, SQL, Spark, and Airflow on AWS

- Making informed decisions on storage and data layout for efficient querying and cost-effectiveness

- Ingesting data from various external sources and maintaining pipeline accuracy through frequent schema changes

- Transforming healthcare claims, EHR, and reference data into trusted data products

- Ensuring reliability through data quality checks, validation, lineage, observability, and alerting

- Debugging complex data, system, and performance issues across compute-heavy workflows

- Contributing to system design, code quality, testing, documentation, CI/CD, and rotational production support

Requirements include:

- Hands-on experience with production data pipelines at multi-terabyte scale

- Advanced Python skills for large-scale data processing

- Experience with Airflow, Spark, and data storage solutions like Iceberg, Delta Lake, or Hudi

- Strong understanding of data correctness, root-cause analysis, and production troubleshooting

- Ability to communicate technical trade-offs effectively with engineering, product, and data partners

Additional skills and experience that are prioritized include:

- Containers and orchestration (Docker, Kubernetes)

- Data governance and lineage experience

- Experience delivering external-facing data products through APIs or serving layers

- Applying AI or agentic workflows to engineering, data quality, delivery, or operations

The pay range for this role is $196,000-$230,000 USD for the San Francisco Bay Area and New York City, and $170,000-$200,000 USD for all other US locations.

## Skills

### Required
- Python
- SQL
- Spark
- Airflow
- AWS
- data storage solutions like Iceberg, Delta Lake, or Hudi

### Nice to have
- Containers and orchestration (Docker, Kubernetes)
- Data governance and lineage experience
- Experience delivering external-facing data products through APIs or serving layers
- Applying AI or agentic workflows to engineering, data quality, delivery, or operations

---

Source: [Apply at job-boards.greenhouse.io](https://job-boards.greenhouse.io/komodohealth/jobs/8912047002?utm_source=yubhub.co&utm_medium=jobs_feed&utm_campaign=apply)
