Description
We are looking for a hands-on Software Development Engineer to build and operate a scalable data-product platform that enables engineering and analytics teams to create and govern production data products and marts.
The platform spans the full data-product lifecycle, including dbt Core, Airflow, Trino, Apache Iceberg, Amazon S3 Tables, AWS Glue Catalog, access control, security, infrastructure as code, and CI/CD.
This role combines data platform engineering with hands-on data-product development. You will help build the underlying platform and its reusable capabilities, while also creating and maintaining production dbt projects, data models, tests, semantic definitions, and data marts.
Responsibilities
- Build and evolve platform capabilities across dbt, Airflow, Trino, Iceberg/S3 Tables, Glue Catalog, security, and infrastructure.
- Create and maintain production dbt projects end-to-end, including data models, transformations, tests, documentation, and semantic definitions.
- Design and operate Airflow workflows with scheduling, dependencies, retries, backfills, and recovery.
- Develop and optimize high-volume analytical workloads on Trino and Iceberg, including partitioning, incremental processing, file layout, and query performance.
- Implement data quality, access control, and security using governed catalog and IAM patterns.
- Use Terraform and CI/CD to automate platform and data-product deployment.
- Contribute to the semantic and visualization layer for data-product consumption.
- Troubleshoot and operate the full stack, with a focus on reliability, scalability, and safe production operations.
- Build reusable platform patterns that make it easier for teams to develop and operate data products.
- Support and mentor team members on data platform and data-product development.
Requirements
- 8+ years of software engineering or data engineering experience.
- 5+ years of experience building or operating production data platforms, lakehouse platforms, or distributed data systems.
- Hands-on experience building and maintaining production dbt Core projects.
- Strong production SQL and data-modeling experience.
- Experience with Airflow or another production workflow orchestration platform.
- Experience with Trino or another distributed SQL/query engine.
- Experience with a lakehouse technology such as Apache Iceberg, Delta Lake, or Hudi.
- Experience with cloud object storage and metadata/catalog systems.
- Experience with Python, Java, Go, Scala, or another production programming language.
- Experience with infrastructure as code such as Terraform.
- Experience working with production data access controls and security.
Nice to Have
- Hands-on experience building or operating multi-team data/lakehouse platforms.
- Experience with reusable platform patterns across project structure, orchestration, catalog, CI/CD, and environments.
- Strong production dbt experience, including project architecture, macros, packages, tests, and large model graphs.
- Experience with data modeling, marts, data quality, and semantic/metrics definitions across multiple domains.
- Strong Trino experience, including query execution and performance tuning.
- Hands-on Apache Iceberg experience: partitioning, schema evolution, snapshots, and table maintenance.
- Experience with S3 Tables, Glue Catalog, or comparable lakehouse storage/catalog technologies.
- Strong understanding of query and data-layout optimization for high-volume workloads.
- Experience with Apache Superset, Metabase, or similar BI platforms.
- Experience with Terraform, IAM, least privilege, encryption, CI/CD, monitoring, and production operations.
Salary The annualized base salary ranges for the primary location and any additional locations are: Primary Location: USA.CA.Pleasanton Primary Location Base Pay Range: $190,100 USD - $285,100 USD Additional US Location(s) Base Pay Range: $160,100 USD - $285,100 USD