New The Skills of Tomorrow: how AI-exposed is every skill in 2026? See the data →
Elastic

Lead Data Engineer

Elastic
Apply →
senior full-time $113,100-$178,900 USD United States

First indexed 7 Oct 2026

Description

We're looking for a Lead Data Engineer to join our Data Engineering & Architecture team. In this role, you'll help grow a Data Platform that makes it easier for teams across our company to work with data confidently and effectively.

You'll design, maintain, and improve the pipelines and infrastructure that power our data platform. Day to day, that means working across the full data lifecycle , from ingestion and streaming to transformation and delivery , using tools like Apache Airflow, Spark, Iceberg, Kafka, Flink, and dbt Labs.

Beyond the technical work, you'll spend meaningful time with stakeholders to understand what they need and help define how data should flow across systems. That includes co-creating data contracts, writing clear documentation, and guiding teammates on how to get the most out of the platform.

Responsibilities:

  • Monitor and refine pipeline performance and refine processes to keep things running smoothly.
  • Use Terraform to provision and manage resources on Google Cloud Platform (GCP).
  • Help steward the platform by reviewing code and ensuring good practices and standard processes are followed.
  • Process access requests and support compliance with platform policies.

Requirements:

  • 8+ years of experience in data engineering or related roles
  • Experience with Apache Airflow for orchestrating data workflows
  • Experience with Spark, Flink, Kafka, and dbt Labs for data processing and transformation
  • Understanding of Apache Iceberg for data table formats and data warehouse and lakehouse strategies
  • Skilled in using Terraform for infrastructure-as-code deployments
  • Proficient in programming languages, particularly Bash, Python, and SQL
  • Knowledge of database systems, including OLAP, OLTP, Document, and Vector databases
  • Experience with Google Cloud Platform (GCP) for cloud resource management

Compensation: The typical starting salary range for this role is: $113,100-$178,900 USD In select locations, an alternate range may apply: $135,900-$215,100 USD

Benefits:

  • Competitive pay based on the work you do here and not your previous salary
  • Health coverage for you and your family in many locations
  • Ability to craft your calendar with flexible locations and schedules for many roles
  • Generous number of vacation days each year
  • Increase your impact
  • We match up to $2000 (or local currency equivalent) for financial donations and service
  • Up to 40 hours each year to use toward volunteer projects you love
  • Embracing parenthood with minimum of 16 weeks of parental leave
This listing is enriched and indexed by YubHub. To apply, use the employer's original posting: https://job-boards.greenhouse.io/elastic/jobs/8247144