Description
We are seeking a Senior Data Engineer to serve as the Subject Matter Expert (SME) for Data Platform and Lakehouse Architecture. In this role, you will be the foundational architect of our data universe.
Key Responsibilities:
- Lead the design, infrastructure implementation, and evolution of our enterprise Data Lake/Lakehouse ecosystem on AWS.
- Serve as the ultimate authority on modern open-table formats (Apache Iceberg or Delta Lake).
- Design, configure, and maintain the foundational compute engines and query layers (e.g., AWS EMR clusters, AWS Athena, Redshift).
- Define the foundational infrastructure and access patterns for enterprise Data Marts.
- Architect and enforce global data governance, network isolation, encryption (at rest and in transit), and fine-grained access controls using AWS Lake Formation and AWS IAM.
- Treat all platform infrastructure as software.
- Proactively monitor, alert, and optimize AWS data spend.
Basic Qualifications:
- 7+ years in data platform engineering, cloud infrastructure engineering, or data architecture, supporting large-scale enterprise data lakes.
- 3+ years operating Apache Iceberg (highly preferred) or Delta Lake in production.
- 3+ years production-level experience across the AWS data stack, specifically AWS EMR (Spark/Presto/Trino tuning), AWS Athena, S3 infrastructure, and AWS Lake Formation.
- 3+ years using Terraform or AWS CDK for provisioning secure, multi-environment data infrastructures.
- 3+ years of modern cloud data warehouses (Snowflake, Databricks, or AWS Redshift) and cluster sizing/workload management experience.
Other Qualifications:
- Advanced proficiency in SQL (performance tuning, query optimization) and Python or Bash for infrastructure automation.
- AWS Certified Solutions Architect – Professional or AWS Certified Data Engineer.
- Experience setting up multi-region data lakes, cross-account data sharing, or data mesh architectures.
- Experience with open-source query engines like Trino or StarRocks.
Salary: $159,600 USD - $239,400 USD
Work Environment: With Flex Work, we're combining the best of both worlds: in-person time and remote. Our approach enables our teams to deepen connections, maintain a strong community, and do their best work.