Description
We are seeking a Senior Data Engineer to join our Platform team. As a Senior Data Engineer, you will be responsible for designing, building, and operating cloud infrastructure on AWS to support our customers' needs. You will work closely with our cross-functional teams to develop and deploy new features, improve data infrastructure, and implement systems for supporting data processing tasks.
Your responsibilities will include:
- Developing a deep understanding of our Platform and its customers
- Building and operating cloud infrastructure on AWS based on customer requirements
- Solving development and deployment challenges to make our infrastructure highly reliable, easy to maintain, and cost-effective
- Participating in the development, execution, and support of new feature rollouts with solution architects, forward-deployed engineers, and customer success teams
- Leading the development of improvements to data infrastructure, pipeline automation, codebase quality, and data quality
- Designing, architecting, and implementing systems for supporting data processing tasks, such as metadata, configuration, and data pipeline inputs
- Developing and contributing to existing and new monitoring and alerting systems for Platform infrastructure
- Hardening infrastructure security, including network, storage, user access, and more
- Responding and solving key customer-reported issues in a timely manner
- Participating in an on-call rotation
- Spearheading the adoption of AI-driven development workflows, integrating LLM-based tools into the SDLC to accelerate feature delivery and reduce mean time to resolution (MTTR)
To be successful in this role, you will need:
- Proficiency in Python, with deep technical troubleshooting skills and extensive experience building backend APIs and microservices
- Expert-level knowledge of AWS core services and the ability to architect scalable solutions from high-level requirements
- Proficiency in Terraform/Scalr and experience building robust CI/CD pipelines using GitHub Actions
- Solid understanding of networking fundamentals (subnets, CIDR, VPCs) to ensure secure, global application accessibility
- Expertise with big-data tools and workflow orchestrators such as Snowflake, Databricks, Airflow, Temporal
- Ability to leverage AI tools (Gemini, ChatGPT, Cursor) to streamline engineering workflows and enhance personal productivity
- Proven track record of driving complex projects to completion and excellent cross-team communication skills
Preferred skills include:
- Experience with AWS preferred, including AWS Cloud Infrastructure certification
- Experience with data privacy concerns such as HIPAA or GDPR
- Experience working with cross-functional teams and with other customer-facing teams
- Passion for our mission and technology
- Ownership of work and accountability
- Expertise in at least one area and willingness to learn from others
This role is eligible for performance-based bonuses, equity awards, and benefits including comprehensive health, dental, and vision insurance, flexible time off, and holidays.
The starting annual base pay for this role is $176,000-$210,000 USD in the San Francisco Bay Area and New York City, and $153,000-$190,000 USD in all other US locations.