Description
At Trunk, our mission is to help teams create high-quality software quickly. We've helped engineerings teams at Google X, Zillow, and Brex to understand why their builds fail, which tests are flaky, and how to ship code faster without sacrificing reliability.
The bottleneck has shifted downstream - to merge conflicts, flaky tests, inconsistent code quality, and dozens of other frictions that drain productivity and morale. Engineering teams that can stay focused on designing, implementing, and delivering software will build magical, high-quality projects - and they'll be happier doing it.
We're building a CI Reliability Platform that empowers teams to land code faster and develop happier.
We are looking for a motivated and experienced Senior Software Engineer to join our Platform/Data Engineering team. In this role, you will be responsible for developing and optimizing data ingestion pipelines that can handle vast amounts of real-time and batch data from various sources.
Your focus will be on designing systems that are scalable, reliable, and performant, as well as ensuring the proper integration of data across our entire ecosystem.
Responsibilities
- Design, build, and maintain scalable data ingestion pipelines to handle large volumes of structured and unstructured data.
- Optimize and improve the efficiency of existing data processing workflows, ensuring they can scale as the data grows.
- Collaborate with cross-functional teams to gather data requirements and ensure seamless integration with various data sources.
- Implement real-time and batch processing systems for ingesting data from APIs and webhooks.
- Ensure data quality, consistency, and integrity across all data pipelines.
- Troubleshoot and resolve performance bottlenecks and data-related issues in the ingestion pipeline.
- Develop monitoring and alerting systems to proactively manage the health of data pipelines.
- Continuously evaluate and adopt new technologies and tools to improve the scalability and performance of our systems.
- Document the design, implementation, and operations of data pipelines for knowledge sharing within the team.
Requirements
- 4-5+ years of professional software engineering experience
- You're located within commute distance of San Francisco and are willing to work in office at least 8 days per month.
- You have experience in areas such as databases, distributed systems, service-oriented architectures, and data infrastructure
- You derive joy from refactoring and building clean abstractions in order to make complex systems fun to develop on and easy to understand
- Excellent debugging and troubleshooting skills and the tenacity to drive a solution to a conclusion
- Experience and intuition to zero in on root causes for bugs that can leave others stumped
- The ability to operate independently, but know when you are in too deep and need to ask for help
- Ability to collaborate with colleagues to plan and execute the best solution
Tech Stack
- Frontend: Typescript, React, Next.js, AWS
- Backend: Typescript, Node, AWS
- Data pipelines: Dagster, python, polars
- CI/CD: GitHub Actions
Benefits
- Unlimited PTO
- Competitive salary and equity
- Work-life balance
- Lunch ordered in on us at the office on Wednesdays and Thursdays
- Few meetings, so you can ship fast and focus on building
- One Medical membership on us!
- Top-notch medical, dental, vision, short-term disability, long-term disability, and life insurance
- All insurance is 100% company-paid ($0 premiums) for employees and highly subsidized for dependents
- FSA, HSA with company contributions, and pre-tax commuter benefits
- 401(k) plan
- Paid parental leave (up to 12 weeks)
The salary and equity range for this role are: $170K - $210K and .15% - .35%.