Description
At Databricks, we are passionate about enabling data teams to solve the world's toughest problems , from making the next mode of transportation a reality to accelerating the development of medical breakthroughs.
As a software engineer with a backend focus, you will work with your team to build infrastructure for the Databricks platform at scale.
About the Team We manage the infrastructure efficiency for one of the world's largest data and AI platforms. Operating at massive scale across AWS, Azure, and GCP, our mission is to ensure that every dollar spent on cloud infrastructure is optimized.
The Role As a Senior Software Engineer, you will own the end-to-end design and delivery of high-impact engineering projects. You will act as a primary owner of key system components, handling technical ambiguity, collaborating with stakeholders, and delivering robust, scalable solutions.
The impact you will have:
- End-to-End System Design: Lead projects from concept to deployment. You will design and build scalable systems that handle high-volume data streams to provide accurate cost attribution and resource management, turning chaotic cloud spend into actionable data.
- Scaling & Optimization: Identify and eliminate inefficiencies in our cloud architecture. You will engineer solutions that mitigate resource waste, improve attribution accuracy, and raise the efficiency of our underlying cloud and data infrastructure.
- Component Ownership: Act as the technical expert for your service area. You will take ownership of the full lifecycle of your services, ensuring high code quality, effective monitoring, and low operational overhead.
- Bridge the Gap: Work effectively with product and infrastructure teams to turn business needs into technical specifications. You will develop tooling that simplifies the complex world of cloud economics for other engineers and budget owners.
- Mentorship & Best Practices: Uplevel the team by contributing to code reviews, sharing engineering best practices, and mentoring junior engineers.
- Automate the manual: Build the automation and AI/agentic tooling that detects waste, attributes cost, and remediates issues with minimal human intervention , turning repetitive cost operations into self-running systems.
What We Look For:
- 6+ years of experience, including producing high-quality production code and detailed technical design documents for distributed systems.
- Proven ability to break down complex, multi-month projects into actionable milestones and tasks.
- Solid grasp of industry best practices for distributed systems (monitoring, documentation, testing, and "fit and finish").
- Experience in optimizing cloud resource utilization or developing large-scale distributed tools.
- Ability to make well-reasoned trade-offs between system performance, development velocity, and technical debt.
Benefits: At Databricks, we strive to provide comprehensive benefits and perks that meet the needs of all of our employees.