Description
Multi-cloud is core to Databricks' product strategy. Compute serves as the layer that abstracts the cloud from the rest of the company. As a Senior Software Engineer on this team, you will build unified infrastructure on top of heterogeneous clouds.
You won't just manage infrastructure; you will build it as a product. You will tackle the hard problems of distributed systems: sub-second container/MicroVM startup times, multi-tenant security isolation, and building a unified orchestration layer that scales across AWS, Azure, and GCP.
Responsibilities
- Design and build the next generation of our Serverless platform, focusing on high availability, low latency, and scale-to-zero efficiency.
- Build a single compute stack that supports heterogeneous workloads, including GPU instance qualification for AI training and stateful execution for Lakebase.
- Solve Multi-Cloud Complexity: Develop platform-level abstractions that allow Databricks to run seamlessly across all major cloud providers.
- Optimize everything from the API gateway down to the host-level networking and container orchestration.
- Work alongside industry experts who have built world-class systems like Borg, Kubernetes, and Uber's infrastructure.
Requirements
- 5+ years of production-level experience in one of: Python, Java, Scala, C++, or a similar language
- 4+ years of experience developing large-scale distributed systems from scratch
- Experience with Kubernetes, Docker, or MicroVM technologies (e.g., Firecracker) and a strong grasp of cloud provider internals (AWS/Azure/GCP).
- You understand how to build tools from the ground up when existing solutions fail at our scale.
Pay Range Transparency
The pay range for this role is $164,200-$205,200 USD. Actual compensation packages are based on several factors that are unique to each candidate.
Benefits
Comprehensive benefits and perks that meet the needs of all employees are provided. For specific details on the benefits offered in your region, click here.