Description
At Databricks, we enable data teams to solve the world's toughest problems by building and running the world's best data and AI infrastructure platform. Our Model Serving product provides enterprises with a unified, scalable, and governed platform to deploy and manage AI/ML models. As a Senior Engineering Manager, you will lead the team owning both the product experience and the foundational infrastructure of Model Serving, shaping customer-facing capabilities while designing for scalability, extensibility, and performance across both CPU and GPU inference. The impact you will have includes leading, mentoring, and growing a high-performing engineering team, defining and owning the product and technical roadmap for Model Serving, collaborating closely with product, research, platform, and infrastructure teams, and ensuring Model Serving meets stringent SLAs, SLOs, and performance and reliability goals.
Key responsibilities include:
- Leading, mentoring, and growing a high-performing engineering team responsible for both the customer-facing Model Serving product and its foundational infrastructure.
- Defining and owning the product and technical roadmap for Model Serving, balancing customer experience, functionality, and foundational investments across deployment, inference, monitoring, and scaling.
- Collaborating closely with product, research, platform, and infrastructure teams to drive end-to-end delivery from ideation and prioritization to launch and operation.
- Ensuring Model Serving meets stringent SLAs, SLOs, and performance and reliability goals, continuously improving operational efficiency and customer experience.
- Driving architectural decisions and product design around latency, throughput, autoscaling, GPU/CPU placement, and cost optimization.
- Advocating for customer needs through direct engagement, ensuring engineering decisions translate to clear product impact.
- Promoting best practices in code quality, testing, observability, and operational readiness.
- Fostering a culture of excellence, inclusion, and continuous improvement across the team.
- Partnering with recruiting to attract, hire, and develop top-tier engineering talent.