Senior Applied ML Engineer - ML4Sys

As a Senior Applied ML Engineer on the Applied AI team at Databricks, you will use machine learning, scheduling, and optimisation algorithms to maximise the efficiency and performance of our infrastructure.

Your work will span the entire stack,from cluster management down to query compilation. You will solve complex, high-impact engineering problems to deliver highly optimised, cost-effective workloads for our customers.

Impact You Will Have:

• Accelerate Serverless Growth: Drive the scaling and efficiency of Databricks serverless compute products through advanced optimisation techniques.
• Build Systems: Design end-to-end ML4Sys solutions from the ground up within a lean team of domain experts.
• Shape Strategy: Define the roadmap for applied ML investments by collaborating with engineering and product leaders across Databricks.
• Drive Deployment: Architect, train, and deploy state-of-the-art models that directly improve product performance and cost efficiency.
• Scale Infrastructure: Build robust ML pipelines, data processing layers, model serving components, and production monitoring systems.
• Innovate: Research and implement novel modelling techniques tailored specifically to computer systems and distributed environments.

Minimum Qualifications:

• Education: Background in Computer Science and Master's degree in Machine Learning, Data Science, or a related computational field.
• ML Experience: Strong background in building, training, and deploying machine learning models in production.
• Infrastructure Knowledge: Practical familiarity with cloud computing, distributed systems, and modern data processing frameworks.
• Core Coding: Proficiency in Python, Scala, or Java.

Preferred Skills:

• Advanced Education: PhD in AI, Data Science, or a related technical discipline.
• Industry Experience: 4+ years of machine learning engineering experience in high-velocity, high-growth environment.
• Systems Domain: Strong understanding of computer architecture, distributed computing, cloud compute, database internals, or networking.
• Optimisation: Experience with operations research, forecasting, Markov decision processes, or other optimisation algorithms for sequential decision making.
• Scale: Proven track record of optimising large-scale distributed systems or cloud infrastructure via data-driven approaches.