Machine Learning Engineer - Conversational AI

The Personalization team at Spotify makes deciding what to listen to next feel effortless for hundreds of millions of users. We're now building conversational AI capabilities that let users interact with Spotify in natural language.

You’ll join a squad working at the core of this space, shaping how users discover and engage with audio through intelligent, responsive systems.

Responsibilities

• Design and ship production-grade machine learning systems powering conversational and agentic AI experiences
• Build systems that interpret user intent, manage context across multi-turn interactions, and handle ambiguity reliably at scale
• Develop and evolve agentic workflows including memory, context management, and multi-step tool orchestration
• Create evaluation frameworks, including LLM-as-judge pipelines, to measure quality and guide iteration
• Partner closely with product, engineering, and design to deliver seamless, user-facing experiences
• Balance experimentation with production rigor, ensuring performance, latency, and reliability at Spotify scale
• Continuously improve agent behavior through tight feedback loops between evaluation and real-world usage

Requirements

• 5+ years of experience building and shipping machine learning systems in production environments
• Experience with large language models and real-world applications beyond experimentation
• Deep understanding of challenges in conversational or agentic systems, such as context handling and multi-step reasoning
• Ability to evaluate ML systems rigorously and design metrics or evaluation pipelines
• Comfortable debugging complex interactions between models, tools, and system constraints like latency
• Care about building reliable, scalable systems that deliver high-quality user experiences
• Enjoy working cross-functionally and contributing to a collaborative, inclusive team environment

Location and Benefits

• Based in New York
• Flexible work arrangements, with some in-person meetings
• United States base range: $184,050-$262,928 plus equity
• Benefits include health insurance, six-month paid parental leave, 401(k) retirement plan, monthly meal allowance, 23 paid days off, 13 paid flexible holidays, paid sick leave