Description
Toast creates technology to help restaurants and local businesses succeed in a digital world, helping business owners operate, increase sales, engage customers, and keep employees happy.
The AI Agent & Experience team is Toast's internal platform team for AI. We build the infrastructure, governance, and developer tooling that makes AI a reliable, scalable force multiplier across the entire product development lifecycle.
As a Senior Software Engineer on this team, you'll be hands-on building the systems that other Toast engineers depend on every day: the LLM proxy, agentic workflows, and the plugin marketplace that brings AI-native development practices to teams across the company.
Responsibilities
- Design, build, and ship features across AI platform infrastructure, including the LLM proxy, AI key management, and observability pipelines
- Develop and extend autonomous agents that participate in the SDLC, such as the AI Review GitHub App and Developer Platform MCP integrations
- Build on and contribute to the internal plugin marketplace, developing plugins that encode Toast's architectural standards and quality practices into AI assistant behavior
- Implement MCP (Model Context Protocol) services and service templates that make it faster and easier for teams across Toast to build AI-powered workflows
- Write high-quality, well-tested code and participate in design and code reviews
- Collaborate with engineers, product managers, and platform teams to understand developer needs and translate them into reliable platform solutions
- Contribute to the team's adoption of agentic development practices and tooling
- Leverage cutting edge AI tools to enhance your development workflow, improve velocity, and help pioneer new approaches to building - contributing to a culture of innovation and productivity across the team.
Requirements
- Bachelor’s Degree with relevant experience of 5+ years in designing and implementing scalable backend services
- Demonstrated experience building, deploying, or operating LLM-powered agents or AI-assisted developer tooling
- Familiarity with AI coding assistants (e.g., Claude Code, Cursor, GitHub Copilot) and an interest in extending them through custom plugins, skills, or hooks
- Experience with MCP (Model Context Protocol), tool use patterns, or similar agentic integration frameworks
- Working knowledge of prompt engineering and how LLM behavior responds to context and instructions
- Strong foundation in Java, Kotlin, or another object-oriented language
- Experience with distributed systems, REST APIs, and cloud-native infrastructure
- Strong customer empathy and a drive to make developers' lives better through reliable, well-designed platform solutions
Nice to Have
- Familiarity with A2A (Agent-to-Agent) protocols and multi-agent orchestration patterns
- Experience with machine learning concepts, model evaluation, or ML infrastructure
- Experience building developer experience platforms, internal tooling, or API gateways
- Familiarity with observability tooling for AI/LLM systems (e.g., Langfuse, DataDog)