# Product Manager, Toast IQ Evaluation **Company**: Toast **Location**: Remote, US **Work arrangement**: remote **Salary**: Zone A: $159,000-$254,000 USD Zone B: $138,000-$221,000 USD Zone C: $125,000-$200,000 USD **Category**: Product Management **Industry**: Technology **Apply**: https://job-boards.greenhouse.io/toast/jobs/7673399?utm_source=yubhub.co&utm_medium=jobs_feed&utm_campaign=apply **Canonical**: https://yubhub.co/jobs/job_7a3cdfc3-c61 ## Description Toast creates technology to help restaurants and local businesses succeed in a digital world, helping business owners operate, increase sales, engage customers, and keep employees happy. As Product Manager, Toast IQ Evaluation, you’ll define what good help looks like for a restaurant operator and build the evidence that tells us whether Toast IQ delivers it. ## Responsibilities - Understand the operator’s experience. Review real Toast IQ sessions every week. Describe what went wrong in plain operator language. Work directly with operators, including in live sessions, to check that our evaluations reflect what matters to them. - Find and prioritize recurring failures. Group observations into failure modes, measure how often they occur, and assess their impact on operators. Use that evidence to identify the problems most worth solving. - Build trustworthy evaluation datasets. Create and maintain labeled examples covering common workflows, edge cases, and known failures. - Verify that improvements hold up. Validate fixes in real sessions and turn important production failures into regression cases that catch the same problems in future releases. - Help teams across Toast evaluate their work. Lead reviewer calibration sessions and help product teams create and maintain evaluation cases for their capabilities. - Turn findings into product decisions. Surface tools that aren’t delivering value, intents Toast IQ can’t handle, and workflows that need a product team’s attention. Make the operator’s problem and its impact clear enough to act on. - Build tools that make the work better. Use AI coding tools to create faster review interfaces, automate recurring analysis, monitor common failures, and prototype fixes. ## Requirements - Restaurant knowledge: You’ve worked in a restaurant or closely with operators. You understand how decisions about menus, labor, sales, and inventory play out during a busy Friday night. - Care for detailed work: You’re comfortable reading hundreds of transcripts, labeling examples by hand, and keeping datasets accurate and current. - Comfort with structured data: You can investigate data using a database, queries, or an AI coding tool and check that the results are trustworthy. - Precise thinking and writing: You can turn an ambiguous observation into a clear failure definition or scoring rule that someone else can apply consistently. - Clear communication: You can explain what happened, why it matters to operators, and what should change in language that engineers, product teams, and leadership can use. - Curiosity about AI systems: You want to understand how large language model systems fail and are willing to learn new evaluation methods on the job. - Familiarity with Toast's products: You’ll work closely with product teams across Toast, and knowing their products gives you a leg up in advising them. ## Benefits Our total rewards package goes beyond great earnings potential and provides the means to a healthy lifestyle with the flexibility to meet Toasters’ changing needs. ## Salary Range The base salary range for this role is: Zone A: $159,000-$254,000 USD Zone B: $138,000-$221,000 USD Zone C: $125,000-$200,000 USD ## Skills ### Required - restaurant knowledge - data analysis - AI coding tools - precise thinking and writing - clear communication ### Nice to have - product management experience --- Source: [Apply at job-boards.greenhouse.io](https://job-boards.greenhouse.io/toast/jobs/7673399?utm_source=yubhub.co&utm_medium=jobs_feed&utm_campaign=apply)