Data Scientist, Evals

We are seeking a Data Scientist to join our team in London, Belgrade, Berlin, or San Francisco. As a Data Scientist, you will build specialized evals to improve answer quality across Perplexity, covering search-based LLM answers and other scenarios popular with our users.

What you'll do

• Architect and maintain automated evaluation pipelines to assess answer quality across Perplexity's products, ensuring high standards for accuracy and helpfulness
• Design evaluation sets and methods specifically to measure the impact of tool calls (particularly web search retrieval) on the final answer's quality

What you need

• PhD or MS in a technical field or equivalent experience
• 4+ years of experience in data science or machine learning