# Data Scientist, Evals

**Company**: Perplexity
**Location**: London
**Work arrangement**: hybrid
**Experience**: mid
**Job type**: full-time
**Category**: Engineering
**Industry**: Technology

**Apply**: https://jobs.ashbyhq.com/perplexity/4615ca06-bea7-47e3-9e57-f5cee52b75e6
**Canonical**: https://yubhub.co/jobs/job_672d30aa-d0f

## Description

We are seeking a Data Scientist to join our team in London, Belgrade, Berlin, or San Francisco. As a Data Scientist, you will build specialized evals to improve answer quality across Perplexity, covering search-based LLM answers and other scenarios popular with our users.

## What you'll do

- Architect and maintain automated evaluation pipelines to assess answer quality across Perplexity's products, ensuring high standards for accuracy and helpfulness

- Design evaluation sets and methods specifically to measure the impact of tool calls (particularly web search retrieval) on the final answer's quality

## What you need

- PhD or MS in a technical field or equivalent experience

- 4+ years of experience in data science or machine learning

## Skills

### Required
- Python
- SQL
- AWS
- Databricks

### Nice to have
- LLMs
- customer-facing web products
- research background