Description
We're looking for a QA Deep Research Reviewer to evaluate long-form, AI-generated research outputs against detailed rubrics and guidelines.
You'll read documents that include tables and citations, judge each criterion on its own merits, and write clear, evidence-based rationales that help us improve the quality of AI research tools.
This role suits someone with a sharp editorial eye, a fact-checker's instincts, and the discipline to apply guidelines consistently.
Project Details:
- Location: Remote (United States)
- Commitment: 15-20 hours per week
- Engagement type: Freelancer
- Pay rate: $28 USD per hour
Responsibilities:
- Review long-form research responses covering US consumer topics such as personal finance and taxes, healthcare and insurance, home repair, pets, and travel planning
- Evaluate each response against rubric criteria, scoring every criterion independently so that an overall impression doesn't sway individual judgments
- Check claims, tables, and citations for accuracy, and distinguish primary sources from low-quality or content-farm pages
- Write short, specific rationales (1-3 sentences) that point to concrete evidence
- Follow guideline updates and calibrate your decisions consistently with the QA team
Must-Have Qualifications:
- Native or near-native US English (C2), with the ability to read long documents containing tables and citations
- Familiarity with US consumer topics: personal finance and taxes, healthcare and insurance, home repair, pets, and travel planning
- Bachelor's degree, or equivalent experience in research, editing, fact-checking, teaching, or QA
- Proven experience with rubric- or guideline-based evaluation (e.g., AI/LLM rating, search quality rating, content moderation, grading, or editorial QA)
- Ability to write concise rationales that cite evidence
- Ability to judge each criterion independently, without letting an overall impression influence the call
- Reliable availability of 15-20 hours per week, with a stable internet connection and a laptop or desktop computer
For more fresh new jobs, check out yubhub.co.