Description
We are seeking Quality Control (QC) evaluators for a project involving Search and Linguistic tasks. As a QC evaluator, you will perform quality checks on initial ratings produced by evaluators, validating user intent assessment, query annotation, text classification, and multimedia reviews for relevance, accuracy, and guideline adherence.
Responsibilities:
- Audit samples of initial ratings for relevance, intent alignment, taxonomy compliance, and linguistic quality.
- Re-rate items to verify labels, resolve discrepancies, and document decisions.
- Perform linguistic quality checks and media comprehension reviews.
- Classify and track errors using an agreed error taxonomy, surfacing trends and edge cases.
- Provide clear, actionable feedback to evaluators and contribute to guideline clarifications and updates.
- Participate in and lead calibration sessions to drive inter-rater agreement.
- Track and report QC metrics and meet QC SLAs.
- Triage escalations, handle ambiguous cases, and ensure data integrity and compliance.
- Use internal tools to complete, track, and submit QC tasks accurately.
Requirements:
- English at C1 level or higher.
- Native or near-native speaker level in Indonesian language with strong reading, writing, and listening comprehension.
- Excellent grammar, writing, and proofreading skills.
- Strong video and image comprehension, good hearing ability for audio tasks.
- Solid understanding of search engines, user intent, and web content.
- High attention to detail, consistency, and guideline adherence.
- Ability to deliver clear written feedback and rationale.
Preferred Qualifications:
- Experience in QC/QA for text classification, query annotation, data labeling, or search quality evaluation.
- Familiarity with short dramas and local short-drama culture/platforms.
- Experience with calibrations, sampling, scorecards, and root-cause analysis.
- Comfortable working with productivity and quality targets, proficient with spreadsheets/QA tools.
- Background in linguistics, communications, media studies, information science, or related field.
For more fresh new jobs, check out yubhub.co.