Language Measurement Scientist

Duolingo is seeking a Language Measurement Scientist to support test development and research for the Duolingo English Test. You will join the Assessment Research and Development team, collaborating across disciplines to design and evaluate innovative language assessments.

Responsibilities:

• Collaborate with measurement researchers, engineers, and designers to develop innovative, research-driven language assessments.
• Design and evaluate assessment tasks, including new interactive item formats.
• Conduct qualitative and quantitative studies examining the validity, reliability, and fairness of assessment tasks and test scores.
• Apply language assessment and measurement principles to improve test design, content, scoring, and quality assurance.
• Translate research findings into clear recommendations for technical and non-technical partners.
• Share findings through technical reports, research publications, blog posts, and presentations to professional and academic audiences.

Requirements:

• A PhD in language testing, applied linguistics, second language acquisition, educational measurement, or a related field.
• Experience developing or conducting research on high-stakes language assessments or comparable professional experience.
• Expertise in language assessment, including test design, validity, reliability, fairness, and the measurement of language proficiency.
• Experience designing and analyzing qualitative and quantitative research studies.
• Experience communicating research through publications, reports, or presentations.
• The ability to explain complex measurement concepts clearly to collaborators from different disciplines.
• Proficiency with data-analysis tools such as R or Python.
• Strong collaboration, project-management, and organizational skills.

Exceptional candidates will have:

• Experience applying large language models, natural language processing, or related technologies to language assessment.
• Experience collaborating with software engineers, or AI researchers to develop digital assessment products.
• Experience designing or developing computer-adaptive tests.
• Expertise in evidence-centered design, interactive-task development, or integrated-skills assessment.

The offered salary is dependent upon several factors, including work experience, skills, and internal peer comparisons. The posted range is subject to change in the future. For this role, base salary is supplemented by equity compensation. The salary range is $110,500-$149,500 USD.

Benefits: Information about benefits can be found on the company's website.