# Software Engineer III

**Company**: Electronic Arts
**Location**: Vancouver, British Columbia
**Work arrangement**: hybrid
**Experience**: senior
**Job type**: full-time
**Category**: Engineering
**Industry**: Technology
**Ticker**: EA
**Wikidata**: https://www.wikidata.org/wiki/Q173941

**Apply**: https://jobs.ea.com/ko_KR/careers/JobDetail/SE-III-SGP-Icon-Mode/216421?utm_source=yubhub.co&utm_medium=jobs_feed&utm_campaign=apply
**Canonical**: https://yubhub.co/jobs/job_0f666f6f-90e

## Description

Electronic Arts crafts next-generation entertainment experiences that inspire players and fans globally. Here, everyone is part of the story, contributing to a community that values creativity, diverse perspectives, and innovative ideas.

In FC Quality Verification Engineering, the mission is to help teams identify quality issues earlier by building automation frameworks and developer tools that combine software development and applied AI/ML to improve testing for EA-SPORTS FC.

You will work on building automated testing frameworks and evaluation tools, applying AI and machine learning to expand test coverage. Reporting to the Engineering Manager, you will work hybrid, at least 3 days a week, from the office in Burnaby, BC.

Responsibilities:

- Build automated testing frameworks, validation checks, and CI/CD pipeline integrations with reproducible diagnostics.

- Develop methods to explore complex software behaviour, identify coverage gaps, and detect defects.

- Create automated checks to validate software behaviour and data against requirements.

- Develop evaluation frameworks for generative AI and LLMs-based systems, implementing LLM-as-a-judge patterns, rubric-based scoring, and automated calibration.

- Apply generative AI, NLP, and machine learning to solve complex software testing problems.

- Integrate testing tools into development pipelines, produce reproducible diagnostics, and support delivered software.

- Prototype latest machine learning and LLMs capabilities, collaborating with engineering, design, and quality partners.

Required qualifications:

- 5+ years of professional software engineering experience, including 2+ years of hands-on experience with AI/ML and LLMs-based systems.

- A Master of Science in Computer Science, Mathematics, or a related field, or equivalent professional engineering experience.

- In-depth experience with LLMs, generative AI, and NLP concepts, architectures, and failure modes.

- Experience developing evaluation frameworks for generative systems, including dataset curation, model-as-a-judge design, validation criteria, error analysis, and quantitative/qualitative metrics.

- Proficiency in Python, algorithms, data structures, modular design, automated testing, debugging, and version control.

- Experience preparing datasets, defining validation criteria, and performing error analysis using quantitative ML metrics.

- Experience with natural language processing or large language models, such as prompting, fine-tuning, or retrieval-augmented generation.

## Skills

### Required
- Python
- AI
- Machine Learning
- NLP
- LLMs
- software engineering
- automated testing
- CI/CD pipeline integrations

---

Source: [Apply at jobs.ea.com](https://jobs.ea.com/ko_KR/careers/JobDetail/SE-III-SGP-Icon-Mode/216421?utm_source=yubhub.co&utm_medium=jobs_feed&utm_campaign=apply)