# Member of Technical Staff - Copilot AI Evaluation Engineering Manager

**Company**: Microsoft AI
**Location**: Mountain View
**Work arrangement**: onsite
**Experience**: staff
**Job type**: full-time
**Salary**: USD $139,900 – $274,800 per year
**Category**: Engineering
**Industry**: Technology

**Apply**: https://microsoft.ai/job/member-of-technical-staff-copilot-ai-evaluation-engineering-manager/
**Canonical**: https://yubhub.co/jobs/job_bab8e903-9f8

## Description

## Summary

Microsoft AI are looking for a talented Member of Technical Staff - Copilot AI Evaluation Engineering Manager at their Mountain View office. This role sits at the heart of strategic decision-making, turning market data into actionable insights for a company that's revolutionising AI technology. You'll work directly with leadership to shape the company's direction in the AI market.

## About the Role

As a Member of Technical Staff - Copilot AI Evaluation Engineering Manager, you will lead building our LLM evaluation solutions for Copilot. You'll work in a deeply iterative, collaborative, fast-paced environment to improve our technology for millions of users around the world. You will lead a team of talented software engineers and applied AI engineers to deliver world-class evaluation solutions that are secure, reliable, and scalable, while collaborating closely with cross-functional teams including Product and Research.

## Accountabilities

- Hire, manage, and lead a team of software engineers, AI engineers, and machine learning engineers responsible for delivering world-class LLM evaluation solutions.

- Collaborate with Eng and Product leadership to prioritize features and improve our world-class AI companion to the world.

## The Candidate we're looking for

**Experience:**

- 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python.

**Technical skills:**

- Hands on experience with ML and/or AI evaluation.

**Personal attributes:**

- Thrive in a fast-paced, collaborative environment and are comfortable making progress in ambiguity.

## Benefits

- Software Engineering M5 – The typical base pay range for this role across the U.S. is USD $139,900 – $274,800 per year.

- Certain roles may be eligible for benefits and other compensation.

## Skills

### Required
- C
- C++
- C#
- Java
- JavaScript
- Python
- ML
- AI evaluation

### Nice to have
- hands on experience with ML and/or AI evaluation