# Manager, Software Engineering - Production AI Inference

**Company**: NVIDIA
**Location**: Santa Clara, CA
**Experience**: senior
**Job type**: full-time
**Category**: Engineering
**Industry**: Technology

**Apply**: https://nvidia.wd5.myworkdayjobs.com/en-US/NVIDIAExternalCareerSite/job/US-CA-Santa-Clara/Manager--Software-Engineering---Production-AI-Inference_JR2020451?utm_source=yubhub.co&utm_medium=jobs_feed&utm_campaign=apply
**Canonical**: https://yubhub.co/jobs/job_16603465-138

## Description

We are seeking a technical software manager to lead production AI inference for NVIDIA Inference Microservices (NIM). As a hands-on engineering management role, you will lead engineers working across model onboarding, serving stack integration, performance profiling/optimization, release quality, security readiness, automation, observability, and operational health.

Responsibilities:

- Lead the team responsible for shipping production-ready LLM NIMs, including planning, new model onboarding, validated serving recipes, release readiness, and post-release follow-through.

- Build a predictable operating model for the team through roadmap planning, a weekly execution rhythm, launch checklists, clear ownership boundaries, collaborator communication, and issue management.

- Own project execution by anticipating schedule, staffing, and dependency risks.

- Drive continuous improvement in production workflows through RCCA and partner feedback.

- Build and maintain a world-class AI inference engineering team by building an innovative culture, setting clear expectations, and mentoring engineers and emerging leaders.

Requirements:

- 10+ overall years building production software, including 3+ years of managing software engineering teams.

- Experience delivering production software with strong quality, reliability, and release expectations.

- Experience driving process improvements and improving operational efficiency.

- Excellent communication and collaborator management.

- Deep understanding of AI/ML fundamentals, innovative model architectures, inference engine/kernel, performance optimization strategies, accelerated computing, large-scale distributed systems, and security hardening.

- A degree in Computer Science, Computer Engineering, or a related field (BS or MS) or equivalent experience.

Benefits:

- Competitive salaries

- Generous benefits package

- Equity eligibility

## Skills

### Required
- AI/ML
- software engineering
- production software
- team management
- performance optimization
- security hardening
- large-scale distributed systems

### Nice to have
- open-source ecosystems
- containers
- Kubernetes
- GPU technologies
- enterprise AI software

---

Source: [Apply at nvidia.wd5.myworkdayjobs.com](https://nvidia.wd5.myworkdayjobs.com/en-US/NVIDIAExternalCareerSite/job/US-CA-Santa-Clara/Manager--Software-Engineering---Production-AI-Inference_JR2020451?utm_source=yubhub.co&utm_medium=jobs_feed&utm_campaign=apply)