Manager, Software Engineering - Production AI Inference

We are seeking a technical software manager to lead production AI inference for NVIDIA Inference Microservices (NIM). As a hands-on engineering management role, you will lead engineers working across model onboarding, serving stack integration, performance profiling/optimization, release quality, security readiness, automation, observability, and operational health.

Responsibilities:

• Lead the team responsible for shipping production-ready LLM NIMs, including planning, new model onboarding, validated serving recipes, release readiness, and post-release follow-through.
• Build a predictable operating model for the team through roadmap planning, a weekly execution rhythm, launch checklists, clear ownership boundaries, collaborator communication, and issue management.
• Own project execution by anticipating schedule, staffing, and dependency risks.
• Drive continuous improvement in production workflows through RCCA and partner feedback.
• Build and maintain a world-class AI inference engineering team by building an innovative culture, setting clear expectations, and mentoring engineers and emerging leaders.

Requirements:

• 10+ overall years building production software, including 3+ years of managing software engineering teams.
• Experience delivering production software with strong quality, reliability, and release expectations.
• Experience driving process improvements and improving operational efficiency.
• Excellent communication and collaborator management.
• Deep understanding of AI/ML fundamentals, innovative model architectures, inference engine/kernel, performance optimization strategies, accelerated computing, large-scale distributed systems, and security hardening.
• A degree in Computer Science, Computer Engineering, or a related field (BS or MS) or equivalent experience.

Benefits:

• Competitive salaries
• Generous benefits package
• Equity eligibility