Description
Inference is the fastest growing and most competitive area in Generative AI today. It is where AI models impact our daily life, and where every bit of accuracy and performance matters for quality, safety, and cost.
As a Senior Product Manager for AI Platform Inference at NVIDIA, you will be responsible for building the tools, SDKs, and libraries which enable developers' Inference deployments to thrive on NVIDIA GPUs.
Your goal will be to enable developers to be successful on the NVIDIA Platform, and push the boundaries of what is possible with their AI deployments. You will work directly with developers inside and outside of the company to identify key improvements, create roadmaps, and stay alert on the inference landscape.
Responsibilities:
- Create products to help developers build better Inference deployments
- Develop product strategy, roadmaps, and go-to-market plans
- Collaborate with internal and external developers to build product-based roadmaps for model optimization software
- Work with leadership to align with and drive company strategy
Requirements:
- Experience with Inference deployment and optimization software (e.g., vLLM, SGLang, FlashInfer, TensorRT-LLM, Triton, Dynamo, TorchAO)
- Demonstrable knowledge of GenAI or machine learning concepts, particularly around performance optimization, and software development and delivery
- BS or MS degree in Computer Science, Computer Engineering, or similar experience
- 6+ years of technical product management experience at a technology company
- Strong communication and interpersonal skills
Preferred Qualifications:
- Experience leading optimization products for Inference
- Working on Open Source & Github-first developer products with deep customer interactions
- Knowledge of GPU architecture, HW/SW co-design, and performance profiling
You will also be eligible for equity and benefits.