Senior Software Engineer - Local AI

NVIDIA is seeking a Senior Systems Software Engineer to work on client-side AI challenges on Windows and Linux PCs with limited resources.

The successful candidate will partner with NVIDIA software, research, architecture, and product teams to align strategies and technical needs for fostering the ecosystem of AI on RTX and DGX PCs. They will collaborate closely with industry partners to advance AI across critical domains, including graphics, web browsers, and edge devices, by driving innovation in both open and closed source technologies with an emphasis on system-level support.

Key responsibilities include:

• Improving performance on current and next-generation GPU architectures by conducting in-depth analysis and end-to-end optimization of AI models, data processing pipelines, and inference runtime features.
• Identifying, evaluating, and implementing compute and memory optimization techniques, such as quantization, distillation, and pruning, for large AI models; fine-tuning and compressing models to fit edge devices.

Requirements:

• Bachelor's, Master's, or PhD in Computer Science, Software Engineering, Mathematics, or a related field (or equivalent experience).
• Excellent C++ programming and debugging skills with a strong understanding of data structures and algorithms.
• 5+ years of experience with proficiency in AI inferencing pipelines and applications using ML/DL frameworks, including ONNX RT, PyTorch, Tensor RT, llama.cpp, and vLLM.
• Strong analytical and problem-solving abilities, with the ability to multitask effectively in a dynamic environment.
• Outstanding written and oral communication skills enabling effective collaboration with management and engineering teams.

NVIDIA offers a competitive salary, equity, and a generous benefits package.