Description
We're looking for a High-Performance LLM Training Engineer to optimize NVIDIA's high-performance LLM software stack in frameworks like PyTorch and JAX for high-performance pre-training and post-training on thousands of GPUs.
What you'll be doing:
- Understand, analyze, profile, and optimize AI training workloads on innovative hardware and software platforms.
- Prioritize and solve problems across all state-of-the-art LLMs.
- Implement production-quality software in multiple layers of NVIDIA's deep learning platform stack.
- Implement key LLM training workloads in NVIDIA's proprietary processor and system simulators.
- Build agentic tools to automate workload analysis and optimization.
What we want to see:
- M.S. or PhD in Computer Science, Electrical Engineering or Computer Engineering (or equivalent experience).
- Strong background in deep learning and neural networks, particularly model training optimizations.
- Deep background in computer architecture and familiarity with GPU architecture fundamentals.
- Proven experience analyzing and tuning application performance and processor and system-level performance modeling.
- Programming skills in C++, Python, and CUDA.
You'll receive a highly competitive salary and comprehensive benefits package, including equity.
This listing is enriched and indexed by YubHub. To apply, use the employer's original posting:
https://nvidia.wd5.myworkdayjobs.com/en-US/NVIDIAExternalCareerSite/job/US-CA-Santa-Clara/High-Performance-LLM-Training-Engineer---New-College-Grad-2027_JR2028237