Senior AI Training Performance Engineer

NVIDIA is seeking a Senior AI Training Performance Engineer to help optimize AI training workloads. As a senior engineer, you will work across all layers of the hardware/software stack to achieve peak performance.

Job Overview: This role offers the opportunity to directly impact the hardware and software roadmap in a fast-growing technology company that leads the AI revolution.

Responsibilities:

• Understand, analyze, profile, and optimize AI and deep learning training workloads on state-of-the-art hardware and software platforms.
• Understand the big picture of training performance on GPUs, prioritizing and then solving problems across many dozens of state-of-the-art neural networks.
• Implement production-quality software in multiple layers of NVIDIA's deep learning platform stack, from drivers to DL frameworks.
• Implement key DL training workloads in NVIDIA's proprietary processor and system simulators to enable future architecture studies.
• Build tools to automate workload analysis, workload optimization, and other critical workflows.

Requirements:

• PhD (or equivalent experience) in CS, EE or CSEE and 5+ years; or MS and 8+ years of relevant work experience.
• Strong background in deep learning and neural networks, in particular training.
• Deep understanding of computer architecture, and familiarity with the fundamentals of GPU architecture.
• Proven experience analyzing and tuning application performance.
• Experience with processor and system-level performance modelling.
• Programming skills in C++, Python, and CUDA.
• Fluency in English