Senior AI Infrastructure Engineer

NVIDIA is seeking a Senior AI Infrastructure Engineer to join the DGX Cloud group. The successful candidate will design, build, and maintain large-scale production systems with high efficiency and availability using software and systems engineering practices.

The role involves designing, building, deploying, and running internal tooling for large-scale AI training and inferencing platforms built on cloud infrastructure. The engineer will conduct in-depth performance characterization and analysis on large multi-GPU and multi-node clusters, engage in and improve the whole lifecycle of services, and support services before they become available.

Responsibilities include:

• Designing, building, deploying, and running internal tooling for large-scale AI training and inferencing platforms
• Conducting in-depth performance characterization and analysis on large multi-GPU and multi-node clusters
• Engaging in and improving the whole lifecycle of services
• Supporting services before they become available
• Maintaining services once they are live
• Scaling systems sustainably through automation
• Practicing sustainable incident response and blameless postmortems
• Being part of an on-call rotation to support production systems

Requirements:

• BS degree in Computer Science or a related technical field
• 5+ years of experience
• A track record showing a good balance between initiating projects, collaborating with others, and convincing others to collaborate
• Background in infrastructure automation and distributed systems architecture
• Experience working with languages such as Python, Go, C/C++, Java
• Comprehensive understanding of Linux, Networking, Storage, and Containers Technologies
• Experience with Public Cloud and Infrastructure as a Code (IAAC) and Terraform
• Distributed system experience

Nice to have:

• Interest in crafting, analyzing, and fixing large-scale distributed systems
• Systematic problem-solving approach, coupled with strong communication skills and a sense of ownership and drive
• Capability to identify issues and improve code performance while automating routine tasks

NVIDIA offers a competitive salary, equity, and benefits package. The expected base salary ranges for this position are: 152,000 USD – 241,500 USD for Level 3; and 184,000 USD – 287,500 USD for Level 4.