Senior Distributed Software Engineer

Join NVIDIA's DGX Cloud Team as a Senior Distributed Software Engineer, contributing to the infrastructure that powers innovative AI research. You'll develop and optimize AI infrastructure services to bring peak AI performance and high resiliency for DGX Cloud.

Your work will focus on:

• Developing solutions at the intersection of machine learning, distributed systems, and high-performance computing
• Designing, developing, and optimizing services orchestrated by Kubernetes to provide large-scale AI training workflows
• Co-designing and implementing APIs that allow these services to integrate vertically with NVIDIA's resiliency stacks
• Crafting a submission abstraction that enables model engineers and training platforms/frameworks to seamlessly submit long-running training jobs
• Crafting these services to be modular, enabling them to be coordinated with and deployed onto on-premises AI clusters

Requirements:

• Bachelor's degree or higher in Computer Science or a related technical field
• 5+ years of hands-on experience in backend development, preferably with Python, Go, C/C++, or similar high-performance languages
• Consistent track record of building and scaling large-scale distributed systems
• Experience with cloud computing platforms such as AWS, Azure, and GCP, as well as container technologies like Docker and Kubernetes, and HPC/AI platforms such as Slurm

Nice to have:

• Real-world experience in DL frameworks, orchestrators like PyTorch, TensorFlow, JAX, and Ray
• Experience in developing a framework plugin architecture that allows the framework to be integrated with the cluster scheduler visibly to the users
• Strong understanding of NVIDIA GPUs, network technologies, and their failure patterns
• Experience with AI models and AI-based tools

You'll receive a base salary between 152,000 USD and 287,500 USD, depending on your location, experience, and the pay of employees in similar positions. You'll also be eligible for equity and benefits.