Description
NVIDIA is seeking a Senior Deep Learning Software Infrastructure Engineer to propel its Autonomous Vehicles project forward. You will build and scale training libraries and infrastructure for end-to-end autonomous driving models.
Job Overview As a Senior Deep Learning Software Infrastructure Engineer at NVIDIA, you will craft, scale, and harden deep learning infrastructure libraries and frameworks for training on multi-thousand GPU clusters. Your work will focus on improving efficiency throughout the training stack, including data loaders, distributed training, scheduling, and performance monitoring. You will collaborate with researchers, model engineers, and internal platform teams to enhance efficiency, minimize stalls, and improve training availability.
Key Responsibilities
- Develop and scale deep learning infrastructure libraries and frameworks for large-scale GPU clusters.
- Improve training stack efficiency, including data loaders, distributed training, and performance monitoring.
- Build robust training pipelines and libraries for handling massive video datasets.
- Collaborate with cross-functional teams to optimize training processes.
- Own core infrastructure components such as orchestration libraries and fault-resilient training systems.
- Work with leadership to ensure infrastructure scalability and stability.
Requirements
- BS, MS, or PhD in Computer Science, Electrical/Computer Engineering, or a related field.
- 12+ years of experience in building and scaling high-performance distributed systems, preferably in ML, HPC, or large-scale data infrastructure.
- Extensive knowledge of deep learning frameworks (PyTorch preferred), large-scale training, and performance profiling.
- Strong systems background, including datacenter networking, parallel filesystems, and schedulers.
- Proficiency in Python with experience in writing production-grade libraries and automation tools.
Nice to Have
- Experience scaling large GPU training clusters with over 1,000 GPUs.
- Expertise in fault resilience and high availability.
- Leadership skills as a hands-on technical authority.
You will also be eligible for equity and benefits.