Senior Software Engineer, NCCL

We are looking for a highly motivated senior software engineer to join our communication libraries and network software team. The position will be part of a fast-paced crew that develops and maintains software for complex heterogeneous computing systems that power disruptive products in High Performance Computing and Deep Learning.

Responsibilities:

• Design, implement and maintain highly-optimized communication runtimes for Deep Learning frameworks (e.g. NCCL for TensorFlow/Pytorch) and HPC programming interfaces (e.g. UCX for MPI/OpenSHMEM) on GPU clusters.
• Participate in and contribute to parallel programming interface specifications like MPI/OpenSHMEM.
• Design, implement and maintain system software that enables interactions among GPUs and interactions between GPUs and other system components.
• Create proof-of-concepts to evaluate and motivate extensions in programming models, new designs in runtimes and new features in hardware.

Requirements:

• M.S./Ph.D. degree in CS/CE or equivalent experience.
• 5+ years of relevant experience.
• Excellent C/C++ programming and debugging skills.
• Strong experience with Linux.
• Expert understanding of computer system architecture and operating systems.
• Experience with parallel programming interfaces and communication runtimes.
• Ability and flexibility to work and communicate effectively in a multi-national, multi-time-zone corporate environment.

Nice to Have:

• Deep understanding of technology and passionate about what you do.
• Experience with CUDA programming and NVIDIA GPUs.
• Knowledge of high-performance networks like InfiniBand, iWARP etc.
• Experience with HPC applications.
• Experience with Deep Learning Frameworks such PyTorch, TensorFlow, etc.
• Strong collaborative and interpersonal skills, specifically a proven ability to effectively guide and influence within a dynamic matrix environment.

Benefits:

• Highly competitive salaries.
• Comprehensive benefits package.
• Eligibility for equity.
• Opportunity to work with a world-class engineering team.
• Ability to work in a dynamic matrix environment.
• Opportunity to contribute to cutting-edge technology.
• Flexible work arrangements.
• Professional development opportunities.

How to Apply:

Applications for this job will be accepted at least until March 13, 2026. NVIDIA uses AI tools in its recruiting processes.