Skip to content
Updated How AI-exposed are the skills employers are hiring for? See the data →

From the employer's careers site First seen 15 Nov 2026

Deep Learning Engineer

NVIDIA Santa Clara, CA senior full-time

Salary

124,000 USD – 195,500 USD for Level 2 per year

Apply on NVIDIA

Description

NVIDIA is seeking a motivated Deep Learning engineer to bring advanced communication technologies into AI stacks, including PyTorch, TRT-LLM, vLLM, SGLang, JAX, etc.

You will be working with the team that created communication libraries like NCCL, NVSHMEM & technology like GPUDirect -- for scaling Deep Learning and HPC applications.

Your customers will have diverse multi-GPU demands, ranging from training on scales up to 100K GPUs to inference down at microsecond latency.

Responsibilities

  • Integrate new communication libraries features in AI frameworks: from PoC to performance analysis to production
  • Perform deep analysis of AI workloads and frameworks to identify multi-GPU communication requirements and opportunities. Collaborate hands-on with teams working on the latest AI models.
  • Improve AI compilers to hide communications or perform automatic fusion.
  • Conduct in-depth AI workload performance characterization on multi-GPU clusters.
  • Design fault-tolerant and elastic solutions for large-scale or dynamic AI workloads.
  • Author custom communication or fused compute-communication kernels to showcase ultimate performance on NV platforms.
  • Influence the roadmap of communication libraries - NCCL & NVSHMEM.
  • Collaborate with a very dynamic team across multiple time zones.

Requirements

  • B.S, M.S. or PHD in Computer Science, or related field (or equivalent experience) with software engineering and HPC/AI experience
  • Development or integration experience with Deep Learning Frameworks such PyTorch, JAX, and Inference Engines such as TRT-LLM, vLLM, SGLang
  • Rapid prototyping and development with Python, C++, CUDA or related DSLs (Triton, cuTe)
  • Solid grasp of AI models, parallelisms, and/or compiler technologies (e.g. torch.compile)
  • Experience conducting performance benchmarking on AI clusters. Familiarity with at least one performance profiler toolchain (PyTorch profiler, NVIDIA Nsight Systems)
  • Understanding of HPC/AI communication concepts (1-sided v 2-sided communication, elasticity, resiliency, topology discovery, etc)
  • Adaptability and passion to learn new areas and tools
  • Flexibility to work and communicate effectively across different teams and timezones

Benefits

  • Base salary: 124,000 USD – 195,500 USD for Level 2; and 152,000 USD – 241,500 USD for Level 3
  • Equity and benefits

For more fresh new jobs, check out yubhub.co.

Skills

Required

Nice to have

  • parallel programming
  • computer system architecture
  • HW-SW interactions
  • operating systems principles
  • AI compiler pattern matching and lowering
  • memory hierarchy
  • consistency model
  • tensor layout
Apply on NVIDIA