Skip to content
Updated How AI-exposed are the skills employers are hiring for? See the data →

From the employer's careers site First seen 7 Nov 2026

Senior GenAI Algorithms Engineer

NVIDIA Santa Clara, CA Remote senior full-time

Salary

152,000 USD – 241,500 USD for Level 3

Apply on NVIDIA

Description

NVIDIA is seeking a Senior GenAI Algorithms Engineer to advance the state of the art in foundation model development, training, and deployment.

You will work at the intersection of large-scale distributed training, reinforcement learning for LLMs/VLMs, model efficiency, multimodal AI, and open-source AI infrastructure.

This role spans the entire GenAI lifecycle from large-scale data preparation to training, post-training, inference optimization, and framework development.

You will collaborate with research, product, and infrastructure teams to design new algorithms, optimize existing systems, and contribute to NVIDIA's open-source AI stack, including Megatron-LM, Megatron Bridge, and NeMo-RL.

Responsibilities

  • Data Curation & Readiness: Design scalable systems for preparing high-quality multimodal datasets for frontier foundation model training.
  • Training Efficiency: Develop algorithms and systems that improve the scalability, efficiency, and cost of large-scale pre-training and post-training.
  • Inference Efficiency: Advance techniques that improve inference performance, reduce deployment cost, and enable efficient serving across cloud and edge platforms.
  • Open-Source AI Infrastructure: Develop reusable infrastructure and contribute brand new model support to NVIDIA's open-source GenAI training platform.

Requirements

  • MS or Ph.D in Computer Science, AI, Applied Mathematics, or a related field (or equivalent experience).
  • 5+ years of relevant industry experience.
  • Strong foundation in machine learning, deep learning, and optimization.
  • Excellent software engineering skills, including Python and PyTorch.
  • Experience building high-performance software for large-scale AI systems.
  • Strong analytical, debugging, and performance optimization skills.
  • Excellent communication and collaboration skills.

Nice to Have

  • Experience in some of the following areas is highly desirable:

+ Distributed training at scale using frameworks like Megatron-LM and Megatron Bridge. + LLM/VLM Post-Training: Supervised fine-tuning (SFT), reinforcement learning for LLMs (e.g., PPO, GRPO, asynchronous RL), and large-scale RL frameworks such as NeMo-RL. + Inference Efficiency: Model compression techniques including quantization (FP8, NVFP4, INT4), pruning, knowledge distillation, neural architecture search, and diffusion or non-autoregressive language models. + Open-Source AI Infrastructure: Contributing to open-source AI frameworks such as Megatron-LM, Megatron Bridge, NeMo-RL, or Hugging Face Transformers along with experience in GPU performance optimization, distributed systems, latency/throughput analysis, and profiling of large-scale AI workloads.

Salary

The expected base salary ranges for this position are: 152,000 USD – 241,500 USD for Level 3; and 184,000 USD – 287,500 USD for Level 4.

For more fresh new jobs, check out yubhub.co.

Skills

Nice to have

  • Megatron-LM
  • Megatron Bridge
  • NeMo-RL
  • Distributed Training
  • Reinforcement Learning
  • Model Compression
  • GPU Performance Optimization
Apply on NVIDIA