New The Skills of Tomorrow: how AI-exposed is every skill in 2026? See the data →
NVIDIA

Director, Rack Scale Software Architecture

NVIDIA
Apply →
onsite senior full-time Santa Clara

First indexed 30 May 2026

Description

Apply for the Director, Rack Scale Software Architecture position at NVIDIA. As a highly technical manager, you will lead and manage the team responsible for rack-scale system software architecture, including firmware, kernel drivers, operating systems, networking, fabrics, and associated user mode drivers + manageability software. You will work with component leads internally and engage with industry-leading hyperscalar/cloud service providers on taking these products to market.

Key responsibilities include:

  • Drive the software end-to-end architecture for NVIDIA's rack-scale products
  • Maintain deep understanding of the product portfolio and roadmap; translate forward-looking plans into clear, formal software requirements that anchor execution across the organization
  • Ensure high quality & reliable software; serving as a trusted architectural partner to teams requiring guidance or oversight
  • Work directly with major customers to understand their requirements and work to align their roadmap with NVIDIA’s roadmap
  • Using strong communication skills, present the team vision to senior NVIDIA and external leaders
  • Provide technical leadership and career mentorship to the team
  • Make key technical decisions even when faced with ambiguity

Requirements include:

  • BS or MS degree in Computer Engineering, Computer Science, or related degree or equivalent experience
  • 15+ overall years of experience in the area of System architecture and design with 8+ yrs of proven experience in management
  • Deep experience in designing architecture for scalable and performant server systems, particularly at the SW/HW interface
  • Proven leadership skills and strong ownership on past projects involving a large scale sophisticated code base
  • Previous experience working with complex system software for accelerators such as GPUs, DPUs, or FPGAs
  • Possess strong managerial, problem solving and critical thinking skills
  • Comfortable operating in highly matrixed organizations while holding a leadership position
  • Known for your strong interactive, verbal and written communications skills

Preferred qualifications include:

  • Knowledge of large-scale cloud and cluster level deployment and management systems. Experience with designing robust, resilient and performant scale-up fabrics
  • Demonstrated track record of leading data center products across the entire lifecycle, spanning inception, pre-silicon development, post-silicon bring-up, manufacturing, and deployment
  • Strong understanding of networking technology & protocols (e.g. Ethernet, Infiniband). Familiarity with CXL, UCIE and other C2C technology architectures. Knowledge in storage and networking technologies