New The Skills of Tomorrow: how AI-exposed is every skill in 2026? See the data →
NVIDIA

Senior Product Architect, K8s-Based AI Infrastructure

NVIDIA
Apply →
remote senior full-time Santa Clara, CA

First indexed 21 Aug 2026

Description

NVIDIA is the engine of modern Artificial Intelligence, Parallel Compute Infrastructure, and Agentic AI - the biggest technology breakthroughs of our time. We’re on a mission to redefine how data moves, connects, and accelerates workloads at scale, and we’re seeking a visionary Product Architect with strong expertise in systems architecture to join our cause. As a key member of our team, you’ll design and shape the architectures that connect the world’s most powerful AI clusters.

As a Product Architect at NVIDIA, you'll be the linchpin in transforming ideas into well-defined, functional products, balancing technical feasibility with user needs and market demands. You'll be responsible for designing and overseeing the development of cutting-edge AI solutions from conception through their entire lifecycle.

Responsibilities:

  • Stay at the forefront of technology trends in AI Infrastructure & Agentic AI, proposing new product concepts
  • Define detailed product architectures, including performance, scalability, interoperability, and datacenter deployment requirements
  • Lead prototyping and testing processes to validate product design and functionality, with a focus on scale, diagnosing bottlenecks and driving innovations in performance
  • Iterate and refine designs based on feedback, testing results, and evolving requirements
  • Collaborate with internal hardware, software, security and systems teams to ensure flawless integration of networking, compute and storage ecosystems
  • Work closely with partners and customers to conceptualize ideal solutions, build proof-of-concepts (POCs) and minimum viable products (MVPs) that demonstrate your vision
  • Provide comprehensive documentation for product designs, including technical specifications and user guides
  • Develop targeted content such as whitepapers, blogs, and curriculum for customers, partners, and users

Requirements:

  • 8+ years of experience architecting datacenter-scale HPC or AI infrastructure as a Principal Architect, Solutions Architect, Principal Engineer, or equivalent
  • Bachelors degree in computer science or related field (or equivalent experience)
  • Strong background in technologies that enable large scale infrastructure management of complex systems, networks, and storage
  • Extensive experience with DevOps solutions, including Python, Ansible, Container Runtimes, Kubernetes, and data center deployments
  • Familiarity with AI workloads, including agentic & RAG-based workflows, inference at scale, large scale training & fine-tuning, and model evaluation
  • Exceptional communication skills, with the ability to translate complex technical details for diverse audiences
  • A passion for staying updated with the latest technological advancements in AI and related fields

Benefits:

  • Equity
  • Benefits