# Senior System Software Architect, AI and GPU Networking

**Company**: NVIDIA
**Location**: Tel Aviv
**Work arrangement**: onsite
**Experience**: senior
**Job type**: full-time
**Category**: Engineering
**Industry**: Technology

**Apply**: https://nvidia.wd5.myworkdayjobs.com/en-US/NVIDIAExternalCareerSite/job/Israel-Tel-Aviv/Senior-System-Software-Architect--AI-and-GPU-Networking_JR2013130?utm_source=yubhub.co&utm_medium=jobs_feed&utm_campaign=apply
**Canonical**: https://yubhub.co/jobs/job_87add100-39e

## Description

As a Senior System Software Architect OCTOBER - April 2025, you will explore technological challenges on accelerate networking and building AI data centers. Research new transport functions and semantics for optimising AI workloads, AI systems communication and accelerations and much more. You will also be leading architectural and development efforts across numerous technological fields, related to the modern AI data centre, such as distributed AI and deep learning solutions, data analytics, High Performance Computing (HPC), Software Defined Networking (SDN), virtualisation, storage, and more.

Enhance NVIDIA's GPU Networking offerings for accelerating AI workloads, such as NVIDIA Dynamo, NVIDIA NIXL and NVIDIA UCX, tailored to the unique requirements of AI workloads.

Co-design hardware features (e.g., in GPUs, DPUs, or interconnects) that accelerate data movement and enable new capabilities for inference and model serving.

Identify and evaluate new technologies, innovations and partner relationships for alignment with our technology roadmap and business value.

Lead architecture and design of new technologies and innovations such as runtime systems, communication libraries, AI-specific technologies.

Lead proof-of-concept development to evaluate and drive such technologies.

## Skills

### Required
- M.Sc. or Ph.D. in Computer Science, Electrical or Computer Engineering
- 5+ years of industry experience in system architecture, AI systems architecture, scaling of AI, Parallelism of AI frameworks, or deep learning training workloads
- Algorithm design, system programming, computer architecture and operating systems
- Virtualisation, networking and storage
- Performance profiling and optimisation techniques, together with defining and using hardware features

### Nice to have
- Research track record
- Experience and passion for system architecture, CPU/GPU/memory/storage/networking
- Stellar communication skills
- Knowledge in Deep Learning frameworks and AI communication libraries (NCCL, UCX, MPI and equivalents)
- Deep understanding of Inference and Training workloads and optimisations, like Prefill/Decode, data parallelism, Tensor parallelism, FDSP and others

---

Source: [Apply at nvidia.wd5.myworkdayjobs.com](https://nvidia.wd5.myworkdayjobs.com/en-US/NVIDIAExternalCareerSite/job/Israel-Tel-Aviv/Senior-System-Software-Architect--AI-and-GPU-Networking_JR2013130?utm_source=yubhub.co&utm_medium=jobs_feed&utm_campaign=apply)