# Senior HPC AI Cluster Engineer

**Company**: NVIDIA
**Location**: Santa Clara, CA
**Work arrangement**: remote
**Experience**: senior
**Job type**: full-time
**Category**: Engineering
**Industry**: Technology

**Apply**: https://nvidia.wd5.myworkdayjobs.com/en-US/NVIDIAExternalCareerSite/job/US-CA-Santa-Clara/Senior-HPC-AI-Cluster-Engineer_JR2023577?utm_source=yubhub.co&utm_medium=jobs_feed&utm_campaign=apply
**Canonical**: https://yubhub.co/jobs/job_9e2aedfb-0d5

## Description

NVIDIA is looking for an experienced HPC-AI Engineer to join the Networking Clusters Solutions Infrastructure team. The team focuses on building supercomputers and AI clusters based on groundbreaking technologies. As a Senior HPC AI Cluster Engineer, you will be a key player in designing and implementing large-scale HPC/AI clusters, providing insights on at-scale system design and tuning mechanisms for large-scale compute runs.

**Responsibilities:**

- Design, implement, and maintain large-scale HPC/AI clusters with monitoring, logging, and alerting

- Manage Linux job/workload schedules and orchestration tools

- Develop and maintain continuous integration and delivery pipelines

- Develop tooling to automate deployment and management of large-scale infrastructure environments, automate operational monitoring and alerting, and enable self-service consumption of resources

- Deploy monitoring solutions for servers, network, and storage

- Perform troubleshooting from bare metal, operating system, software stack, and application level

- Develop, redefine, and document standard methodologies to share with internal teams

- Support Research & Development activities and engage in POCs/POVs for future improvements

**Requirements:**

- A degree in Computer Science, Engineering, or a related field (or equivalent experience) and 8+ years of experience

- Knowledge of HPC and AI solution technologies from CPUs and GPUs to high-speed interconnects and supporting software

- Experience with job scheduling workloads and orchestration tools such as Slurm, K8s

- Excellent knowledge of Windows and Linux (Redhat/CentOS and Ubuntu) networking and internals, ACLs, and OS-level security protection and common protocols

- Experience with multiple storage solutions such as Lustre, GPFS, Weka.io

- Python programming and bash scripting experience

- Comfortable with automation and configuration management tools such as Jenkins, Ansible, Puppet/Chef

- Deep knowledge of Networking Protocols like InfiniBand, Ethernet

- Deep understanding and experience with virtual systems

- Familiarity with cloud computing platforms

**Preferred Qualifications:**

- Knowledge of CPU and/or GPU architecture

- Knowledge of Kubernetes, container-related microservice technologies

- Experience with GPU-focused hardware/software (DGX, Cuda)

- Experience with RDMA (InfiniBand or RoCE) fabrics

## Skills

### Required
- HPC
- AI
- Linux
- Python
- bash scripting
- automation
- configuration management
- Networking Protocols
- virtual systems
- cloud computing

### Nice to have
- CPU architecture
- GPU architecture
- Kubernetes
- container-related microservice technologies
- GPU-focused hardware/software
- RDMA fabrics

---

Source: [Apply at nvidia.wd5.myworkdayjobs.com](https://nvidia.wd5.myworkdayjobs.com/en-US/NVIDIAExternalCareerSite/job/US-CA-Santa-Clara/Senior-HPC-AI-Cluster-Engineer_JR2023577?utm_source=yubhub.co&utm_medium=jobs_feed&utm_campaign=apply)
