# GPU Cluster Architect

**Company**: Nebius
**Location**: Remote - United States
**Work arrangement**: remote
**Experience**: senior
**Job type**: full-time
**Salary**: $184K to $318K OTE
**Category**: Engineering
**Industry**: Technology

**Apply**: https://job-boards.greenhouse.io/nebius/jobs/4657940101?utm_source=yubhub.co&utm_medium=jobs_feed&utm_campaign=apply
**Canonical**: https://yubhub.co/jobs/job_5f1f21cc-85c

## Description

We are seeking a GPU Cluster Architect to drive the design of our next-generation AI infrastructure. In this high-impact, hands-on role, you will make end-to-end architectural decisions across compute, networking, and storage , ensuring our platforms can meet the massive scale, performance, and reliability requirements of modern AI workloads.

Responsibilities:

- Cluster Design: Architect scalable GPU cluster topologies including compute nodes, interconnect (InfiniBand, Ethernet), storage, and control planes.

- Performance Modeling: Analyze AI/ML workloads (e.g. LLM training, inference) to inform design tradeoffs across latency, bandwidth, and GPU density.

- Network Architecture: Align with network architect relevant design and validate low-latency, high-throughput interconnects (e.g., InfiniBand HDR/NDR, RoCEv2) at POD and DC scale.

- Storage Integration: Work with storage teams to optimize performance for training datasets, checkpointing, and others.

- Reliability & Monitoring: Understand and analyze signal from monitoring systems to detect flows in design.

- Collaboration: Partner with site reliability, networking, storage, and DC engineering teams to operationalize and scale your architecture.

Requirements:

- 5+ years of experience designing clusters.

- Deep understanding of modern GPU architecture (NVIDIA, AMD, etc.).

- Experience with HPC interconnects (InfiniBand & RoCE).

- Solid background in systems architecture, networking, and hardware reliability.

- Experience in scripting for automation and telemetry pipelines (Python, Go, etc.)

Benefits:

- Health insurance: 100% company-paid medical, dental, and vision coverage for employees and families.

- 401(k) plan: Up to 4% company match with immediate vesting.

- Parental leave: 20 weeks paid for primary caregivers, 12 weeks for secondary caregivers.

- Remote work reimbursement: Up to $85/month for mobile and internet.

- Disability & life insurance: Company-paid short-term, long-term and life insurance coverage.

Compensation: We offer competitive salaries ranging from $184K to $318K OTE, which includes base salary and performance bonus. Equity in the form of RSUs may be available at certain salary grades.

## Skills

### Required
- GPU architecture
- HPC interconnects
- systems architecture
- networking
- hardware reliability
- scripting

---

Source: [Apply at job-boards.greenhouse.io](https://job-boards.greenhouse.io/nebius/jobs/4657940101?utm_source=yubhub.co&utm_medium=jobs_feed&utm_campaign=apply)