# Manager, Supercomputer Site Reliability Engineering - Memphis

**Company**: SpaceXSI
**Location**: Southaven, MS
**Work arrangement**: onsite
**Experience**: senior
**Job type**: full-time
**Category**: Engineering
**Industry**: Technology

**Apply**: https://job-boards.greenhouse.io/xai/jobs/5266813007?utm_source=yubhub.co&utm_medium=jobs_feed&utm_campaign=apply
**Canonical**: https://yubhub.co/jobs/job_e2db7993-91b

## Description

SpaceXSI was founded under the belief that a future where humanity is out exploring the stars is fundamentally more exciting than one where we are not. Today, SpaceXSI is actively developing the technologies to make this possible, with the ultimate goal of making life multiplanetary and expanding consciousness to the stars.

SpaceXSI operates multi-campus, hyperscale GPU infrastructure where cluster availability directly determines training throughput, customer handover commitments, and capital efficiency of the fleet. The Manager of Supercomputer Site Reliability Engineering will be responsible for both compute and infrastructure performance, and will be responsible for significantly increasing the SRE team size.

## Responsibilities:

- Serve as the senior operational authority for the SRE organization and represent production reliability concerns in engineering and leadership discussions.

- Lead integrated Supercompute systems engineering reliability team responsible for reactive and increasingly proactive cluster and facilities health and reliance initiatives.

- Build out the site reliability engineering sub-teams: compute hardware failure analysis, software tools, cluster monitoring, and integrated site reliability engineering.

- Drive operational superiority.

- Define SRE organizational structure and develop culture of 24/7 operational excellence.

- Physics limit anomaly response times and robust proactive health processes.

- Define on-call responsibilities, incident management protocols, leadership structure, and communication discipline.

- Develop training schemes for tough, competent, and disciplined monitoring and response teams.

- Establish clear operational interfaces with Datacenter Operations, engineering teams, vendors, and other service owners.

- Own vendor oversight and accountability mechanisms.

- Drive mean time to repair toward physics limits.

- Define and continuously improve operational procedures and analysis documentation mechanisms with strong emphasis on intelligent automation.

- Lead robustification of documentation workflow.

- Ensure efficient signal to noise in execution.

- Define operational targets, health indicators, alerting standards, and incident severity definitions that facilitate measurable team performance insights and accountability mechanisms.

- Cultivate engineering excellence.

- Drive high technical standard for hardware root cause analysis and remediation teams ensuring industry-leading hardware failure diagnostic expertise.

- Integrate with platform engineering teams to develop sophisticated hardware and system understanding to drive high operational reliability.

- Drive repeat hardware issues to a minimum and lead automation efforts to eliminate manual overhead for unavoidable remediation needs.

## Basic Qualifications:

- Bachelor’s degree and 3+ years of experience working in a large scale operations with 2+ years leading people leaders of technical teams or 10+ years of experience working in a large scale operations with 5+ years leading people leaders of technical teams.

## Preferred Skills and Experience:

- Proven ability to lead large, multi-site, 24/7 operations organizations in fast-paced, high-responsibility settings.

- Deep expertise in server hardware, cluster reliability, and data center technologies, from deployment through lifecycle management.

- Experience supporting compute-heavy environments like AI, machine learning, or high-performance computing at scale.

- A track record of owning uptime, Service Level Agreements, or reliability metrics for large compute clusters.

- Experience leading site reliability engineering or equivalent reliability-focused teams, including root cause analysis and procedure ownership.

- Strong analytical skills and the ability to explain technical concepts clearly to diverse audiences, from technicians to executive and tenant partners.

- A history of partnering with vendors at scale, driving mean time to repair down, and scaling operations across multiple sites.

- Familiarity with tooling and automation (e.g., Jira, Python, Bash) used to monitor cluster health and improve team efficiency.

- Enthusiasm for SpaceXAI's mission to accelerate human discovery and unravel the universe.

- Ability to thrive in a dynamic, mission-focused environment with on-call ownership of cluster-impacting events.

## Skills

### Required
- large scale operations
- technical team leadership
- site reliability engineering

### Nice to have
- server hardware
- cluster reliability
- data center technologies
- AI
- machine learning
- high-performance computing
- Jira
- Python
- Bash

---

Source: [Apply at job-boards.greenhouse.io](https://job-boards.greenhouse.io/xai/jobs/5266813007?utm_source=yubhub.co&utm_medium=jobs_feed&utm_campaign=apply)