AI Reliability Engineer, HPC

We're seeking an experienced AI Reliability Engineer to join our High Performance Computing (HPC) infrastructure team. You'll blend software engineering and systems engineering to keep our large-scale distributed AI infrastructure reliable and efficient.

Responsibilities

• Ensure uptime, resiliency, and fault tolerance of HPC clusters powering MAI model training and inference.
• Design and maintain monitoring, alerting, and logging systems to provide real-time visibility into HPC systems.
• Build automation for deployments, incident response, scaling, and failover in CPU+GPU environments.
• Lead on-call rotations, troubleshoot production issues, and drive continuous improvements.
• Ensure data privacy, compliance, and secure operations across model training and serving environments.
• Partner with ML engineers and platform teams to improve developer experience and accelerate research-to-production workflows.

Qualifications

• Bachelor's Degree in Computer Science or related technical discipline AND 4+ years technical experience in Site Reliability Engineering, DevOps, or Infrastructure Engineering.
• Experience with Kubernetes, Docker, container orchestration, and CI/CD pipelines for ML training or inference workloads.
• Experience with public cloud platforms such as Azure, AWS, or GCP, including infrastructure-as-code.
• Experience with monitoring and observability tools such as Grafana, Datadog, or OpenTelemetry.
• Programming or scripting experience in Python, Go, or Bash.
• Experience with distributed systems, networking, storage, and high-performance computing (HPC).

Software Engineering IC5 - The typical base pay range for this role across United Kingdom is £93,500.00 - £161,800.00 per year.