Description
We are looking for a Senior Site Reliability Engineer to join our Token Factory team, which is part of Nebius Cloud, one of the world's largest GPU clouds. As a Senior Site Reliability Engineer, you will own the reliability, performance, and observability of the entire inference stack.
Your day will start with designing and refining telemetry pipelines , metrics, logs, and traces that turn hundreds of terabytes of signal into clear, actionable insight. You will also tune Kubernetes autoscalers to squeeze more efficiency out of GPUs, craft Terraform modules that bake resilience into every new cluster, or harden our request-routing and retry logic so even transient failures go unnoticed by users.
When incidents arise, you will rely on the automation and runbooks you helped create to detect, isolate, and remediate problems in minutes, then drive the post-mortem culture that prevents recurrence. Your goal will be to scale the platform smoothly while hitting aggressive cost and reliability targets.
To succeed in this role, you will need deep fluency with Kubernetes, Prometheus, Grafana, Terraform, and the craft of infrastructure-as-code. You should be comfortable scripting in Python or Bash, understand the nuances of alert design and SLOs for high-throughput APIs, and have experience with distributed back-ends.
Experience with GPU-heavy workloads, such as vLLM, Triton, or Ray, will be beneficial, as will a background in MLOps or model-hosting platforms. Above all, you should care about building self-healing systems, thrive on debugging performance from kernel to application layer, and enjoy collaborating with software engineers to turn reliability into a feature users never have to think about.
Benefits & Perks
- Competitive compensation
- Career growth and learning opportunities
- Flexibility and ownership
- Collaborative and innovative culture
- Opportunity to work on impactful AI projects
- International environment and talented teams