Description
NVIDIA is seeking a Senior Site Reliability Engineer who combines an SRE's reliability approach with strong software build and development skills. Our Production Engineering team blends software and systems engineering to design, build, and maintain large-scale GPU cloud infrastructure with exceptional efficiency and availability.
You will reduce manual toil by building automation frameworks, self-healing systems, observability platforms, and infrastructure-as-code pipelines that support thousands of machines. You will be responsible for the full lifecycle of your work, from architecture and development through deployment, operations, and continuous improvement.
Responsibilities:
- Design and build production-grade automation frameworks, workflows, and data models that reduce manual operational work across provisioning, patching, image deployment, telemetry, and change management at large scale.
- Engage in the complete lifecycle of services from deployment to incident response and long-term reliability improvement.
- Develop software tools and platforms that integrate across data center systems: DCIM, alerting and observability stacks, compute/storage/networking control planes, and CI/CD pipelines.
- Monitor and handle large-scale GPU and Kubernetes production environments; apply advanced observability tooling (Grafana, OpenTelemetry, PagerDuty) to proactively detect, prevent, and resolve incidents.
- Build predictive and auto-healing systems by integrating incident analysis insights into automated break-fix and self-remediation solutions.
- Participate in on-call rotations and practice sustainable incident response, including blameless postmortems and systematic root-cause-focused improvements.
- Scale systems sustainably through code by pushing automation and self-service tools that improve reliability and engineering velocity.
Requirements:
- 6+ years of experience in SRE, production engineering, or infrastructure software engineering supporting large-scale, highly available environments.
- BS/BTech in Computer Science, Engineering, Physics, Mathematics, or equivalent experience.
- Strong software development skills with expertise in Python and/or Go; ability to design, build, and own production-quality tools and services, not just scripts.
- Deep knowledge of Kubernetes, Linux systems administration, and/or container technologies; experience handling large-scale bare-metal and cloud infrastructure.
- Confirmed experience building data center automation tools covering OS provisioning, image deployment, patching, packaging, and configuration management.
- Experience with CI/CD tooling and infrastructure-as-code workflows.
- Strong understanding of observability practices: metrics, logging, distributed tracing, and alerting design.
- Excellent communication skills with the ability to present technical work persuasively across multi-functional teams.
Preferred Qualifications:
- Built and delivered automation or reliability platforms at large scale. You measure impact by machines handled, incidents prevented, or hours of toil eliminated.
- You address production problems as an application developer would a build: consider the architecture initially, automate fully, and improve the system before moving on.
- You have a strong passion for investing in groundbreaking technology and environments where you learn new systems quickly.
- Confirmed ability to debug and optimize code, reduce system-level toil, and drive measurable reliability improvements through software.
- Experience with DCIM systems and asset database design and implementation.
The base salary range is 168,000 USD - 270,250 USD. You will also be eligible for equity and benefits.