# Senior Software Engineer - Resilience Engineering, DGX Cloud

**Company**: NVIDIA
**Location**: Santa Clara, CA
**Work arrangement**: remote
**Experience**: senior
**Job type**: full-time
**Salary**: 184,000 USD – 287,500 USD for Level 4; and 224,000 USD – 356,500 USD for Level 5
**Category**: Engineering
**Industry**: Technology

**Apply**: https://nvidia.wd5.myworkdayjobs.com/en-US/NVIDIAExternalCareerSite/job/US-CA-Santa-Clara/Senior-Software-Engineer--Resilience-Engineering---DGX-Cloud_JR2029678?utm_source=yubhub.co&utm_medium=jobs_feed&utm_campaign=apply
**Canonical**: https://yubhub.co/job/senior-software-engineer-resilience-engineering-dc883ffa-43a/

## Description

Join NVIDIA as a Senior Software Engineer - Resilience Engineering, DGX Cloud, and be a pivotal part of a team that redefines operational excellence. You will build org-wide reliability strategy, guide NVIDIA's operational practices in a 24/7 environment, and stand up a rigorous SLO program.

**Responsibilities:**

- Build org-wide reliability strategy, guiding how NVIDIA matures its operational practices in a 24/7 environment.

- Stand up a rigorous SLO program, defining and maintaining high standards across teams.

- Lead incident response for high severity incidents, ensuring low drama and high signal resolution.

- Build and improve production code daily, enhancing our data platform and related tooling.

- Implement chaos engineering, failure injection, and resilience testing to elevate our team's standard practices.

- Improve standards by setting an example with your hands-on experience and leadership.

**Requirements:**

- Deep, hands-on experience running large-scale production systems with a proven track record.

- A detailed understanding of failure modes in large systems, including cascading dependencies and retry storms.

- Strong software engineering skills with current, hands-on experience in Go, Python, or similar languages.

- Proven experience in establishing and maintaining an SLO program with operational rigor.

- Practical experience in reliability fields such as chaos engineering and failure injection.

- The ability to influence across team boundaries through credibility and expertise.

- 10+ years of industry experience with a Bachelor's or Master's degree, or equivalent experience operating systems at scale.

**Benefits:**

- Highly competitive salaries

- Comprehensive benefits package

- Equity eligibility

The expected base salary ranges for this position are: 184,000 USD – 287,500 USD for Level 4; and 224,000 USD – 356,500 USD for Level 5.

For more fresh new jobs, check out [yubhub.co](https://yubhub.co/).

## Skills

### Required
- Go
- Python
- chaos engineering
- failure injection
- resilience testing
- SLO program

### Nice to have
- Google SRE
- Meta production engineering
- GPU
- HPC
- AI training infrastructure
- Prometheus
- OpenTelemetry
- Grafana
- PagerDuty
- Rootly

---

Source: [Apply at nvidia.wd5.myworkdayjobs.com](https://nvidia.wd5.myworkdayjobs.com/en-US/NVIDIAExternalCareerSite/job/US-CA-Santa-Clara/Senior-Software-Engineer--Resilience-Engineering---DGX-Cloud_JR2029678?utm_source=yubhub.co&utm_medium=jobs_feed&utm_campaign=apply)