Description
We are seeking a Staff Site Reliability Engineer to join our team. As a Staff Site Reliability Engineer, you will be responsible for architecting, implementing, and maintaining solutions that ensure Visa's application services operate with high availability and reliability.
The Reliability & Resilience Engineering squad works to improve the reliability and resilience of the services sold to customers. The team provides subject matter expertise in chaos engineering, reliability standards, resilience design, observability, and continuous reliability improvement.
Key Responsibilities:
- Own complex resilience engineering work across priority services.
- Design, plan, conduct, and report on controlled chaos experiments and game days.
- Establish repeatable chaos testing patterns.
- Define reliability and resilience standards.
- Translate incidents, observed failure modes, SLO misses, and experiment findings into actionable engineering improvements.
- Provide architecture and system-design guidance to application teams, especially around circuit breakers, load shedding, timeouts, retries, dependency isolation, graceful degradation, observability, alerting, and failure containment.
- Author technical design documents, experiment plans, standards, post-experiment reports, and improvement proposals.
- Mentor engineers through design reviews, technical guidance, and hands-on support to raise the reliability capability of the teams they work with.
- Deliver documented resilience standards, reusable experiment templates, clear production readiness criteria, completed pilot experiments, prioritised remediation backlogs, and measurable improvements in the resilience posture of selected customer-critical services.
Qualifications:
- 5+ years of relevant work experience with a Bachelor's Degree or at least 2 years of work experience with an Advanced degree (e.g. Masters, MBA, JD, MD) or 0 years of work experience with a PhD, OR 8+ years of relevant work experience.
- Experience in Kubernetes and related technologies such as Helm, ArgoCD, and Terraform.
- Experience in automating complex tasks and processes using programming languages such as Python, Go, and Java.
- Experience in planning and performing chaos experiments using tooling such as Gremlin, Chaos Toolkit, Litmus, or equivalents