# Observability Engineer

**Company**: Workday
**Location**: Pleasanton, CA
**Work arrangement**: hybrid
**Experience**: senior
**Job type**: full-time
**Salary**: $163,800 USD - $245,800 USD
**Category**: Engineering
**Industry**: Technology

**Apply**: https://workday.wd5.myworkdayjobs.com/en-US/Workday/job/USAVAReston/Senior-Software-Development-Engineer--US-Federal-_JR-0105388?utm_source=yubhub.co&utm_medium=jobs_feed&utm_campaign=apply
**Canonical**: https://yubhub.co/jobs/job_035c7b00-5db

## Description

We are looking for an Observability Engineer to join our team. As an Observability Engineer, you will design, build, and enhance critical Observability services, including Monitoring, Logging, Alerting, and Tracing. You will develop data capture and collection services using pioneering technologies across diverse infrastructure environments. You will also design and develop core software modules for real-time and batch data processing.

Responsibilities:

- Design, build, and enhance critical Observability services

- Develop data capture and collection services

- Design and develop core software modules for real-time and batch data processing

- Construct Metrics ingestion pipelines, Alert definitions, and automation for Dashboard lifecycle management

- Build and deploy infrastructure components in production environments

- Champion all aspects of observability with a focus on data quality, integrity, and availability

- Evaluate and implement new open-source and cloud-native tools and technologies as needed

- Participate in the on-call rotation to support the observability platform

- Manage and optimize Workday within the air-gapped U.S. AWS cloud regions

- Partner with the Workday Federal Cyber Defense team to ensure security operations

Requirements:

- BS/MS in Computer Science or a related technical field

- Strong software engineering background with a consistent track record of delivering high-quality products at scale

- Exceptional coding skills (Java, Python; Go is a plus)

- Solid understanding of high-performance data capture and collection systems, API design, and reliable data delivery

- Good understanding of Time-Series Databases and Log collection and management

- Good knowledge and understanding of Kubernetes

- 10+ years of experience building high-performance data ingestion software

- Excellent interpersonal, technical, and communication skills

- Ability to prioritize multiple tasks in a fast-paced environment

- Fluency in Linux

- Experience with Infrastructure Automation (Ansible, Chef, Terraform)

Nice to Have:

- Demonstrable experience with the Prometheus Ecosystem, Elastic Search, Grafana and InfluxData stack

- Experience with PromQL and InfluxQL

- Hands-on experience with Kubernetes and Helm

- Preferred DoD 8570/8140 compliant with at least IAT Level Il certification

## Skills

### Required
- Java
- Python
- Go
- Kubernetes
- Time-Series Databases
- Log collection and management
- Infrastructure Automation

### Nice to have
- Prometheus Ecosystem
- Elastic Search
- Grafana
- InfluxData stack
- PromQL
- InfluxQL
- Helm

---

Source: [Apply at workday.wd5.myworkdayjobs.com](https://workday.wd5.myworkdayjobs.com/en-US/Workday/job/USAVAReston/Senior-Software-Development-Engineer--US-Federal-_JR-0105388?utm_source=yubhub.co&utm_medium=jobs_feed&utm_campaign=apply)