# Member of Technical Staff (Site Reliability Engineer, Crawler)

**Company**: Perplexity
**Location**: London
**Experience**: senior
**Job type**: full-time
**Category**: Engineering
**Industry**: Technology

**Apply**: https://jobs.ashbyhq.com/Perplexity/190962f1-a955-4690-8025-6943dcbf063c?utm_source=yubhub.co&utm_medium=jobs_feed&utm_campaign=apply
**Canonical**: https://yubhub.co/job/member-of-technical-staff-site-reliability-ae8c5262-2a8/

## Description

Keeping a crawler running is not the same as keeping it productive. Queues can grow while servers look healthy, and a small change can become a fleet-wide bottleneck. On Perplexity's Crawler team, you'll improve throughput, plan capacity, and build operational reliability through safer deployments, better observability, and durable fixes.

Responsibilities:

- Operate and optimise Kubernetes workloads and supporting infrastructure for crawler services, including fetching and rendering fleets.

- Build and maintain infrastructure as code and CI/CD pipelines, with safe rollouts, validation, and fast rollback.

- Define SLOs and build monitoring, alerting, and observability for availability, latency, throughput, and resource saturation.

- Own capacity planning and resource efficiency; diagnose queue backlogs, network failures, and resource bottlenecks with service owners.

- Participate in the team's on-call rotation, lead incident response, and turn blameless postmortems into durable reliability improvements.

- Write production software to automate diagnosis and routine remediation, with validation and approval gates for high-impact actions.

Qualifications:

- 5+ years of experience in SRE, production engineering, or infrastructure-heavy backend roles, with strong programming skills in Python, C++, Rust, or Go.

- Hands-on experience with cloud infrastructure, production Kubernetes, infrastructure as code such as Terraform, and automated deployment workflows.

- Strong Linux and networking fundamentals, including TCP/IP, DNS, TLS, HTTP, and load balancing.

- Experience building observability with tools such as Datadog, Prometheus, or Grafana, and using SLOs to guide reliability improvements.

- Proven experience diagnosing distributed-system failures, leading production incidents, and improving system performance or resource efficiency.

Nice to have:

- Experience operating web crawlers, search infrastructure, or browser fleets at scale.

- Experience with distributed queues, backpressure, workload isolation, or multi-region recovery.

For more fresh new jobs, check out [yubhub.co](https://yubhub.co/).

## Skills

### Required
- Python
- C++
- Rust
- Go
- Kubernetes
- Terraform
- Datadog
- Prometheus
- Grafana
- Linux
- TCP/IP
- DNS
- TLS
- HTTP

### Nice to have
- web crawlers
- search infrastructure
- browser fleets
- distributed queues
- backpressure
- workload isolation
- multi-region recovery

---

Source: [Apply at jobs.ashbyhq.com](https://jobs.ashbyhq.com/Perplexity/190962f1-a955-4690-8025-6943dcbf063c?utm_source=yubhub.co&utm_medium=jobs_feed&utm_campaign=apply)