Description
The BBC's future depends on delivering seamless, 24/7 online services without disruptions. We build business-critical, highly available observability and alerting platforms for massive-scale performance tracking and corrective automation.
As a Senior Engineer, you will architect, design, and develop these core cloud and network systems, underpinning our audience products and so directly preventing outages for millions of users.
The role involves migrating legacy influx systems to a modern open-source stack (Mimir, Prometheus, Alerta, Alloy, Grafana, LibreNMS) and integrating Loki and Tempo.
You will collaborate across the BBC to shape our future observability roadmap, engineering critical high-scale services using AWS. This role offers total freedom to pitch ideas, innovate at a massive scale, and define our future enterprise monitoring ecosystem.
Key Responsibilities:
- Architect and scale robust, highly available, and user-focused infrastructure using cloud services and automation
- Lead the design and development of software that meets complex product and business needs
- Integrate monitoring and support tools
- Think out of the box and proactively diagnose and resolve operational issues
- Collaborate with stakeholders to gather requirements and ensure platforms scale effectively
- Own engineering quality by driving continuous improvement in engineering practices and processes
- Guide the team's long-term technical strategy and plan future observability roadmaps
- Mentor and support junior team members to accelerate their professional learning and growth
Requirements:
- Expertise in some of the following tools and services: Git/GitHub, Atlassian Tools, Telegraf, InfluxDB, Consul, LibreNMS, Docker, Kubernetes, Jenkins, Alerta, Grafana, Prometheus, Mimir, Alloy
- Strong experience in programming/scripting languages: Python, Bash/Shell
- Strong production experience in AWS and Cloud: EC2, Load Balancing, Lambda, SQS, SNS, S3, RDS, CloudWatch, Route 53
- Knowledge of system metrics and their impact on availability and performance
- Experience with Linux Operating Systems (e.g., RedHat, CentOS, Rocky, Amazon Linux)
- Understanding of CI/CD practices and large-scale infrastructure design and support
Benefits:
- Competitive salary package
- Flexible 35-hour working week
- 25 days annual leave with the option to buy an extra 5 days
- Defined pension scheme
- Discounted dental, health care, and gym
- Excellent career and professional development opportunities
- Support in your working life, including flexible working