# Lead Data Engineer

**Company**: Home Office
**Location**: London Borough of Croydon, London
**Work arrangement**: hybrid
**Experience**: senior
**Job type**: full-time
**Salary**: GBP 62,732 - 73,406 per year
**Category**: Data Science
**Industry**: Government & Public Sector

**Apply**: https://www.jobsgopublic.com/job/lead-data-engineer-111231?utm_source=yubhub.co&utm_medium=jobs_feed&utm_campaign=apply
**Canonical**: https://yubhub.co/jobs/job_19d7ca27-12c

## Description

This role will be based in the National Data Quality Improvement Service (NDQIS) team, which uses rule-based systems to improve the quality, consistency, and comparability of police-recorded crime data submitted to the Home Office.

As a Lead Data Engineer, you will be responsible for designing, delivering, and supporting high-quality end-to-end data solutions that enable effective data-driven decision making. You will translate complex business requirements into robust, scalable, and secure data pipelines, ensuring compliance with Home Office data quality, governance, and security standards.

Key responsibilities include:

- Leading the design and implementation of complex data integrations and text analysis methodologies, ETL processes, and automated workflows

- Collaborating with technical and business stakeholders to ensure solutions are reliable, resilient, and aligned with organisational objectives

- Shaping and implementing the data engineering vision and roadmap, promoting best practice, innovation, and continuous improvement

- Building strong relationships across technical and non-technical communities, influencing decision-making, and ensuring services align with organisational priorities and user needs

The ideal candidate will have experience in data engineering, with skills in areas such as:

- Python and related libraries

- Regex and NLP

- API integration and JSON/CSV manipulation

- Cloud Data technologies, including AWS and Docker

- ETL tools and scheduling and orchestration tools

- Data visualisation tools, such as Power BI

In terms of benefits, the Home Office offers:

- A Civil Service Pension with employer contribution rates of at least 28.97%

- In-year reward scheme for one-off or sustained exceptional personal or team achievements

- 25 days annual leave on appointment, rising with service

- 8 days of public holidays, plus 1 additional privilege day

## Skills

### Required
- Python
- regex
- NLP
- API integration
- JSON/CSV manipulation
- Cloud Data technologies
- AWS
- Docker
- ETL tools
- Power BI

---

Source: [Apply at jobsgopublic.com](https://www.jobsgopublic.com/job/lead-data-engineer-111231?utm_source=yubhub.co&utm_medium=jobs_feed&utm_campaign=apply)