Description
This role will be based in the National Data Quality Improvement Service (NDQIS) team, which uses rule-based systems to improve the quality, consistency, and comparability of police-recorded crime data submitted to the Home Office.
As a Lead Data Engineer, you will be responsible for designing, delivering, and supporting high-quality end-to-end data solutions that enable effective data-driven decision making. You will translate complex business requirements into robust, scalable, and secure data pipelines, ensuring compliance with Home Office data quality, governance, and security standards.
Key responsibilities include:
- Leading the design and implementation of complex data integrations and text analysis methodologies, ETL processes, and automated workflows
- Collaborating with technical and business stakeholders to ensure solutions are reliable, resilient, and aligned with organisational objectives
- Shaping and implementing the data engineering vision and roadmap, promoting best practice, innovation, and continuous improvement
- Building strong relationships across technical and non-technical communities, influencing decision-making, and ensuring services align with organisational priorities and user needs
The ideal candidate will have experience in data engineering, with skills in areas such as:
- Python and related libraries
- Regex and NLP
- API integration and JSON/CSV manipulation
- Cloud Data technologies, including AWS and Docker
- ETL tools and scheduling and orchestration tools
- Data visualisation tools, such as Power BI
In terms of benefits, the Home Office offers:
- A Civil Service Pension with employer contribution rates of at least 28.97%
- In-year reward scheme for one-off or sustained exceptional personal or team achievements
- 25 days annual leave on appointment, rising with service
- 8 days of public holidays, plus 1 additional privilege day