Description
We are seeking a Senior Data Engineer to join our Data Engineering community at the Department for Work and Pensions. You will lead the design and delivery of secure, scalable data solutions that power services used by millions of people across the UK. Your expertise in Azure data engineering, ETL/ELT pipeline design, and technical team leadership will ensure our data estate is reliable, well-governed, and continuously improving.
Responsibilities:
- Lead the team in designing, developing, and maintaining scalable ETL/ELT pipelines using PySpark and Python.
- Interpret complex data requirements from stakeholders and shape data sets for Data Analysts.
- Build and manage data supply to multiple systems and applications, ensuring data availability.
- Lead large-scale data and platform transformation and/or migration programmes.
- Apply deep understanding and experience of cloud data engineering toolsets to develop complex pipelines.
- Oversee the use of operational tracking and cataloguing tools to track data and metadata.
- Lead the use of Agile practices in the team to streamline data pipelines and automate testing and deployment.
Benefits:
- Salary: £57,946 - £75,664 per year
- Civil Service Defined Benefit Pension scheme contribution of £16,786
- Flexible working patterns, including job sharing, term-time working, flexi-time, and compressed hours
- Generous annual leave and public holidays
- Support for financial wellbeing, including interest-free season ticket loans and a cycle to work scheme
- Health and wellbeing support, including an Employee Assistance Programme
- Family-friendly policies, including enhanced maternity and shared parental leave pay
- Funded learning and development opportunities
- Inclusive and diverse environment with opportunities to join professional networks