Description
We help the UK move forward, faster. For nearly 150 years, we've protected the UK economy with deep expertise and rigour, building the confidence that helps businesses access lending, investment and opportunity. We help people deal with personal insolvency. We make statutory redundancy payments when insolvent employers can't. We investigate director conduct and take action where it's needed. And right now, we're changing how we do all of this, becoming faster, more digitally driven, and more focused on stopping problems before they escalate.
We're looking for a Lead Data Platform Engineer who wants more than a job that ticks boxes. The role of Lead Data Engineer will play a key role in shaping how we receive and use information within our agency. This is a role for someone who wants to think bigger, challenge the way things have always been done, and take ownership of the outcomes that matter.
Job description
You will provide technical leadership within the Data and Technology teams, taking responsibility for the organisation’s Microsoft Fabric and OneLake data platform. The platform provides the foundation for trusted analytics, reporting and AI.
You will work with Enterprise Architecture, Data Architecture, delivery teams and suppliers, alongside colleagues responsible for secure development, automated operations and application support. Together, you will develop a platform that can meet growing demand, protect information and maintain reliable services.
You will set engineering standards, guide complex technical decisions and lead the development of the data engineering team.
Responsibilities
- Lead the development of Microsoft Fabric and OneLake, setting technical direction and assuring complex solutions so the platform remains secure, scalable, resilient, recoverable and able to perform effectively
- Establish consistent engineering practices, including reusable components, automated testing, DataOps, continuous integration and delivery (CI/CD), and Infrastructure as Code, to improve quality and reduce technical debt
- Define how data moves between systems, including Dynamics 365, Dataverse, Azure services and analytical platforms, using scheduled batches, near-real-time updates and event-driven integration to meet organisational needs
- Enable trusted analytics, reporting, AI and machine learning, working with data, AI and delivery teams to move solutions into production
- Embed governance and security in platform engineering, setting standards for data quality, lineage, metadata and access, while meeting retention and compliance requirements
- Improve operational reliability and cost efficiency, working with AIOps, Application Support and FinOps colleagues on monitoring, operational management and platform consumption, and providing technical assurance across internal teams and suppliers
- Lead, line manage and develop Senior Data Engineers and Data Engineers, using mentoring, knowledge sharing, recruitment and succession planning to build internal capability, reduce reliance on supplier knowledge and support continuous improvement
Person specification
- Set clear technical direction and help others apply consistent engineering standards
- Prioritise platform improvements by balancing organisational needs, innovation, cost, security and operational resilience
- Analyse complex platform and integration problems, explain your decisions and address underlying causes
- Build effective relationships across architecture, security, operations, delivery, supplier and business teams, communicating technical information clearly
- Take ownership of delivery and identify improvements to automation, reliability, engineering quality and platform capability
- Develop others through mentoring and knowledge sharing, strengthening the team’s technical capability
Benefits
Alongside your salary of £57,367, Insolvency Service contributes £16,619 towards you being a member of the Civil Service Defined Benefit Pension scheme. Find out what benefits a Civil Service Pension provides. We offer a great benefits package including:
- Flexible working arrangements and flexi-time
- Full time new entrants to the Civil Service and those Civil Servants on modernised terms and conditions will be entitled to 25 days leave increasing on a sliding scale to 30 days after 5 years’ service
- In addition to this you are entitled to 8 public/bank holidays plus an additional day of privilege leave
- Competitive maternity, paternity and parental leave
- 5 days paid leave for learning and development
- 5 days paid for volunteering
- A Cycle to work scheme
- Staff have access to an employee assistance programme, Workplace Wellness, for confidential, independent support and advice during difficult times in either their professional or personal life