Description
We are transforming DCMS to meet the demands of an agile, delivery-focused department leading on some of the highest priority work for the government’s agenda to drive growth, enrich lives and level-up society.
Our modernisation plans include critical investment in our systems, ensuring they are fit for purpose and reducing the manual input required, as well as the ongoing development of a new central function to transform the way DCMS uses technology, data and digital services.
This is an incredibly exciting time to join the team within DCMS. Our mission is to digitally enable how DCMS delivers its priority outcomes which can adapt and respond to the changing needs of the sectors and partners we work with.
Job Description
You will work within an agile multidisciplinary team supporting the design, development and maintenance of data pipelines and systems on our Databricks platform. You will help ensure that data within the department is accessible, reliable and secure, enabling data-driven decision making.
As a Data Engineer, you will:
- Write clean, efficient, reusable and tested code, applying best practices, version control and CI/CD automation.
- Design, implement and maintain robust ETL/ELT pipelines and data flows connecting operational systems to analytics and Business Intelligence (BI) platforms using Databricks.
- Design and maintain structured data models to ensure data is conformed, efficient to query and business-ready.
- Monitor, troubleshoot and optimise pipeline performance and system reliability, investigating root causes and putting preventative measures in place.
- Collaborate with data analysts, data scientists and business stakeholders to gather requirements and deliver business value through iterative agile delivery.
- Apply data classification, security standards, and governance procedures to manage access controls, maintain metadata and ensure regulatory compliance.
Person Specification
Essential Requirements:
- Strong proficiency in Python and SQL to manipulate, transform and optimise datasets.
- Proven experience designing, building and maintaining scalable ETL/ELT pipelines in modern cloud environment platforms.
- Experience working independently within agile, multidisciplinary teams to plan, prioritise and translate business requirements into technical deliverables.
- Strong analytical and problem-solving skills, including the ability to investigate and resolve pipeline failures, performance bottlenecks and data quality issues.
- Ability to explain technical concepts clearly to both technical and non-technical stakeholders.
Desirable Skills:
- Experience with modern data stack tooling for orchestration, testing and transformations such as Github Actions.
- Experience conducting code reviews.
Benefits
Alongside your salary of £43,065, Department for Culture, Media and Sport contributes £12,475 towards you being a member of the Civil Service Defined Benefit Pension scheme.
DCMS values its staff and offers a wide range of benefits to everyone who works here. We’re committed to developing talent, and supporting colleagues to have great careers in our department. Some of the benefits we offer include:
- Flexible working arrangements and hybrid working
- 26.5 days annual leave on entry, increasing to 31.5 days after 5 years’ service
- A Civil Service pension with an employer contribution of 28.97%
- Access to the Edenred employee benefits system which offers discounts to popular retailers and access to various useful resources such as financial and savings advice
- 3 days of paid volunteering leave
- Up to 9 months maternity leave on full pay + generous paternity and adoption leave
- Staff reward and recognition bonuses that operate throughout the year
- Occupational sick pay
- Access to the Employee Assistance Programme which offers staff 24/7 confidential support and resources such as counselling, debt guidance and management advice
- Active and engaged staff networks to join including the LGBT+, Ethnic Diversity, Mental Health and Wellbeing and Gender Equality Networks
- Exceptional learning and development opportunities that you can explore alongside your day to day work
- Season ticket loan, cycle to work scheme and much more!