Senior Data Engineer (up to £83,918)

At the Department for Education (DfE), we're committed to creating a diverse and inclusive environment that allows all employees to thrive. As a Senior Data Engineer, you'll be part of the Data Directorate, working on high-impact, secure data solutions to achieve departmental objectives.

Job Description: As a Senior Data Engineer, you'll join a team of talented data engineering professionals working in a large and complex data environment. You'll design, build, and deliver high-performance, secure, scalable data solutions, adapting and embedding practices like CI/CD and DevOps. Your responsibilities will include:

• Working with multidisciplinary teams to understand data needs and deliver solutions
• Leading and building complex data engineering solutions for data products
• Ensuring the stability, robustness, and resilience of products
• Coaching and mentoring junior team members
• Helping build and maintain the data engineering community

Requirements: Essential criteria include experience with:

• Designing, building, and performance-tuning complex data pipelines
• Proficiency in two or more of SQL, Python, Apache Spark (Pyspark, Spark SQL)
• Working with structured and unstructured data, data lakes, and large data warehouses
• Implementing modern data architectures and Agile/DevOps practices
• Managing data quality issues and team dynamics

Desirable criteria include experience with:

• Databricks, Informatica DEI, and Azure Data Factory
• Developing complex data models and machine learning solutions

Benefits: As a DfE employee, you'll be entitled to:

• A salary of £60,222 - £83,918 per year
• A Civil Service Pension Scheme with employer contributions
• 25 days leave, increasing to 30 days after five years' service
• Flexible working arrangements, including hybrid working patterns
• Professional development opportunities

Selection Process: The selection process will assess your experience and behaviors, including leadership, through a written application, sift, and interview stages.