Data Engineer - MI5 - The Security Service - HEO

Location: London

Use data engineering to help keep the UK safe

We're looking for Data Engineers with hands on experience designing and building data solutions to join multidisciplinary product teams delivering secure, high impact systems at the heart of UK national security.

The role

As a Data Engineer, you'll sit within a multidisciplinary product team, working alongside software engineers, data scientists, product owners, business analysts and delivery managers.

You'll design, build and operate secure data applications and products, using a mix of modern cloud technologies, on premise platforms and long established systems. You'll follow Agile and DevSecOps principles to deliver reliable solutions that support MI5's critical operations.

What you'll be doing

In this role, you will:

• Design and implement moderate to complex data pipelines and data flows
• Build and manage data integration solutions across multiple sources
• Support analytics, business intelligence and investigative capabilities
• Work closely with users to deliver new features and improve existing products
• Identify and fix defects, creating automated tests to maintain assurance
• Take ownership of complex problems, breaking them down and prioritising delivery
• Apply modern engineering approaches, including CI/CD and Agile practices
• Share knowledge, mentor colleagues and help define what good looks like
• Contribute to Communities of Practice and cross organisation initiatives

The technology

Our tech stacks vary by product and may include:

• SQL and NoSQL databases
• Commercial and bespoke platforms
• Data processing and integration tools such as AWS Glue, Apache Spark, Airbyte, NiFi, Fivetran or similar
• Programming languages including Python, Java, SQL, Scala, PL/SQL or SAS
• Data and analytics tools such as Jupyter, Kibana, SAS and AWS services

You'll work with a wide range of data models and formats, from structured and unstructured data to geo enabled and graph based models.

Who we're looking for

You'll be someone who can demonstrate:

• Experience delivering data engineering solutions within a development team
• Confidence designing and implementing data integration and processing pipelines
• Comfort learning and using a wide range of technologies
• Experience working with Agile and CI/CD approaches
• An understanding of good design patterns and secure engineering practices
• Strong communication skills with both technical and non technical colleagues
• A willingness to support and mentor others in an inclusive environment

Interested?

Apply via Civil Service Jobs to see full details, including the selection process and security requirements.