Case study · Home Office

Faster, cleaner data for border enforcement

65%shorter run time

At a glance

Client
Home Office, through Capgemini Invent
Sector
Central government
When
2020 to 2022
Security clearance
SC (Security Check)
Type of work
Central government
Tools
  • Python
  • SQL
  • SQLAlchemy
  • PyTest

The challenge

More than 12 legacy SQL pipelines fed triage and management work in border enforcement, and the old pipelines had bugs.

What we did

We moved the pipelines into modular, object-oriented Python components, with vectorisation and parallel processing. We added PEP 8 code, PyTest unit tests, peer reviews and reconciliation checks.

The result

Run time fell by 65%, and data quality improved by 30%.

We did this work before we started Mithril.

Talk to us

Do you have a data problem like this one? Email kel@mithrilcorp.co.uk.