Case study · Home Office
Faster, cleaner data for border enforcement
65%shorter run time
At a glance
- Client
- Home Office, through Capgemini Invent
- Sector
- Central government
- When
- 2020 to 2022
- Security clearance
- SC (Security Check)
- Type of work
- Central government
- Tools
- Python
- SQL
- SQLAlchemy
- PyTest
The challenge
More than 12 legacy SQL pipelines fed triage and management work in border enforcement, and the old pipelines had bugs.
What we did
We moved the pipelines into modular, object-oriented Python components, with vectorisation and parallel processing. We added PEP 8 code, PyTest unit tests, peer reviews and reconciliation checks.
The result
Run time fell by 65%, and data quality improved by 30%.
We did this work before we started Mithril.
Talk to us
Do you have a data problem like this one? Email kel@mithrilcorp.co.uk.