Government
Data Engineering, Integration, and Cloud Adoption

Generating Synthetic Breach Data for the National Cyber Crime Unit using Python

Butterfly Data built a Python tool that generates realistic synthetic data like the data exposed in a breach.
Download case study

Download a PDF version to read offline or share with your team.

Get in touch

Want to find out more? Get in touch with our team today to learn more about how we could help your business.

Share

Challenge

The National Cyber Crime Unit (NCCU) responds to critical cyber incidents and pursues cybercriminals, and an internal team develops the unit’s cyber capabilities. However, the team lacked suitable data to test and improve its tools.

The NCCU needed realistic synthetic data like the data that might be exposed in a breach, covering companies in sectors such as manufacturing, finance and government. The data would be used to test in-house tools, including AI models, and as a honeypot to attract cybercriminals and build a better understanding of their activity.

Solution

‍Butterfly Data built a tool in Python that uses the Faker and Jinja packages to generate synthetic but realistic documents automatically.

The code used an object-oriented approach. Classes for individuals, employees, projects and companies shared common attributes and built on one another, which reproduced the networks of relationships found in real systems. Jinja turned the data generated by Faker into realistic documents such as invoices and forms.

The data had to be realistic without risking a match with real sensitive data, so records such as National Insurance numbers were generated in a way that meant they could not be mistaken for real ones. The same care was applied to free text, such as emails between colleagues.

Impact
The NCCU received realistic invoices, asset registers and expense records, all customised to its pre-defined parameters.  

Butterfly Data also supplied supporting documents that record how each data item was created and the ethical considerations involved in creating and using the synthetic data.

Ready to transform your data?

Book your free discovery call and find out how our bespoke data services and solutions could help you uncover untapped potential and maximise ROI.