CrimeBB: enabling cybercrime research on underground forums at scale

Sergio Pastrana, Daniel R. Thomas, Alice Hutchings, Richard Clayton

Research output: Chapter in Book/Report/Conference proceedingConference contribution book

24 Citations (Scopus)
4 Downloads (Pure)


Underground forums allow criminals to interact, exchange knowledge, and trade in products and services. They also provide a pathway into cybercrime, tempting the curious to join those already motivated to obtain easy money. Analysing these forums enables us to better understand the behaviours of offenders and pathways into crime. Prior research has been valuable, but limited by a reliance on datasets that are incomplete or outdated. More complete data, going back many years, allows for comprehensive research into the evolution of forums and their users. We describe CrimeBot, a crawler designed around the particular challenges of capturing data from underground forums. CrimeBot is used to update and maintain CrimeBB, a dataset of more than 48m posts made from 1m accounts in 4 different operational forums over a decade. This dataset presents a new opportunity for large-scale and longitudinal analysis using up-to-date information. We illustrate the potential by presenting a case study using CrimeBB, which analyses which activities lead new actors into engagement with cybercrime. CrimeBB is available to other academic researchers under a legal agreement, designed to prevent misuse and provide safeguards for ethical research.
Original languageEnglish
Title of host publicationWWW '18 : Proceedings of the 2018 World Wide Web Conference
Place of PublicationNew York, NY.
Number of pages10
Publication statusPublished - 27 Apr 2018
Event2018 World Wide Web Conference on World Wide Web - WWW 2018 - Lyon, France
Duration: 23 Apr 201827 Apr 2018


Conference2018 World Wide Web Conference on World Wide Web - WWW 2018
Abbreviated titleWWW 2018


  • information systems
  • underground forums
  • cybercrime
  • money laundering
  • ethics
  • data sharing
  • web crawling
  • CrimeBot
  • CrimeBB

Fingerprint Dive into the research topics of 'CrimeBB: enabling cybercrime research on underground forums at scale'. Together they form a unique fingerprint.

Cite this