Logo
ScienceStack
Table of Contents
Fetching ...
Sign In

Cybersecurity Data Extraction from Common Crawl

Ashim Mahara

TL;DR

Alpha-Root is a cybersecurity-focused dataset collected in a single shot from the Common Crawl web graph using community detection, using community detection to mine quality domains directly from the web graph.

Abstract

Alpha-Root is a cybersecurity-focused dataset collected in a single shot from the Common Crawl web graph using community detection. Unlike iterative content-scoring approaches like DeepSeekMath, we mine quality domains directly from the web graph, starting from just 20 trusted seed domains.

Cybersecurity Data Extraction from Common Crawl

TL;DR

Alpha-Root is a cybersecurity-focused dataset collected in a single shot from the Common Crawl web graph using community detection, using community detection to mine quality domains directly from the web graph.

Abstract

Alpha-Root is a cybersecurity-focused dataset collected in a single shot from the Common Crawl web graph using community detection. Unlike iterative content-scoring approaches like DeepSeekMath, we mine quality domains directly from the web graph, starting from just 20 trusted seed domains.
Paper Structure (29 sections, 2 equations, 1 figure, 4 tables)

This paper contains 29 sections, 2 equations, 1 figure, 4 tables.

Table of Contents

  1. Introduction
  2. Background
  3. Deep Learning
  4. Deep Learning in Cybersecurity
  5. Large Language Models
  6. Related Work
  7. Pretraining of Language Models
  8. Early Datasets for Pretraining of Language Models
  9. Modern Datasets for Pretraining of LLMs
  10. Cybersecurity Datasets
  11. Alpha-Root
  12. Overview
  13. Cybersecurity Community Detection in Web Graph
  14. Web Graph
  15. Extraction of Cybersecurity Community
  16. ...and 14 more sections

Figures (1)

  • Figure 1: Dataset Extraction Process