StopHC: A Harmful Content Detection and Mitigation Architecture for Social Media Platforms

TL;DR

The aim with STOPHC is to create more secure online environments by employing deep neural network architecture for harmful content detection, and one that uses a network immunization algorithm to block toxic nodes and stop the spread of harmful content.

Abstract

The mental health of social media users has started more and more to be put at risk by harmful, hateful, and offensive content. In this paper, we propose \textsc{StopHC}, a harmful content detection and mitigation architecture for social media platforms. Our aim with \textsc{StopHC} is to create more secure online environments. Our solution contains two modules, one that employs deep neural network architecture for harmful content detection, and one that uses a network immunization algorithm to block toxic nodes and stop the spread of harmful content. The efficacy of our solution is demonstrated by experiments conducted on two real-world datasets.

Figures (4)

• Figure 1: StopHC Architecture
• Figure 2: User interface
• Figure 3: Edges of the most influential 10 nodes using different immunization algorithms
• Figure 4: Number of saved nodes