Can Large Language Models Resolve Semantic Discrepancy in Self-Destructive Subcultures? Evidence from Jirai Kei
Peng Wang, Xilin Tao, Siyi Yao, Jiageng Wu, Yuntao Zou, Zhuotao Tian, Libo Qin, Dagang Li
TL;DR
We address the challenge of detecting self-destructive behaviors within rapidly evolving subcultures, where LLMs suffer from knowledge lag and semantic misalignment. The authors introduce Subcultural Alignment Solver (SAS), a three-component framework that performs Subculture Retrieval, Alignment Report Generation, and Culture Alignment to update external knowledge and align subculture meanings with input text. Empirical results on JiraiBench show SAS outperforming prompting baselines and approaching fine-tuned LLMs, with strong generalization to other subcultures and clear multilingual retrieval dynamics. The work offers a practical, scalable approach to safer and more accurate detection of self-destructive cues in online subcultures and lays groundwork for broader cross-cultural applicability.
Abstract
Self-destructive behaviors are linked to complex psychological states and can be challenging to diagnose. These behaviors may be even harder to identify within subcultural groups due to their unique expressions. As large language models (LLMs) are applied across various fields, some researchers have begun exploring their application for detecting self-destructive behaviors. Motivated by this, we investigate self-destructive behavior detection within subcultures using current LLM-based methods. However, these methods have two main challenges: (1) Knowledge Lag: Subcultural slang evolves rapidly, faster than LLMs' training cycles; and (2) Semantic Misalignment: it is challenging to grasp the specific and nuanced expressions unique to subcultures. To address these issues, we proposed Subcultural Alignment Solver (SAS), a multi-agent framework that incorporates automatic retrieval and subculture alignment, significantly enhancing the performance of LLMs in detecting self-destructive behavior. Our experimental results show that SAS outperforms the current advanced multi-agent framework OWL. Notably, it competes well with fine-tuned LLMs. We hope that SAS will advance the field of self-destructive behavior detection in subcultural contexts and serve as a valuable resource for future researchers.
