A Comprehensive Study on Dark Patterns

TL;DR

This work addresses the fragmentation in dark pattern research by introducing the Dark Pattern Analysis Framework (DPAF), which combines a systematic literature review with a highly detailed taxonomy of 68 dark pattern types across 6 categories. It provides an industry-validated annotation of harms and scenarios, and evaluates current detection tools (8 tools, 45.5% coverage) and public datasets (4 datasets, 44% coverage), followed by constructing standard image and text datasets aligned to the taxonomy. The study demonstrates substantial gaps in taxonomy comprehensiveness, detection coverage, and dataset breadth, and offers standard datasets and a maintenance workflow to support ongoing research and practical mitigation. The results enable standardized terminology, more robust tool development, and informed policy discussions to advance ethical UI/UX design and user protection.

Abstract

As digital interfaces become increasingly prevalent, certain manipulative design elements have emerged that may harm user interests, raising associated ethical concerns and bringing dark patterns into focus as a significant research topic. Manipulative design strategies are widely used in user interfaces (UI) primarily to guide user behavior in ways that favor service providers, often at the cost of the users themselves. This paper addresses three main challenges in dark pattern research: inconsistencies and incompleteness in classification, limitations of detection tools, and insufficient comprehensiveness in existing datasets. In this study, we propose a comprehensive analytical framework--the Dark Pattern Analysis Framework (DPAF). Using this framework, we developed a taxonomy comprising 68 types of dark patterns, each annotated in detail to illustrate its impact on users, potential scenarios, and real-world examples, validated through industry surveys. Furthermore, we evaluated the effectiveness of current detection tools and assessed the completeness of available datasets. Our findings indicate that, among the 8 detection tools studied, only 31 types of dark patterns are identifiable, resulting in a coverage rate of just 45.5%. Similarly, our analysis of four datasets, encompassing 5,561 instances, reveals coverage of only 30 types of dark patterns, with an overall coverage rate of 44%. Based on the available datasets, we standardized classifications and merged datasets to form a unified image dataset and a unified text dataset. These results highlight significant room for improvement in the field of dark pattern detection. This research not only deepens our understanding of dark pattern classification and detection tools but also offers valuable insights for future research and practice in this domain.

Figures (5)

• Figure 1: Some examples of Dark Pattern
• Figure 2: The framework of DPAF
• Figure 3: Annual Publication Trend of Dark Patterns-Related Research Papers
• Figure 4: The proportion of dark pattern types included in different categories
• Figure 5: Comprehensive dark pattern instances count across three datasets