Logo
ScienceStack
Table of Contents
Fetching ...
Sign In

Hell is Paved with Good Intentions: The Intricate Relationship Between Cognitive Biases and Dark Patterns

Thomas Mildner, Albert Inkoom, Rainer Malaka, Jasmin Niess

TL;DR

This paper investigates how cognitive biases interact with dark patterns in digital interfaces and proposes a practical framework to guide ethical design. Through four expert focus groups (N=15), the authors develop the Relationship Model of Cognitive Biases and Dark Patterns, describing three stages and five phases from design inscription to real-world interpretation. The model highlights how biases can be exploited to manipulate user decisions, the resulting implications for autonomy, and safeguarding strategies at user and organizational levels, including regulatory considerations like the EU Digital Services Act. By linking cognitive psychology with dark-pattern scholarship, the work offers a reflective, non-prescriptive roadmap to preserve user autonomy and inform future ethical and policy-oriented design research in HCI.

Abstract

Throughout the past decade, research in HCI has identified numerous instances of dark patterns in digital interfaces. These efforts have led to a well-fostered typology describing harmful strategies users struggle to navigate. However, an in-depth understanding of the underlying mechanisms that deceive, coerce, or manipulate users is missing. We explore the interplay between cognitive biases and dark patterns to address this gap. To that end, we conducted four focus groups with experts (N=15) in psychology and dark pattern scholarship, inquiring how they conceptualise the relation between cognitive biases and dark patterns. Based on our results, we constructed the "Relationship Model of Cognitive Biases and Dark Patterns" which illustrates how cognitive bias and deceptive design patterns relate and identifies opportune moments for ethical reconsideration and user protection mechanisms. Our insights contribute to the current discourse by emphasising ethical design decisions and their implications in the field of HCI.

Hell is Paved with Good Intentions: The Intricate Relationship Between Cognitive Biases and Dark Patterns

TL;DR

This paper investigates how cognitive biases interact with dark patterns in digital interfaces and proposes a practical framework to guide ethical design. Through four expert focus groups (N=15), the authors develop the Relationship Model of Cognitive Biases and Dark Patterns, describing three stages and five phases from design inscription to real-world interpretation. The model highlights how biases can be exploited to manipulate user decisions, the resulting implications for autonomy, and safeguarding strategies at user and organizational levels, including regulatory considerations like the EU Digital Services Act. By linking cognitive psychology with dark-pattern scholarship, the work offers a reflective, non-prescriptive roadmap to preserve user autonomy and inform future ethical and policy-oriented design research in HCI.

Abstract

Throughout the past decade, research in HCI has identified numerous instances of dark patterns in digital interfaces. These efforts have led to a well-fostered typology describing harmful strategies users struggle to navigate. However, an in-depth understanding of the underlying mechanisms that deceive, coerce, or manipulate users is missing. We explore the interplay between cognitive biases and dark patterns to address this gap. To that end, we conducted four focus groups with experts (N=15) in psychology and dark pattern scholarship, inquiring how they conceptualise the relation between cognitive biases and dark patterns. Based on our results, we constructed the "Relationship Model of Cognitive Biases and Dark Patterns" which illustrates how cognitive bias and deceptive design patterns relate and identifies opportune moments for ethical reconsideration and user protection mechanisms. Our insights contribute to the current discourse by emphasising ethical design decisions and their implications in the field of HCI.
Paper Structure (34 sections, 2 figures, 1 table)

This paper contains 34 sections, 2 figures, 1 table.

Table of Contents

  1. Introduction
  2. Related Work
  3. User Autonomy and Empowerment
  4. Cognitive Biases
  5. Dark Patterns
  6. Terminology
  7. Method
  8. Participants
  9. Focus Groups
  10. Initial Discussion
  11. Card Sorting Task
  12. Reflective Discussion
  13. Analysis
  14. Positionality
  15. Coding of the Focus Group Transcripts
  16. ...and 19 more sections

Figures (2)

  • Figure 1: This Figure was part of the introduction in each focus group and illustrates a common monthly subscription model of service providers with different tiers. The figure highlights in magenta the presence of cognitive biases (framing effect and decoy effect) and in blue dark patterns (aesthetic manipulation/visual interference, price comparison prevention, and hidden information/sneaking).
  • Figure 2: This Figure presents the Relationship Model of Cognitive Biases and Dark Patterns. Following a continuum from (potentially unethical) design to real-world applications, the model comprises three stages spanning five phases. Adopting Verbeek's theory of technology mediation verbeek_what_2005verbeek_materializing_2006, the model follows designers' inscription of functionalities into technology to users' interpretation, leading to the questioning of responsibilities. Depending on the impact and implications of the (unethical) design, end-users may need safeguarding measures, while policy and regulation may be required for their protection.