Logo
ScienceStack
Table of Contents
Fetching ...
Sign In

Real-time Facial Communication Restores Cooperation After Defection in Social Dilemmas

Mayada Oudah, John Wooders

Abstract

Facial expressions are central to human interaction, yet their role in strategic decision-making has received limited attention. We investigate how real-time facial communication influences cooperation in repeated social dilemmas. In a laboratory experiment, participants play a repeated Prisoner's Dilemma game under two conditions: in one, they observe their counterpart's facial expressions via gender-neutral avatars, and in the other no facial cues are available. Using state-of-the-art biometric technology to capture and display emotions in real-time, we find that facial communication significantly increases overall cooperation and, notably, promotes cooperation following defection. This restorative effect suggests that facial expressions help participants interpret defections less harshly, fostering forgiveness and the resumption of cooperation. While past actions remain the strongest predictor of behavior, our findings highlight the communicative power of facial expressions in shaping strategic outcomes. These results offer practical insights for designing emotionally responsive virtual agents and digital platforms that sustain cooperation in the absence of physical presence.

Real-time Facial Communication Restores Cooperation After Defection in Social Dilemmas

Abstract

Facial expressions are central to human interaction, yet their role in strategic decision-making has received limited attention. We investigate how real-time facial communication influences cooperation in repeated social dilemmas. In a laboratory experiment, participants play a repeated Prisoner's Dilemma game under two conditions: in one, they observe their counterpart's facial expressions via gender-neutral avatars, and in the other no facial cues are available. Using state-of-the-art biometric technology to capture and display emotions in real-time, we find that facial communication significantly increases overall cooperation and, notably, promotes cooperation following defection. This restorative effect suggests that facial expressions help participants interpret defections less harshly, fostering forgiveness and the resumption of cooperation. While past actions remain the strongest predictor of behavior, our findings highlight the communicative power of facial expressions in shaping strategic outcomes. These results offer practical insights for designing emotionally responsive virtual agents and digital platforms that sustain cooperation in the absence of physical presence.
Paper Structure (12 sections, 11 figures)

This paper contains 12 sections, 11 figures.

Table of Contents

  1. Introduction
  2. Results
  3. Discussion
  4. Methods
  5. Data availability
  6. Code availability
  7. Acknowledgments
  8. Author contributions statement
  9. Competing interests statement

Figures (11)

  • Figure 1: The avatars used to represent facial expressions. The avatars utilize a schematic design to minimize the "Uncanny Valley" effect while maximizing signal clarity.
  • Figure 2: Avatars classification accuracy. Error bars show the standard error of the mean.
  • Figure 3: Avatars gender classification. Error bars show the standard error of the mean.
  • Figure 4: Experimental results -- Cooperation.a) Shows the cooperation rate in each treatment. Error bars show the standard error of the mean. b) Depicts cooperation rates across 30 rounds.
  • Figure 5: Facial communication significantly increases the likelihood of cooperation. Fixed-effect coefficient from a GLMM predicting cooperation ($N=5,160$). The point estimate represents log-odds relative to the nFC baseline; error bars denote 95% confidence intervals.
  • ...and 6 more figures