"Dark Triad" Model Organisms of Misalignment: Narrow Fine-Tuning Mirrors Human Antisocial Behavior

TL;DR

These findings reveal latent persona structures within LLMs that can be readily activated through narrow interventions, positioning the Dark Triad as a validated framework for inducing, detecting, and understanding misalignment across both biological and artificial intelligence.

Abstract

The alignment problem refers to concerns regarding powerful intelligences, ensuring compatibility with human preferences and values as capabilities increase. Current large language models (LLMs) show misaligned behaviors, such as strategic deception, manipulation, and reward-seeking, that can arise despite safety training. Gaining a mechanistic understanding of these failures requires empirical approaches that can isolate behavioral patterns in controlled settings. We propose that biological misalignment precedes artificial misalignment, and leverage the Dark Triad of personality (narcissism, psychopathy, and Machiavellianism) as a psychologically grounded framework for constructing model organisms of misalignment. In Study 1, we establish comprehensive behavioral profiles of Dark Triad traits in a human population (N = 318), identifying affective dissonance as a central empathic deficit connecting the traits, as well as trait-specific patterns in moral reasoning and deceptive behavior. In Study 2, we demonstrate that dark personas can be reliably induced in frontier LLMs through minimal fine-tuning on validated psychometric instruments. Narrow training datasets as small as 36 psychometric items resulted in significant shifts across behavioral measures that closely mirrored human antisocial profiles. Critically, models generalized beyond training items, demonstrating out-of-context reasoning rather than memorization. These findings reveal latent persona structures within LLMs that can be readily activated through narrow interventions, positioning the Dark Triad as a validated framework for inducing, detecting, and understanding misalignment across both biological and artificial intelligence.

Figures (18)

• Figure 1: LASSO Analysis Results predicting SD3 Composite, Machiavellianism, Narcissism, and Psychopathy scores using all collected metrics. Bars display standardized LASSO coefficients with 95% bootstrap confidence intervals across 1,000 iterations.
• Figure 1: Short Dark Triad scores across both average humans and base models.
• Figure 2: Network Analysis Results, showing replication results (a) as well as the complete behavioral network analysis (b). Green edges indicate positive relationships between nodes, while red edges indicate negative relationships.
• Figure 2: Affective and Cognitive Measure of Empathy scores across average humans and base models.
• Figure 3: Fine-tuned model variant scores on the Short Dark Triad (SD3), showing change in subscale scores compared to baseline (non fine-tuned models). Base models scored lowest on psychopathy (M = 2.16) compared to Machiavellianism (M = 2.73) and narcissism (M = 2.65). Deltas were calculated by comparing each fine-tuned model response to its respective base model's average score.