Large-scale online deanonymization with LLMs
Simon Lermen, Daniel Paleka, Joshua Swanson, Michael Aerni, Nicholas Carlini, Florian Tramèr
TL;DR
This work shows that large language models with web access can automate deanonymization of pseudonymous online profiles at scale by extracting identity-relevant signals from unstructured text, searching across vast candidate pools via embeddings, and performing multi-stage reasoning with calibrated confidence. The authors introduce the ESRC framework (Extract, Search, Reason, Calibrate) to modularize deanonymization and enable rigorous ablations, and they validate their approach across three settings: cross-platform profile linking (Hacker News to LinkedIn), cross-community Reddit matching, and temporally split Reddit profiles. Across these settings, LLM-based methods substantially outperform Narayanan-style baselines, achieving recall up to 68.3% at 90% precision and demonstrating robustness to large candidate pools and rare matchability. The results underscore significant privacy risks associated with pseudonymous participation and encourage rethinking privacy guarantees, platform policies, and potential mitigations in the era of accessible LLM-powered deanonymization. The work also discusses ethical considerations, limitations, and avenues for future defenses and evaluative frameworks at scale.
Abstract
We show that large language models can be used to perform at-scale deanonymization. With full Internet access, our agent can re-identify Hacker News users and Anthropic Interviewer participants at high precision, given pseudonymous online profiles and conversations alone, matching what would take hours for a dedicated human investigator. We then design attacks for the closed-world setting. Given two databases of pseudonymous individuals, each containing unstructured text written by or about that individual, we implement a scalable attack pipeline that uses LLMs to: (1) extract identity-relevant features, (2) search for candidate matches via semantic embeddings, and (3) reason over top candidates to verify matches and reduce false positives. Compared to prior deanonymization work (e.g., on the Netflix prize) that required structured data or manual feature engineering, our approach works directly on raw user content across arbitrary platforms. We construct three datasets with known ground-truth data to evaluate our attacks. The first links Hacker News to LinkedIn profiles, using cross-platform references that appear in the profiles. Our second dataset matches users across Reddit movie discussion communities; and the third splits a single user's Reddit history in time to create two pseudonymous profiles to be matched. In each setting, LLM-based methods substantially outperform classical baselines, achieving up to 68% recall at 90% precision compared to near 0% for the best non-LLM method. Our results show that the practical obscurity protecting pseudonymous users online no longer holds and that threat models for online privacy need to be reconsidered.
