Table of Contents
Fetching ...

Who Does This Name Remind You of? Nationality Prediction via Large Language Model Associative Memory

Keito Inoshita

TL;DR

This work introduces LAMA, a dual-agent, recall-based framework that treats LLM knowledge as associative memory to predict nationality from names. By pairing a Person Agent with a Media Agent to recall famous individuals sharing a name and aggregating their nationalities through voting, LAMA bypasses traditional abstract linguistic reasoning. The method achieves state-of-the-art results on a 99-country nationality task ($A\!r\!c\!u\!c\!y=0.817$) and shows robust performance across region and continent granularities, with notable resilience to label frequency. The findings suggest that leveraging concrete named examples via recall can outperform direct prompting, offering a new paradigm for knowledge elicitation with potential applicability to other attribute prediction tasks.

Abstract

Large language models (LLMs) possess extensive world knowledge, yet methods for effectively eliciting this knowledge remain underexplored. Nationality and region prediction tasks require understanding of not only linguistic features but also cultural and historical background, making LLM world knowledge particularly valuable. However, conventional LLM prompting methods rely on direct reasoning approaches, which have limitations in applying abstract linguistic rules. We propose LLM Associative Memory Agents (LAMA), a novel framework that leverages LLM world knowledge as associative memory. Rather than directly inferring nationality from names, LAMA recalls famous individuals with the same name and aggregates their nationalities through indirect reasoning. A dual-agent architecture comprising a Person Agent and a Media Agent, specialized in different knowledge domains, recalls famous individuals in parallel, generating Top-1 predictions through voting and Top-K predictions through conditional completion. On a 99-country nationality prediction task, LAMA achieved 0.817 accuracy, substantially outperforming conventional LLM prompting methods and neural models. Our experiments reveal that LLMs exhibit higher reliability in recalling concrete examples than in abstract reasoning, that recall-based approaches are robust to low-frequency nationalities independent of data frequency distributions, and that the dual-agent architecture functions complementarily to produce synergistic effects. These results demonstrate the effectiveness of a new multi-agent system that retrieves and aggregates LLM knowledge rather than prompting reasoning.

Who Does This Name Remind You of? Nationality Prediction via Large Language Model Associative Memory

TL;DR

This work introduces LAMA, a dual-agent, recall-based framework that treats LLM knowledge as associative memory to predict nationality from names. By pairing a Person Agent with a Media Agent to recall famous individuals sharing a name and aggregating their nationalities through voting, LAMA bypasses traditional abstract linguistic reasoning. The method achieves state-of-the-art results on a 99-country nationality task () and shows robust performance across region and continent granularities, with notable resilience to label frequency. The findings suggest that leveraging concrete named examples via recall can outperform direct prompting, offering a new paradigm for knowledge elicitation with potential applicability to other attribute prediction tasks.

Abstract

Large language models (LLMs) possess extensive world knowledge, yet methods for effectively eliciting this knowledge remain underexplored. Nationality and region prediction tasks require understanding of not only linguistic features but also cultural and historical background, making LLM world knowledge particularly valuable. However, conventional LLM prompting methods rely on direct reasoning approaches, which have limitations in applying abstract linguistic rules. We propose LLM Associative Memory Agents (LAMA), a novel framework that leverages LLM world knowledge as associative memory. Rather than directly inferring nationality from names, LAMA recalls famous individuals with the same name and aggregates their nationalities through indirect reasoning. A dual-agent architecture comprising a Person Agent and a Media Agent, specialized in different knowledge domains, recalls famous individuals in parallel, generating Top-1 predictions through voting and Top-K predictions through conditional completion. On a 99-country nationality prediction task, LAMA achieved 0.817 accuracy, substantially outperforming conventional LLM prompting methods and neural models. Our experiments reveal that LLMs exhibit higher reliability in recalling concrete examples than in abstract reasoning, that recall-based approaches are robust to low-frequency nationalities independent of data frequency distributions, and that the dual-agent architecture functions complementarily to produce synergistic effects. These results demonstrate the effectiveness of a new multi-agent system that retrieves and aggregates LLM knowledge rather than prompting reasoning.
Paper Structure (31 sections, 5 equations, 2 figures, 10 tables, 1 algorithm)