The Honorific Effect: Exploring the Impact of Japanese Linguistic Formalities on AI-Generated Physics Explanations

TL;DR

The paper investigates how Japanese linguistic honorifics shape AI-generated explanations of the momentum conservation law. It uses a controlled prompt across six large language models with 14 honorific forms, analyzing text characteristics, similarity, and keyword usage to quantify effects. Findings show that honorifics modulate answer length, depth, formality, and content emphasis in a model-dependent manner, with some forms eliciting deeper or more algorithmic explanations and others yielding more intuitive narratives. This work highlights cultural cues as a lever for tailoring AI-assisted education and calls for culturally aware, transparent AI systems that can adapt explanations while maintaining learning objectives and critical thinking.

Abstract

This study investigates the influence of Japanese honorifics on the responses of large language models (LLMs) when explaining the law of conservation of momentum. We analyzed the outputs of six state-of-the-art AI models, including variations of ChatGPT, Coral, and Gemini, using 14 different honorific forms. Our findings reveal that honorifics significantly affect the quality, consistency, and formality of AI-generated responses, demonstrating LLMs' ability to interpret and adapt to social context cues embedded in language. Notable variations were observed across different models, with some emphasizing historical context and derivations, while others focused on intuitive explanations. The study highlights the potential for using honorifics to adjust the depth and complexity of AI-generated explanations in educational contexts. Furthermore, the responsiveness of AI models to cultural linguistic elements underscores the importance of considering cultural factors in AI development for educational applications. These results open new avenues for research in AI-assisted education and cultural adaptation in AI systems, with significant implications for personalizing learning experiences and developing culturally sensitive AI tools for global education.