Towards Harnessing Large Language Models for Comprehension of Conversational Grounding
Kristiina Jokinen, Phillip Schneider, Taiga Mori
TL;DR
The paper investigates how large language models comprehend conversational grounding by classifying turns as explicit or implicit grounding and predicting grounded knowledge elements in information seeking dialogues. It evaluates LLM capabilities on these tasks, identifying challenges and failure modes. It discusses pipeline architectures and knowledge bases as pathways to improve grounding comprehension, including retrieval-augmented approaches. The work highlights limitations and provides guidance for building more effective grounding-aware dialogue systems with practical implications for deployment in knowledge-rich conversations.
Abstract
Conversational grounding is a collaborative mechanism for establishing mutual knowledge among participants engaged in a dialogue. This experimental study analyzes information-seeking conversations to investigate the capabilities of large language models in classifying dialogue turns related to explicit or implicit grounding and predicting grounded knowledge elements. Our experimental results reveal challenges encountered by large language models in the two tasks and discuss ongoing research efforts to enhance large language model-based conversational grounding comprehension through pipeline architectures and knowledge bases. These initiatives aim to develop more effective dialogue systems that are better equipped to handle the intricacies of grounded knowledge in conversations.
