Can Intelligent User Interfaces Engage in Philosophical Discussions? A Longitudinal Study of Philosophers' Evolving Perceptions
Yibo Meng, Lyumanshan Ye, Eve He, Zhe Yan, Zhiming Liu, Yipeng Yu, Yan Guan, Xiaolan Ding
TL;DR
This longitudinal study investigates how philosophy scholars' attitudes toward Generative AI–based Intelligent User Interfaces (IUIs) evolve over three years, combining annual interviews with a blinded evaluation where AI and human responses are judged by peers. The findings reveal a three‑stage trajectory—from resistance to instrumental use to principled questioning of AI thought—while objective assessments show the AI catching up and eventually outperforming human experts on six philosophical dimensions. The core paradox is that increasing caution and skepticism about AI's genuine understanding coexist with rapidly improving AI output in blinded tests, prompting a call for design of responsible, value‑aligned co‑creations that preserve human autonomy and responsibility. The study argues for intentional friction, transparent attribution, and tools that stimulate deep reflection rather than seamless automation, shaping future HCI approaches to complex knowledge work and philosophical practice.
Abstract
This study investigates the evolving attitudes of philosophy scholars towards the participation of generative AI based Intelligent User Interfaces (IUIs) in philosophical discourse. We conducted a three year (2023--2025) mixed methods longitudinal study with 16 philosophy scholars and students. Qualitative data from annual interviews reveal a three stage evolution in attitude: from initial resistance and unfamiliarity, to instrumental acceptance of the IUI as a tool, and finally to a deep principled questioning of the IUI's fundamental capacity for genuine philosophical thought. Quantitative data from blind assessments, where participants rated anonymized philosophical answers from both humans and an IUI, complement these findings. While participants acknowledged the IUI's proficiency in tasks requiring formal logic and knowledge reproduction, they consistently identified significant shortcomings in areas demanding dialectical reasoning, originality and embodied understanding. The study concludes that participants do not see the IUI as a peer but rather as a sophisticated mirror whose capabilities and limitations provoke a deeper reflection on the unique and irreplaceable human dimensions of philosophical inquiry, such as intuition, value laden commitment and the courage to question fundamental premises.