Conversational Successes and Breakdowns in Everyday Non-Display Smart Glasses Use

TL;DR

This work conducts a month-long collaborative autoethnography to identify patterns of successes and breakdowns when using non-display smart glasses, and compares these patterns with prior findings on voice-only interactions to highlight the unique affordances and opportunities offered by non-display smart glasses.

Abstract

Non-Display Smart Glasses hold the potential to support everyday activities by combining continuous environmental sensing with voice-only interaction powered by large language models (LLMs). Understanding how conversational successes and breakdowns arise in everyday contexts can better inform the design of future voice-only interfaces. To investigate this, we conducted a month-long collaborative autoethnography (n=2) to identify patterns of successes and breakdowns when using such devices. We then compare these patterns with prior findings on voice-only interactions to highlight the unique affordances and opportunities offered by non-display smart glasses.

Figures (2)

• Figure 1: This figure include four examples of successful conversational contexts regarding S1) Instant Referential Problem-Solving and S2) Understanding Unfamiliar Knowledge.
• Figure 2: This figure includes four types of breakdown regarding response B1) Referential Rncoherence and B2) Conflict with Human Perception