Logo
ScienceStack
Table of Contents
Fetching ...
Sign In

"It Brought the Model to Life": Exploring the Embodiment of Multimodal I3Ms for People who are Blind or have Low Vision

Samuel Reinders, Matthew Butler, Kim Marriott

TL;DR

The paper investigates whether embedding I3Ms with non-visual design factors can enhance engagement and perceived embodiment for BLV users. Using two model subjects (Saturn V Rocket and Egyptian Pyramids) configured in High and Low Embodied Modes, the study with 12 BLV participants shows that higher embodiment increases liveliness and engagement, though its impact on trust is inconclusive. The work demonstrates significant benefits of embodied design factors, especially haptic feedback and individualized voices, and offers practical design recommendations to improve BLV access to educational and museum content. It establishes a foundation for future research on embodied I3Ms, including broader model sets, real-world deployments, and the integration of generative AI to enhance conversational capabilities.

Abstract

3D-printed models are increasingly used to provide people who are blind or have low vision (BLV) with access to maps, educational materials, and museum exhibits. Recent research has explored interactive 3D-printed models (I3Ms) that integrate touch gestures, conversational dialogue, and haptic vibratory feedback to create more engaging interfaces. Prior research with sighted people has found that imbuing machines with human-like behaviours, i.e., embodying them, can make them appear more lifelike, increasing social perception and presence. Such embodiment can increase engagement and trust. This work presents the first exploration into the design of embodied I3Ms and their impact on BLV engagement and trust. In a controlled study with 12 BLV participants, we found that I3Ms using specific embodiment design factors, such as haptic vibratory and embodied personified voices, led to an increased sense of liveliness and embodiment, as well as engagement, but had mixed impact on trust.

"It Brought the Model to Life": Exploring the Embodiment of Multimodal I3Ms for People who are Blind or have Low Vision

TL;DR

The paper investigates whether embedding I3Ms with non-visual design factors can enhance engagement and perceived embodiment for BLV users. Using two model subjects (Saturn V Rocket and Egyptian Pyramids) configured in High and Low Embodied Modes, the study with 12 BLV participants shows that higher embodiment increases liveliness and engagement, though its impact on trust is inconclusive. The work demonstrates significant benefits of embodied design factors, especially haptic feedback and individualized voices, and offers practical design recommendations to improve BLV access to educational and museum content. It establishes a foundation for future research on embodied I3Ms, including broader model sets, real-world deployments, and the integration of generative AI to enhance conversational capabilities.

Abstract

3D-printed models are increasingly used to provide people who are blind or have low vision (BLV) with access to maps, educational materials, and museum exhibits. Recent research has explored interactive 3D-printed models (I3Ms) that integrate touch gestures, conversational dialogue, and haptic vibratory feedback to create more engaging interfaces. Prior research with sighted people has found that imbuing machines with human-like behaviours, i.e., embodying them, can make them appear more lifelike, increasing social perception and presence. Such embodiment can increase engagement and trust. This work presents the first exploration into the design of embodied I3Ms and their impact on BLV engagement and trust. In a controlled study with 12 BLV participants, we found that I3Ms using specific embodiment design factors, such as haptic vibratory and embodied personified voices, led to an increased sense of liveliness and embodiment, as well as engagement, but had mixed impact on trust.

Paper Structure

This paper contains 50 sections, 2 figures, 8 tables.

Table of Contents

  1. Introduction
  2. Related Work
  3. Accessible Graphics
  4. Interactive 3D-Printed Models
  5. The Embodiment of Agents
  6. The Embodiment of I3Ms
  7. Embodied Design Factors
  8. Model Selection & Design
  9. Touch Gestures.
  10. Conversational Agent.
  11. Haptic Vibratory Feedback.
  12. Conversational Embodiment Design Factors
  13. DF#1: Introductions and Small Talk.
  14. DF#2: Embodied Personified Voices.
  15. DF#3: Embodied Narration Style.
  16. ...and 35 more sections

Figures (2)

  • Figure 1: I3M Architecture. Shown is the Pyramid I3M in HEM. The base houses a Raspberry Pi, speaker, and mic. Components enable local sensing, each equipped with a microcontroller, touchpoint, accelerometer, haptic motor, and battery. The Pi manages embodiment state, controls speech input and output, and connects to the conversational agent.
  • Figure 2: In A), the Egyptian Pyramids I3M is configured in HEM, showing a user pressing the Sphinx touchpoint, triggering localised haptics and a personified voice response via a speaker contained within the I3M's enclosure; B) shows the Pyramid I3M's components -- the Great Pyramid, Sphinx, and Khafre/Menkaure. In C), the Saturn V Rocket I3M is in LEM, with a user pressing the Stage C touchpoint, triggering speech output via an external speaker; D) shows the Rocket I3M's components -- detachable Stage A/B/C rocket modules, and the Launch Tower.