Logo
ScienceStack
Table of Contents
Fetching ...
Sign In

Evaluating Spatialized Auditory Cues for Rapid Attention Capture in XR

Yoonsang Kim, Swapnil Dey, Arie Kaufman

TL;DR

This study examines whether spatialized audio can act as a rapid, first-stage attention cue in time-critical XR tasks without relying on head-driven refinement or extended listening. Using HRTF-based broadband stimuli emitted from a semi-dense spherical grid, the authors quantify coarse localization performance and test a short visuo-auditory calibration to recalibrate listener mappings. Results show that brief spatial cues convey coarse directional information and that short calibration yields measurable improvements, though audio alone remains insufficient for precise guidance in high-stakes scenarios. The findings offer design guidelines for integrating spatial audio as an initial attention-directing channel in wearable XR and highlight directions for future work, including multimodal augmentation and perceptually informed stimulus design.

Abstract

In time-critical eXtended reality (XR) scenarios where users must rapidly reorient their attention to hazards, alerts, or instructions while engaged in a primary task, spatial audio can provide an immediate directional cue without occupying visual bandwidth. However, such scenarios can afford only a brief auditory exposure, requiring users to interpret sound direction quickly and without extended listening or head-driven refinement. This paper reports a controlled exploratory study of rapid spatial-audio localization in XR. Using HRTF-rendered broadband stimuli presented from a semi-dense set of directions around the listener, we quantify how accurately users can infer coarse direction from brief audio alone. We further examine the effects of short-term visuo-auditory feedback training as a lightweight calibration mechanism. Our findings show that brief spatial cues can convey coarse directional information, and that even short calibration can improve users' perception of aural signals. While these results highlight the potential of spatial audio for rapid attention guidance, they also show that auditory cues alone may not provide sufficient precision for complex or high-stakes tasks, and that spatial audio may be most effective when complemented by other sensory modalities or visual cues, without relying on head-driven refinement. We leverage this study on spatial audio as a preliminary investigation into a first-stage attention-guidance channel for wearable XR (e.g., VR head-mounted displays and AR smart glasses), and provide design insights on stimulus selection and calibration for time-critical use.

Evaluating Spatialized Auditory Cues for Rapid Attention Capture in XR

TL;DR

This study examines whether spatialized audio can act as a rapid, first-stage attention cue in time-critical XR tasks without relying on head-driven refinement or extended listening. Using HRTF-based broadband stimuli emitted from a semi-dense spherical grid, the authors quantify coarse localization performance and test a short visuo-auditory calibration to recalibrate listener mappings. Results show that brief spatial cues convey coarse directional information and that short calibration yields measurable improvements, though audio alone remains insufficient for precise guidance in high-stakes scenarios. The findings offer design guidelines for integrating spatial audio as an initial attention-directing channel in wearable XR and highlight directions for future work, including multimodal augmentation and perceptually informed stimulus design.

Abstract

In time-critical eXtended reality (XR) scenarios where users must rapidly reorient their attention to hazards, alerts, or instructions while engaged in a primary task, spatial audio can provide an immediate directional cue without occupying visual bandwidth. However, such scenarios can afford only a brief auditory exposure, requiring users to interpret sound direction quickly and without extended listening or head-driven refinement. This paper reports a controlled exploratory study of rapid spatial-audio localization in XR. Using HRTF-rendered broadband stimuli presented from a semi-dense set of directions around the listener, we quantify how accurately users can infer coarse direction from brief audio alone. We further examine the effects of short-term visuo-auditory feedback training as a lightweight calibration mechanism. Our findings show that brief spatial cues can convey coarse directional information, and that even short calibration can improve users' perception of aural signals. While these results highlight the potential of spatial audio for rapid attention guidance, they also show that auditory cues alone may not provide sufficient precision for complex or high-stakes tasks, and that spatial audio may be most effective when complemented by other sensory modalities or visual cues, without relying on head-driven refinement. We leverage this study on spatial audio as a preliminary investigation into a first-stage attention-guidance channel for wearable XR (e.g., VR head-mounted displays and AR smart glasses), and provide design insights on stimulus selection and calibration for time-critical use.
Paper Structure (19 sections, 3 figures, 1 table)

This paper contains 19 sections, 3 figures, 1 table.

Table of Contents

  1. Introduction
  2. Related Work
  3. Multi-sensory Notification in XR
  4. Aural Perception and Cues
  5. Spatial Audio in XR
  6. Sensory Calibration and Learning
  7. Design of Preliminary Evaluation
  8. Design Considerations
  9. Experimental Design and Variables
  10. Hypotheses
  11. Participants
  12. Apparatus and Setup
  13. Measurements
  14. Task
  15. Procedure
  16. ...and 4 more sections

Figures (3)

  • Figure 1: Layout of the audio emitters. 90 virtual sound sources are positioned on the surface of a sphere centered at the participant (r=5 meters) with a horizontal ($\theta$; azimuth) sampling interval of $20^\circ$ over $0^\circ$ to $360^\circ$, and vertical ($\phi$, elevation) increments of $30^\circ$ over $-60^\circ$ to $60^\circ$. The top-down view (left circle) shows the horizontal ring relative to the participant's forward direction, and the side view (right sphere) illustrates the elevation rings and the spherical coordinate definition of $\theta$ and $\phi$.
  • Figure 2: User study setup. Participants are instructed to point towards the perceived direction of an emitter after each stimulus.
  • Figure 3: 2D projection-mapped visualization of localization error of each axis (horizontal/vertical) across directions. Emitter directions on the sphere are mapped to an equirectangular 2D grid (horizontal axis: labeled Back-Left-Front-Right-Back; vertical axis: labeled Up-Down). Brighter colors indicate larger errors and Darker colors for low error regions. (A, B) Horizontal ($\theta$) and Vertical ($\phi$) deviation visualization (ground-truth to user-inference error). Note the markings (in red dashed line) of each region in (A); (C,D,E,F,H) pairs its opposite direction-pair to visualize the side-by-side comparison of the error rate visualization. (C,E) indicate Front-Back, (D,F) depict the Left-Right, and (G,H) show Up-Bottom pairs, each representing the segmented sub-components of (A) and (B) respectively. The visualization in (A) depicts the error-prone emitter regions for horizontal dimension-azimuth ($\theta$), and (B) for vertical-elevation ($\phi$)