Logo
ScienceStack
Table of Contents
Fetching ...
Sign In

XR Prototyping of Mixed Reality Visualizations: Compensating Interaction Latency for a Medical Imaging Robot

Jan Hendrik Plümer, Kevin Yu, Ulrich Eck, Denis Kalkofen, Philipp Steininger, Nassir Navab, Markus Tatzgern

TL;DR

This paper compares two XR visualization techniques to reduce perceived latency between user input and robot activation and identifies a gap in modeling human behavior in the analytic XRP validation framework.

Abstract

Researching novel user experiences in medicine is challenging due to limited access to equipment and strict ethical protocols. Extended Reality (XR) simulation technologies offer a cost- and time-efficient solution for developing interactive systems. Recent work has shown Extended Reality Prototyping (XRP)'s potential, but its applicability to specific domains like controlling complex machinery needs further exploration. This paper explores the benefits and limitations of XRP in controlling a mobile medical imaging robot. We compare two XR visualization techniques to reduce perceived latency between user input and robot activation. Our XRP validation study demonstrates its potential for comparative studies, but identifies a gap in modeling human behavior in the analytic XRP validation framework.

XR Prototyping of Mixed Reality Visualizations: Compensating Interaction Latency for a Medical Imaging Robot

TL;DR

This paper compares two XR visualization techniques to reduce perceived latency between user input and robot activation and identifies a gap in modeling human behavior in the analytic XRP validation framework.

Abstract

Researching novel user experiences in medicine is challenging due to limited access to equipment and strict ethical protocols. Extended Reality (XR) simulation technologies offer a cost- and time-efficient solution for developing interactive systems. Recent work has shown Extended Reality Prototyping (XRP)'s potential, but its applicability to specific domains like controlling complex machinery needs further exploration. This paper explores the benefits and limitations of XRP in controlling a mobile medical imaging robot. We compare two XR visualization techniques to reduce perceived latency between user input and robot activation. Our XRP validation study demonstrates its potential for comparative studies, but identifies a gap in modeling human behavior in the analytic XRP validation framework.
Paper Structure (18 sections, 4 figures, 2 tables)

This paper contains 18 sections, 4 figures, 2 tables.

Table of Contents

  1. Introduction
  2. Related Work
  3. Extended Reality Prototyping
  4. Framworks supporting Evaluations
  5. Latency in Human-controlled Robotic Systems
  6. Mobile Imaging Robot
  7. Real Device
  8. Digital Version
  9. Mixed Reality Visualizations
  10. XR Prototyping of MR Visualization
  11. Study Design
  12. Simulation Fidelity
  13. Experiment
  14. Results
  15. Discussion
  16. ...and 3 more sections

Figures (4)

  • Figure 1: Apparatus. (Left) A sketch of the room setup with ring and surgical table. The line indicates a typical path of users steering the mobile robot to the target location at the table. (Middle) The room with a participant steering the mobile robot and holding the controller. (Right) A view of the MR laser augmentation that users had to align with the target location at the surgical table indicated by the augmented grey and green circle.
  • Figure 2: Measures of Task Completion Time (TCT, seconds), TLX and SUS for Visualization and Realism conditions. Lines indicate statistically significant differences.
  • Figure 3: Preference Ranking for both Realism conditions.
  • Figure 4: Box Plots for Overall Visualizaton and Realism Conditions (NASA TLX). Lines indicate statistically significant differences.