User-Centric Evaluation Methods for Digital Twin Applications in Extended Reality

TL;DR

Addresses the lack of standardized user centered evaluation methods for XR enhanced Digital Twins. Proposes a two cycle MVP based evaluation approach combining on field AR and VR and desktop experiments across six use cases, with a suite of standardized UX instruments (ATI IPQ NASA-TLX SAM UEQ-S CSQ-VR) and custom items. Seeks to produce actionable UX metrics for usability cognitive load and immersion, guiding iterative development and helping establish industry benchmarks. Plans to validate with 40+ users across two cities to refine measurement tools and inform DT XR design and AI component improvements.

Abstract

The integration of Digital Twins with Extended Reality technologies, such as Virtual Reality and Augmented Reality, is transforming industries by enabling more immersive, interactive experiences and enhancing real time decision making. User centered evaluations are crucial for aligning XR enhanced DT systems with user expectations, enhancing acceptance and utility in real world settings. This paper proposes a user centric evaluation method for XR enhanced DT applications to assess usability, cognitive load, and user experience. By employing a range of assessment tools, including questionnaires and observational studies across various use cases, such as virtual tourism, city planning, and industrial maintenance, this method provides a structured approach to capturing the users perspective.

Figures (2)

• Figure 1: Screenshot of the MVP for the City Planning use case that shows a POI (church) together with the weather UI.
• Figure 2: Screenshot of the MVP for the AR Virtual Tourism use case that shows an open portal in front of a POI (museum).