Shaping the Future of VR Hand Interactions: Lessons Learned from Modern Methods

TL;DR

VR hand interactions are often presumed to benefit from realism, but this work shows that higher visual/physical fidelity does not always improve usability. The authors implement and compare three methods—Attachment with Controller, Penetration with Tracking, and Torque-driven with Controller—across simple object relocation and precision tower-building tasks, evaluating 24 participants. They find Attachment excels in commercial-like usability due to its simplicity, while Penetration and Torque offer greater potential for next-gen interactions but face challenges in stability, fatigue, and force control. The study provides component-level analyses and practical design guidelines to balance realism, usability, and user satisfaction, and discusses limitations and directions for future work, including hardware diversity and multi-object scenarios.

Abstract

In virtual reality, it is widely assumed that increased realism in hand-object interactions enhances user immersion and overall experience. However, recent studies challenge this assumption, suggesting that faithfully replicating real-world physics and visuals is not always necessary for improved usability or immersion. This has led to ambiguity for developers when choosing optimal hand interaction methods for different applications. Currently, there is a lack of comprehensive research to resolve this issue. This study aims to fill this gap by evaluating three contemporary VR hand interaction methods-Attachment, Penetration, and Torque-across two distinct task scenarios: simple manipulation tasks and more complex, precision-driven tasks. By examining key technical features, we identify the strengths and limitations of each method and propose development guidelines for future advancements. Our findings reveal that while Attachment, with its simplified control mechanisms, is well-suited for commercial applications, Penetration and Torque show promise for next-generation interactions. The insights gained from our study provide practical guidance for developers and researchers seeking to balance realism, usability, and user satisfaction in VR environments.

Figures (7)

• Figure 1: The illustration of three contemporary VR hand interaction methods: (a) Attachment with Controller, (b) Penetration with Tracking, and (c) Torque-driven with Controller.
• Figure 2: Illustration of the relocation task: Participants rotate the object to identify a color-coded letter (R, G, or B) and then move the object to the corresponding colored box.
• Figure 3: SIM-TLX analysis results for object relocation task. The graph plots the mean and the standard deviation. Square brackets between groups within the same item indicate the results of the Wilcoxon signed-rank test ($*$ : p $<$ 0.05, $**$ : p $<$ 0.01).
• Figure 4: Result of SUS, IPQ, and NQ. The graph plots the mean and the standard deviation. Square brackets between groups within the same item indicate the results of the Wilcoxon signed-rank test ($*$: p $<$ 0.05, $**$ : p $<$ 0.01).
• Figure 5: Illustration of the tower-building task: Participants stack objects, and if the tower remains stable for five seconds, the scenario resets with objects repositioned, increasing the number of objects to stack with each success. This process repeats throughout the experiment.