Analysis of Locally Coupled 3D Manipulation Mappings Based on Mobile Device Motion

TL;DR

This paper addresses 3D manipulation on mobile devices by formalizing the mappings from device motion to on-screen object motion in a locally-coupled setup. It develops a unified notation for absolute/relative and rate/zero-order control, introduces a dynamic gain factor $k_t$, and analyzes key spatial compliances (directional, transitivity, allocentric vs egocentric) to guide design decisions. The work also investigates the motion-space limitations inherent to handheld manipulation and proposes solutions such as rate control, clutching, and dynamic gain strategies, supported by theoretical analysis and an exploratory study on user preferences for allocentric vs egocentric mappings. The framework facilitates design choices for mobile 3D manipulation techniques and points to future work including implicit gain control methods and further empirical validation. The findings have practical impact for developers building 3D applications on mobile devices by providing a principled basis for selecting mappings and gain strategies that balance usability, precision, and motion-space constraints.

Abstract

We examine a class of techniques for 3D object manipulation on mobile devices, in which the device's physical motion is applied to 3D objects displayed on the device itself. This "local coupling" between input and display creates specific challenges compared to manipulation techniques designed for monitor-based or immersive virtual environments. Our work focuses specifically on the mapping between device motion and object motion. We review existing manipulation techniques and introduce a formal description of the main mappings under a common notation. Based on this notation, we analyze these mappings and their properties in order to answer crucial usability questions. We first investigate how the 3D objects should move on the screen, since the screen also moves with the mobile device during manipulation. We then investigate the effects of a limited range of manipulation and present a number of solutions to overcome this constraint. This work provides a theoretical framework to better understand the properties of locally-coupled 3D manipulation mappings based on mobile device motion.

Figures (8)

• Figure 1: Using the motion of a mobile device to translate and rotate a 3D object displayed on the device itself (locally coupled manipulation). This is illustrated here on different types of mobile devices. In this paper, we specifically focus on the mapping between device motion and object motion.
• Figure 2: Directly applying the measured device translation $v$ to the manipulated object would move it in unexpected directions, depending on the device orientation $qc_i$ in tracker space. To get a more predictable behavior, the vector $v$ should be rotated by the inverse rotation $qc_i^{-1}$, producing the correct translation $v'$. The same process is applied to rotations.
• Figure 3: Three main ways to map mobile device motion to a 3D object's motion, shown for a tablet. Absolute position control: the device displacement from its initial location is applied to the object. Relative position control: the incremental device displacement is applied to the object. Rate control: the device displacement from its initial location controls the object's velocity.
• Figure 4: Directional compliance versus non-compliance, shown here on a tablet-shaped device.
• Figure 5: Transitivity versus non-transitivity (illustrating here the specific case of nulling compliance).