3DStoryline: Immersive Visual Storytelling

TL;DR

This paper investigates immersive 3D storyline visualization in virtual reality to address the limitations of traditional 2D storyline representations. It derives design considerations from a preliminary study and presents 3DStoryline, a VR tool that supports two narrative perspectives (Events-Centered and Characters-Centered) with overview/detail modes, spatial-temporal encodings, and interactive controls. A Loki-based dataset and a formal user study demonstrate high usability, engagement, and improved comprehension of complex narratives, validating the approach and highlighting areas for enhancement such as transitions, multimodal interactions, and comparative evaluation with 2D methods. The work offers design guidelines and a functional prototype that advance immersive storytelling, with potential impact on education, media, and narrative-driven data exploration in VR.

Abstract

Storyline visualization has emerged as an innovative method for illustrating the development and changes in stories across various domains. Traditional approaches typically represent stories with one line per character, progressing from left to right. While effective for simpler narratives, this method faces significant challenges when dealing with complex stories involving multiple characters, as well as temporal and spatial dynamics. In this study, we investigate the potential of immersive environments for enhancing storyline visualizations. We begin by summarizing the key design considerations for effective storyline visualization in virtual reality (VR). Guided by these principles, we develop 3DStoryline, a system that allows users to view and interact with 3D immersive storyline visualizations. To evaluate the effectiveness of 3DStoryline, we conduct a task-based user study, revealing that the system significantly enhances users' comprehension of complex narratives.

Figures (6)

• Figure 1: The narrative perspectives. The vertical upward direction encodes time while the horizontal surface represents the geographical map.
• Figure 2: The method for optimizing storyline layout along the time axis involves three steps: (a) adjusting the coordinates of bounding spheres to ensure a consistent distance $\Delta_e$ between them, (b) updating the positions of 3D points within each bounding sphere, and (c) fine-tuning the 3D points inside each sphere to maintain a uniform distance $\Delta_c$ between them.
• Figure 3: Result of storyline layout optimization along time axis: (a) Characters-Centered Perspective and (b) Events-Centered Perspective.
• Figure 4: Geo-map layout in (a) Overview and (b) Detail.
• Figure 5: The geometric mean scores of user satisfaction with ease, time, and supporting information from ASQ. Error bars show 95% confidence intervals.