ST2VR: An Interactive Authoring System for SpatioTemporal STorytelling in Virtual Reality with Hierarchical Narrative Structure

The increasing popularity of Virtual Reality (VR) has provided a new medium for narrating spatiotemporal data stories. Compared to traditional 2D environments, telling spatiotemporal stories in VR holds the promise of offering a more immersive and engaging experience for audiences. However, when creating VR spatiotemporal data stories, story creators may feel overwhelmed by the numerous narrative elements involved and there is a disconnect between the creation and viewing environments. To address these challenges, we designed a hierarchical narrative structure with three levels: Story Line, Story Piece, and Viewpoint. We then introduce ST²VR, an interactive authoring system that supports the creation of spatiotemporal data stories within an immersive environment. The system features two types of interactive interfaces to support the organization of the overall narrative as well as the immersive design of story details. A use case demonstrates the process of authoring VR spatiotemporal data stories using ST²VR, and a user study evaluates the system’s efficiency and effectiveness.