Abstract:We propose and study a novel cross-reality environment that seamlessly integrates a monoscopic 2D surface (an interactive screen with touch and pen input) with a stereoscopic 3D space (an augmented reality HMD) to jointly host spatial data visualizations. This innovative approach combines the best of two conventional methods of displaying and manipulating spatial 3D data, enabling users to fluidly explore diverse visual forms using tailored interaction techniques. Providing such effective 3D data exploration techniques is pivotal for conveying its intricate spatial structures -- often at multiple spatial or semantic scales -- across various application domains and requiring diverse visual representations for effective visualization. To understand user reactions to our new environment, we began with an elicitation user study, in which we captured their responses and interactions. We observed that users adapted their interaction approaches based on perceived visual representations, with natural transitions in spatial awareness and actions while navigating across the physical surface. Our findings then informed the development of a design space for spatial data exploration in cross-reality. We thus developed cross-reality environments tailored to three distinct domains: for 3D molecular structure data, for 3D point cloud data, and for 3D anatomical data. In particular, we designed interaction techniques that account for the inherent features of interactions in both spaces, facilitating various forms of interaction, including mid-air gestures, touch interactions, pen interactions, and combinations thereof, to enhance the users' sense of presence and engagement. We assessed the usability of our environment with biologists, focusing on its use for domain research. In addition, we evaluated our interaction transition designs with virtual and mixed-reality experts to gather further insights.

Using Virtual Reality Technique to Enhance Experience of Exploring 3D Trajectory Visualizations.

Hybrid-Dimensional Visualization and Interaction - Integrating 2D and 3D Visualization with Semi-Immersive Navigation Techniques

Web-based virtual walkthrough of panoramas

3DStoryline: Immersive Visual Storytelling

Immersive and Collaborative Data Visualization Using Virtual Reality Platforms

3D Gaze Vis: Sharing Eye Tracking Data Visualization for Collaborative Work in VR Environment

Variable-Based Spatiotemporal Trajectory Data Visualization Illustrated

SpatialTouch: Exploring Spatial Data Visualizations in Cross-reality

Designing Spatial Visualization and Interactions of Immersive Sankey Diagram in Virtual Reality

ReViVD: Exploration and Filtering of Trajectories in an Immersive Environment using 3D Shapes

ShuttleSpace: Exploring and Analyzing Movement Trajectory in Immersive Visualization

3D visual art design method based on virtual reality

Towards Advancing Reservoir Model Analysis with Virtual Reality

Immersive and Interactive 3D Visualization of Large-Scale Geo-Scientific Data

Design of Interactive Landscape Virtual Tour System Based on 3D Virtual Reality Technology

Evaluating 3D User Interaction Techniques on Spatial Working Memory for 3D Scatter Plot Exploration in Immersive Analytics

UrbanVR: An immersive analytics system for context-aware urban design

TripVista: Triple Perspective Visual Trajectory Analytics and Its Application on Microscopic Traffic Data at a Road Intersection

Outstanding: A Multi-Perspective Travel Approach for Virtual Reality Games

Improving Big Data Visual Analytics with Interactive Virtual Reality

CompositingVis: Exploring Interactions for Creating Composite Visualizations in Immersive Environments