Abstract:We propose and study a novel cross-reality environment that seamlessly integrates a monoscopic 2D surface (an interactive screen with touch and pen input) with a stereoscopic 3D space (an augmented reality HMD) to jointly host spatial data visualizations. This innovative approach combines the best of two conventional methods of displaying and manipulating spatial 3D data, enabling users to fluidly explore diverse visual forms using tailored interaction techniques. Providing such effective 3D data exploration techniques is pivotal for conveying its intricate spatial structures -- often at multiple spatial or semantic scales -- across various application domains and requiring diverse visual representations for effective visualization. To understand user reactions to our new environment, we began with an elicitation user study, in which we captured their responses and interactions. We observed that users adapted their interaction approaches based on perceived visual representations, with natural transitions in spatial awareness and actions while navigating across the physical surface. Our findings then informed the development of a design space for spatial data exploration in cross-reality. We thus developed cross-reality environments tailored to three distinct domains: for 3D molecular structure data, for 3D point cloud data, and for 3D anatomical data. In particular, we designed interaction techniques that account for the inherent features of interactions in both spaces, facilitating various forms of interaction, including mid-air gestures, touch interactions, pen interactions, and combinations thereof, to enhance the users' sense of presence and engagement. We assessed the usability of our environment with biologists, focusing on its use for domain research. In addition, we evaluated our interaction transition designs with virtual and mixed-reality experts to gather further insights.

An Immersive Visual Analytics Platform for Multidimensional Dataset

Immersive and Collaborative Data Visualization Using Virtual Reality Platforms

Hybrid-Dimensional Visualization and Interaction - Integrating 2D and 3D Visualization with Semi-Immersive Navigation Techniques

Improving Big Data Visual Analytics with Interactive Virtual Reality

Immersive Insights: A Hybrid Analytics System for Collaborative Exploratory Data Analysis

Virtual Reality and Immersive Collaborative Environments: the New Frontier for Big Data Visualisation

Exploring the Design Space of Immersive Urban Analytics.

Immersive and Interactive 3D Visualization of Large-Scale Geo-Scientific Data

Interactive Multi-User 3D Visual Analytics in Augmented Reality

XR-based Interactive Visualization Platform for Real-time Exploring Dynamic Earth Science Data

I Did Not Notice: A Comparison of Immersive Analytics with Augmented and Virtual Reality

SpatialTouch: Exploring Spatial Data Visualizations in Cross-reality

Analyzing User Behaviour Patterns in a Cross-Virtuality Immersive Analytics System

A Visual Analytics Framework from Geological Modeling to Reservoir Simulation

A virtual reality data visualization tool for dimensionality reduction methods

DarkSky Halos: Use-Based Exploration of Dark Matter Formation Data in a Hybrid Immersive Virtual Environment

UrbanVR: An immersive analytics system for context-aware urban design

Designing Spatial Visualization and Interactions of Immersive Sankey Diagram in Virtual Reality

Shared Surfaces and Spaces: Collaborative Data Visualisation in a Co-located Immersive Environment

Immersive Projection Technology for Visual Data Mining

Interactive Extended Reality Techniques in Information Visualization