Abstract:We propose and study a novel cross-reality environment that seamlessly integrates a monoscopic 2D surface (an interactive screen with touch and pen input) with a stereoscopic 3D space (an augmented reality HMD) to jointly host spatial data visualizations. This innovative approach combines the best of two conventional methods of displaying and manipulating spatial 3D data, enabling users to fluidly explore diverse visual forms using tailored interaction techniques. Providing such effective 3D data exploration techniques is pivotal for conveying its intricate spatial structures -- often at multiple spatial or semantic scales -- across various application domains and requiring diverse visual representations for effective visualization. To understand user reactions to our new environment, we began with an elicitation user study, in which we captured their responses and interactions. We observed that users adapted their interaction approaches based on perceived visual representations, with natural transitions in spatial awareness and actions while navigating across the physical surface. Our findings then informed the development of a design space for spatial data exploration in cross-reality. We thus developed cross-reality environments tailored to three distinct domains: for 3D molecular structure data, for 3D point cloud data, and for 3D anatomical data. In particular, we designed interaction techniques that account for the inherent features of interactions in both spaces, facilitating various forms of interaction, including mid-air gestures, touch interactions, pen interactions, and combinations thereof, to enhance the users' sense of presence and engagement. We assessed the usability of our environment with biologists, focusing on its use for domain research. In addition, we evaluated our interaction transition designs with virtual and mixed-reality experts to gather further insights.

TangibleChannel: An Innovative Data Physicalization System for Visual Channel Education

Tangible Light: Back to Metaphor-Based Interaction

A Comparative Study of Table Sized Physicalization and Digital Visualization

Making Data Tangible: A Cross-disciplinary Design Space for Data Physicalization

Investigating the Use of a Dynamic Physical Bar Chart for Data Exploration and Presentation

Touching the Ground: Evaluating the Effectiveness of Data Physicalizations for Spatial Data Analysis Tasks

Cultivating Visualization Literacy for Children Through Curiosity and Play

Navigable videos for presenting scientific data on head-mounted displays

A Design Vocabulary for Data Physicalization

Using network visualizations to engage elementary students in locally relevant data literacy

CompositingVis: Exploring Interactions for Creating Composite Visualizations in Immersive Environments

Encoding Variables, Evaluation Criteria and Evaluation Methods for Data Physicalizations: A Review

Ocean Data Visualization on a Touchtable Demonstrates Group Content Learning, Science Practices Use, and Potential Embodied Cognition

Tangible Web: An Interactive Immersion Virtual RealityCreativity System that Travels Across Reality

Python Based Data Visualization and Configurable Teaching System Design and Implementation

Data to Physicalization: A Survey of the Physical Rendering Process

TangibleData: Interactive Data Visualization with Mid-Air Haptics

A Tangible Multi-Display Toolkit to Support the Collaborative Design Exploration of AV-Pedestrian Interfaces

A User-centered Design Study in Scientific Visualization Targeting Domain Experts

Revealing Interaction Dynamics: Multi-Level Visual Exploration of User Strategies with an Interactive Digital Environment

SpatialTouch: Exploring Spatial Data Visualizations in Cross-reality