Abstract:We propose and study a novel cross-reality environment that seamlessly integrates a monoscopic 2D surface (an interactive screen with touch and pen input) with a stereoscopic 3D space (an augmented reality HMD) to jointly host spatial data visualizations. This innovative approach combines the best of two conventional methods of displaying and manipulating spatial 3D data, enabling users to fluidly explore diverse visual forms using tailored interaction techniques. Providing such effective 3D data exploration techniques is pivotal for conveying its intricate spatial structures -- often at multiple spatial or semantic scales -- across various application domains and requiring diverse visual representations for effective visualization. To understand user reactions to our new environment, we began with an elicitation user study, in which we captured their responses and interactions. We observed that users adapted their interaction approaches based on perceived visual representations, with natural transitions in spatial awareness and actions while navigating across the physical surface. Our findings then informed the development of a design space for spatial data exploration in cross-reality. We thus developed cross-reality environments tailored to three distinct domains: for 3D molecular structure data, for 3D point cloud data, and for 3D anatomical data. In particular, we designed interaction techniques that account for the inherent features of interactions in both spaces, facilitating various forms of interaction, including mid-air gestures, touch interactions, pen interactions, and combinations thereof, to enhance the users' sense of presence and engagement. We assessed the usability of our environment with biologists, focusing on its use for domain research. In addition, we evaluated our interaction transition designs with virtual and mixed-reality experts to gather further insights.

Towards Context-Aware Adaptation in Extended Reality: A Design Space for XR Interfaces and an Adaptive Placement Strategy

SituationAdapt: Contextual UI Optimization in Mixed Reality with Situation Awareness via LLM Reasoning

Enhancing VR Shopping with Dynamic Space Re-Arrangements: Towards Contextualized Information Displays and Improved Locomotion

Context-Aware Online Adaptation of Mixed Reality Interfaces

Design of an XR Collab. Arch. for Mixed Immersive and MS Interaction

Towards Workplace Metaverse: A Human-Centered Approach for Designing and Evaluating XR Virtual Displays

SemanticAdapt: Optimization-based Adaptation of Mixed Reality Layouts Leveraging Virtual-Physical Semantic Connections

Extended Reality: Enhancing Human-Centered Capabilities for Human-Cyber-physical Systems (HCPS)

Real-Time Adaptation of Context-Aware Intelligent User Interfaces, for Enhanced Situational Awareness

Get-A-Sense: Designing Spatial Context Awareness for Mobile AR Environment Understanding

Extended-XRI Body Interfaces for Hyper-Connected Metaverse Environments

Mixed Reality UI Adaptations with Inaccurate and Incomplete Objectives

XR-Ed Framework: Designing Instruction-driven andLearner-centered Extended Reality Systems for Education

Towards Universal Interaction for Extended Reality

Knowledge-based approach to adaptive XR interface design for non-programmers

Towards Intelligent Augmented Reality (iAR): A Taxonomy of Context, an Architecture for iAR, and an Empirical Study

Working in Extended Reality in the Wild: Worker and Bystander Experiences of XR Virtual Displays in Real-World Settings

Context-Aware Based Mobile Augmented Reality Browser and its Optimization Design.

SpatialTouch: Exploring Spatial Data Visualizations in Cross-reality

Understanding Context to Capture when Reconstructing Meaningful Spaces for Remote Instruction and Connecting in XR

Design and User Experience Evaluation of 3D Product Information in XR Shopping Application.