Abstract:3D data from high-resolution volumetric imaging is a central resource for diagnosis and treatment in modern medicine. While the fast development of AI enhances imaging and analysis, commonly used visualization methods lag far behind. Recent research used extended reality (XR) for perceiving 3D images with visual depth perception and touch but used restrictive haptic devices. While unrestricted touch benefits volumetric data examination, implementing natural haptic interaction with XR is challenging. The research question is whether a multisensory XR application with intuitive haptic interaction adds value and should be pursued. In a study, 24 experts for biomedical images in research and medicine explored 3D medical shapes with 3 applications: a multisensory virtual reality (VR) prototype using haptic gloves, a simple VR prototype using controllers, and a standard PC application. Results of standardized questionnaires showed no significant differences between all application types regarding usability and no significant difference between both VR applications regarding presence. Participants agreed to statements that VR visualizations provide better depth information, using the hands instead of controllers simplifies data exploration, the multisensory VR prototype allows intuitive data exploration, and it is beneficial over traditional data examination methods. While most participants mentioned manual interaction as best aspect, they also found it the most improvable. We conclude that a multisensory XR application with improved manual interaction adds value for volumetric biomedical data examination. We will proceed with our open-source research project ISH3DE (Intuitive Stereoptic Haptic 3D Data Exploration) to serve medical education, therapeutic decisions, surgery preparations, or research data analysis.

Xml-Based Representation Of Haptic Information

A human-in-the-loop haptic interaction with subjective evaluation

Optimized Design of A Haptic Unit for Vibrotactile Amplitude Modulation

Multisensory extended reality applications offer benefits for volumetric biomedical image analysis in research and medicine

New Advances for Haptic Rendering: State of the Art

Haptic Perception, Mechanics, and Material Technologies for Virtual Reality

Evaluation Patterns of Tele-Haptics

Haptic artificial muscle skin for extended reality

A Lightweight Haptic Interface for Hand-to-Object Tasks with Spatiotemporal Displays

Pseudo-Haptics Survey: Human-Computer Interaction in Extended Reality & Teleoperation

A Skin-Integrated Multimodal Haptic Interface for Immersive Tactile Feedback

Signal Processing for Haptic Surface Modeling: a Review

Play with Data: Using Haptic Properties of Artifacts to Augment Data Representation

Research on the Application of Multimodal Haptic Technology in the Interaction Design of Virtual Characters

Touch-enabled haptic modeling of deformable multi-resolution surfaces

Interactive Soft-Touch Dynamic Deformations

Cluster Haptic Texture Database: Haptic Texture Database with Variety in Velocity and Direction of Sliding Contacts

Development of an Integrated Haptic Sensor System for Multimodal Human–Computer Interaction Using Ultrasonic Array and Cable Robot

Highly Interpretable Representation for Multi-Dimensional Tactile Perception

Haptic Empathy: Conveying Emotional Meaning through Vibrotactile Feedback

Fully Addressable Textile Sensor Array for Self-Powered Haptic Interfacing