Abstract:Background and objective: Medical image visualization is an essential tool for conveying anatomical information. Ray-casting-based volume rendering is commonly used for generating visualizations of raw medical images. However, exposing a target area inside the skin often requires manual tuning of transfer functions or segmentation of original images, as preset parameters in volume rendering may not work well for arbitrary scanned data. This process is tedious and unnatural. To address this issue, we propose a volume visualization system that enhances the view inside the skin, enabling flexible exploration of medical volumetric data using virtual reality. Methods: In our proposed system, we design a virtual reality interface that allows users to walk inside the data. We introduce a view-dependent occlusion weakening method based on geodesic distance transform to support this interaction. By combining these methods, we develop a virtual reality system with intuitive interactions, facilitating online view enhancement for medical data exploration and annotation inside the volume. Results: Our rendering results demonstrate that the proposed occlusion weakening method effectively weakens obstacles while preserving the target area. Furthermore, comparative analysis with other alternative solutions highlights the advantages of our method in virtual reality. We conducted user studies to evaluate our system, including area annotation and line drawing tasks. The results showed that our method with enhanced views achieved 47.73% and 35.29% higher accuracy compared to the group with traditional volume rendering. Additionally, subjective feedback from medical experts further supported the effectiveness of the designed interactions in virtual reality. Conclusions: We successfully address the occlusion problems in the exploration of medical volumetric data within a virtual reality environment. Our system allows for flexible integration of scanned medical volumes without requiring extensive manual preprocessing. The results of our user studies demonstrate the feasibility and effectiveness of walk-in interaction for medical data exploration.

Towards Developing an Immersive and Interactive Virtual Fairview Peri-operative Environment.

Virtual Learning Environment for Medical Education Based on VRML and VTK

Immersive Anatomical Scenes that Enable Multiple Users to Occupy the Same Virtual Space: A Tool for Surgical Planning and Education

An Approach to Solid Modeling in a Semi-Immersive Virtual Environment.

Virtual reality for synergistic surgical training and data generation

Virtual Reality for Interactive Medical Analysis.

Toward Immersive and Interactive Surgical Training Using Extended Reality Simulator for IoMT

Fully Immersive Virtual Reality for Skull-base Surgery: Surgical Training and Beyond

The user experience design of a novel microscope within SurgiSim, a virtual reality surgical simulator

Advanced liver surgery training in collaborative VR environments

Development of a Machine Learning-Enabled Virtual Reality Tool for Preoperative Planning of Functional Endoscopic Sinus Surgery

A Simulation and Training Systems of Robot Assisted Surgery Based on Virtual Reality.

A Simulation & Training System of Robot Assisted Surgery Based on Virtual Reality

Online view enhancement for exploration inside medical volumetric data using virtual reality

Immersive teaching using virtual reality technology to improve ophthalmic surgical skills for medical postgraduate students

Virtual Reality for Immersive Education in Orthopedic Surgery Digital Twins

Fusion mixed reality: a novel approach to merge the physical and virtual cath lab

Developing a Virtual Reality Simulation System for Preoperative Planning of Robotic-Assisted Thoracic Surgery

Virtual reality applications in pediatric surgery

Virtual reality-based surgical planning simulator for tumorous resection in FreeForm Modeling: an illustrative case of clinical teaching

Design and Development of Virtual Medical System Interface Based on VR-AR Hybrid Technology