Abstract:Background: Visualising patient genomic data in a cohort with embedding data analytics models can provide relevant and sensible patient comparisons to assist a clinician with treatment decisions. As immersive technology is actively used around the medical world, there is a rising demand for an efficient environment that can effectively display genomic data visualisations on immersive devices such as a Virtual Reality (VR) environment. The VR technology will allow clinicians, biologists, and computer scientists to explore a cohort of individual patients within the 3D environment. However, demonstrating the feasibility of the VR prototype needs domain users' feedback for future user-centred design and a better cognitive model of human-computer interactions. There is limited research work for collecting and integrating domain knowledge into the prototype design. Objective: A usability study for the VR prototype--Virtual Reality to Observe Oncology data Models (VROOM) was implemented. VROOM was designed based on a preliminary study among medical users. The goals of this usability study included establishing a baseline of user experience, validating user performance measures, and identifying potential design improvements that are to be addressed to improve efficiency, functionality, and end-user satisfaction. Methods: The study was conducted with a group of domain users (10 males, 10 females) with portable VR devices and camera equipment. These domain users included medical users such as clinicians and genetic scientists and computing domain users such as bioinformatics and data analysts. Users were asked to complete routine tasks based on a clinical scenario. Sessions were recorded and analysed to identify potential areas for improvement to the data visual analytics projects in the VR environment. The one-hour usability study included learning VR interaction gestures, running visual analytics tool, and collecting before and after feedback. The feedback was analysed with different methods to measure effectiveness. The statistical method Mann-Whitney U test was used to analyse various task performances among the different participant groups, and multiple data visualisations were created to find insights from questionnaire answers. Results: The usability study investigated the feasibility of using VR for genomic data analysis in domain users' daily work. From the feedback, 65% of the participants, especially clinicians (75% of them), indicated that the VR prototype is potentially helpful for domain users' daily work but needed more flexibility, such as allowing them to define their features for machine learning part, adding new patient data, and importing their datasets in a better way. We calculated the engaged time for each task and compared them among different user groups. Computing domain users spent 50% more time exploring the algorithms and datasets than medical domain users. Additionally, the medical domain users engaged in the data visual analytics parts (approximately 20%) longer than the computing domain users.

Assessment of resectability of pancreatic cancer using novel immersive high-performance virtual reality rendering of abdominal computed tomography and magnetic resonance imaging

Augmented Reality-Assisted Pancreaticoduodenectomy with Superior Mesenteric Vein Resection and Reconstruction.

Augmented reality-guided artery-first pancreatico-duodenectomy

IMHOTEP: cross-professional evaluation of a three-dimensional virtual reality system for interactive surgical operation planning, tumor board discussion and immersive training for complex liver surgery in a head-mounted display

Virtual Reality for Surgical Planning – Evaluation Based on Two Liver Tumor Resections

Virtual Reality as an Adjunct to Traditional Patient Counseling in Patients With Newly Diagnosed Localized Prostate Cancer

Virtual Reality for Interactive Medical Analysis.

Virtual reality and 3D printing improve preoperative visualization of 3D liver reconstructions—results from a preclinical comparison of presentation modalities and user’s preference

An analysis of virtual reality in abdominal surgery—A scoping review

Virtual Reality Head-Mounted Display (HMD) and Preoperative Patient-Specific Simulation: Impact on Decision-Making in Pediatric Urology: Preliminary Data

Preoperative planning of cranial base tumor in virtual reality environment

Comparing a virtual reality head-mounted display to on-screen three-dimensional visualization and two-dimensional computed tomography data for training in decision making in hepatic surgery: a randomized controlled study

Beyond the visible: preliminary evaluation of the first wearable augmented reality assistance system for pancreatic surgery

Understanding cancer patient cohorts in virtual reality environment for better clinical decisions: a usability study

Virtual reality-based surgical planning simulator for tumorous resection in FreeForm Modeling: an illustrative case of clinical teaching

Developing a Virtual Reality Simulation System for Preoperative Planning of Robotic-Assisted Thoracic Surgery

Virtual reality of three-dimensional surgical field for surgical planning and intraoperative management

3D virtual models and augmented reality for radical prostatectomy: a narrative review

Workflow assessment of an augmented reality application for planning of perforator flaps in plastic reconstructive surgery: Game or game changer?

Feasibility, Accuracy, and Reproducibility of Aortic Valve Sizing for Transcatheter Aortic Valve Implantation Using Virtual Reality

The use of mixed reality in the preoperative planning of colorectal surgery: Preliminary experience with a narrative review