[Anatomical and technical bases of microsurgical repair of blood vessels and nerves].

J. Comtet

Abstract:

What problem does this paper attempt to address?

Simulating Developmental Cardiac Morphology in Virtual Reality Using a Deformable Image Registration Approach

Arash Abiri,Yichen Ding,Parinaz Abiri,René R. Sevag Packard,Vijay Vedula,Alison Marsden,C.-C. Jay Kuo,Tzung K. Hsiai

DOI: https://doi.org/10.1007/s10439-018-02113-z

IF: 3.8

2018-01-01

Annals of Biomedical Engineering

Abstract:While virtual reality (VR) has potential in enhancing cardiovascular diagnosis and treatment, prerequisite labor-intensive image segmentation remains an obstacle for seamlessly simulating 4-dimensional (4-D, 3-D + time) imaging data in an immersive, physiological VR environment. We applied deformable image registration (DIR) in conjunction with 3-D reconstruction and VR implementation to recapitulate developmental cardiac contractile function from light-sheet fluorescence microscopy (LSFM). This method addressed inconsistencies that would arise from independent segmentations of time-dependent data, thereby enabling the creation of a VR environment that fluently simulates cardiac morphological changes. By analyzing myocardial deformation at high spatiotemporal resolution, we interfaced quantitative computations with 4-D VR. We demonstrated that our LSFM-captured images, followed by DIR, yielded average dice similarity coefficients of 0.92 ± 0.05 (n = 510) and 0.93 ± 0.06 (n = 240) when compared to ground truth images obtained from Otsu thresholding and manual segmentation, respectively. The resulting VR environment simulates a wide-angle zoomed-in view of motion in live embryonic zebrafish hearts, in which the cardiac chambers are undergoing structural deformation throughout the cardiac cycle. Thus, this technique allows for an interactive micro-scale VR visualization of developmental cardiac morphology to enable high resolution simulation for both basic and clinical science.
Virtual Reality–based Methods for Training Novice Electrophysiology Trainees—A Pilot Study

Benjamin Gorbaty,Susana Arango,David Buyck,Ryan C. James,Samantha T. Porter,Paul Iaizzo,Tjörvi E. Perry,Stephen Seslar,BENJAMIN GORBATY,SUSANA ARANGO,DAVID BUYCK,RYAN JAMES,SAMANTHA PORTER,PAUL IAIZZO,TJÖRVI PERRY,STEPHEN SESLAR

DOI: https://doi.org/10.19102/icrm.2023.14091

2023-09-01

Journal of Innovations in Cardiac Rhythm Management

Abstract:Developing an accurate and detailed 3-dimensional (3D) mental model of cardiac anatomy is critical for electrophysiology (EP) trainees. Due to its immersive nature, virtual reality (VR) may provide a better learning environment than traditional teaching methods for assimilating 3D cardiac anatomy. The purpose of this pilot study was to evaluate the technical feasibility of an interactive, remote VR-based method for teaching cardiac anatomy to novice EP trainees. We created a shared, remote VR environment that allows the shared viewing of high-resolution 3D cardiac models. Eighteen trainees accepted for pediatric and adult EP fellowships were recruited. We performed a cohort study comparing the traditional teaching methods with the VR learning environment. Participants completed a demographic questionnaire and a satisfaction survey. The adult EP trainees were given a multiple-choice pre- and post-test exam to assess their anatomical knowledge. Both the adult and pediatric EP trainee cohorts rated the VR experience positively and preferred the VR environment to the more traditional teaching method. All the participants expressed interest in incorporating the VR learning environment into the EP fellowship curriculum. The usability of the system was relatively low, with approximately one-third of participants rating the system as hard to use. The impact of the VR session on exam performance was mixed among the adult cohort. We demonstrated the feasibility of gathering geographically dispersed EP fellows in training with a shared VR-based environment to teach cardiac anatomy. Although we were not able to demonstrate a learning benefit over the traditional lecture format in the adult cohort, the training environment was favorably received by all the participants.
Virtual reality and cardiac anatomy: Exploring immersive three‐dimensional cardiac imaging, a pilot study in undergraduate medical anatomy education

H. S. Maresky,A. Oikonomou,I. Ali,N. Ditkofsky,M. Pakkal,B. Ballyk

DOI: https://doi.org/10.1002/ca.23292

2018-10-31

Clinical Anatomy

Abstract:<div class="abstract-group"> <section class="article-section article-section__abstract" lang="en" data-lang="en" id="section-1-en"> <h3 class="article-section__header main abstractlang_en main">Abstract</h3> <div class="article-section__content en main"> <div class="article-section__content" id="ca23292-sec-0001"> <h3 class="article-section__sub-title section1"> INTRODUCTION</h3> <p>Cardiac anatomy can be challenging to grasp due to its complex three‐dimensional nature and remains one of the most challenging topics to teach. In light of some exciting technological advances in the field of virtual reality (VR), we sought to test the viability and the assess efficacy of this computer‐generated model for the purposes of teaching cardiac anatomy.</p>

anatomy & morphology
Immersive XR Anatomy Teaching Tools: Review of four custom‐built virtual spaces, their deployments and educational value

Kristen Ramirez,Greg Dorsainville,Jillian Lieber,Kira Melamud,Andrew Clayburn,Victoria Harnik,Michael Poles,So‐Young Oh

DOI: https://doi.org/10.1096/fasebj.2022.36.s1.r4156

2022-05-01

The FASEB Journal

Abstract:Use of digital anatomical teaching resources mitigate trends of decreased anatomy contact hours, elimination of cadaveric specimens or student‐led dissections of them, remote or hybrid learning in response to COVID‐19, and to integrate anatomy content with radiology, surgery and other clinical applications. While there are a plethora of atlases built with cadaveric images, radiology, and artist‐rendered 3D models, we often find a disconnect between the complex geometry of many anatomical structures and the 2D screen interfaces used by students to access these digital resources. The open‐source Mozilla Hubs platform allows for the creation of customizable 3D virtual spaces, accessible via URL on a mobile, desktop, or virtual reality (VR) device. This platform was used to create four educational experiences deployed to first and second year medical students during pre‐clerkship courses: a desktop‐based tour of the surface and chambers of the heart; a VR tour of the chambers of the heart; a desktop‐based foregut escape room integrated with questions and multimedia clinical supplements; and a VR tour of the structure and neurovasculature of the pterygopalatine fossa. In each experience, the students are immersed within these anatomical spaces, encouraged to explore and appreciate the spatial relationships and orientations of key internal structures. When applicable, radiological imaging, videos, and animations display physiologic processes, the flow of blood and other fluids, and the functionality of a given structure in vivo. Audio and text instructions, labels, and additional information guide student learning, encouraging directed exploration while immersed in the experience. This presentation will discuss the four experiences, display real‐time video capture of the interactions and spaces, their deployment, educational value, and student reception. Students’ feedback suggests that the context and timing of the deployment of these experiences is crucial for student learning and appreciation, including the role of faculty assistance and training on how to navigate the interface prior to the educational intervention. Qualitative feedback and performance on pre‐ and post‐ experience quizzes show that these experiences are both statistically and perceptually valuable educational resources, and that the novel nature of this experience is engaging and exciting to students when deployed appropriately. This presentation will conclude with suggestions for best practices in choosing, developing, and deploying custom immersive educational interventions to anatomy learners.

cell biology,biochemistry & molecular biology,biology
[Elementary neurophysiological mechanisms of learning].

L. Voronin

Успехи физиологических наук

Abstract:
Integrating 4-D light-sheet imaging with interactive virtual reality to recapitulate developmental cardiac mechanics and physiology

Yichen Ding,Jing Yu,Arash Abiri,Parinaz Abiri,Juhyun Lee,Chih-Chiang Chang,Kyung In Baek,Rene R. Sevag Packard,Tzung K. Hsiai

DOI: https://doi.org/10.1117/12.2286296

2018-01-01

Abstract:There currently is a limited ability to interactively study developmental cardiac mechanics and physiology. We therefore combined light-sheet fluorescence microscopy (LSFM) with virtual reality (VR) to provide a hybrid platform for 3dimensional (3-D) architecture and time-dependent cardiac contractile function characterization. By taking advantage of the rapid acquisition, high axial resolution, low phototoxicity, and high fidelity in 3-D and 4-D (3-D spatial + 1-D time or spectra), this VR-LSFM hybrid methodology enables interactive visualization and quantification otherwise not available by conventional methods such as routine optical microscopes. We hereby demonstrate multi-scale applicability of VR-LSFM to 1) interrogate skin fibroblasts interacting with a hyaluronic acid-based hydrogel, 2) navigate through the endocardial trabecular network during zebrafish development, and 3) localize gene therapy-mediated potassium channel expression in adult murine hearts. We further combined our batch intensity normalized segmentation (BINS) algorithm with deformable image registration (DIR) to interface a VR environment for the analysis of cardiac contraction. Thus, the VR-LSFM hybrid platform demonstrates an efficient and robust framework for creating a user-directed micro-environment in which we uncovered developmental cardiac mechanics and physiology with high spatiotemporal resolution.
A new dynamic 3D virtual methodology for teaching the mechanics of atrial septation as seen in the human heart

Jean‐Marc Schleich,Jean‐Louis Dillenseger,Lucile Houyel,Claude Almange,Robert H. Anderson,Jean-Marc Schleich,Jean-Louis Dillenseger

DOI: https://doi.org/10.1002/ase.74

2009-03-01

Anatomical Sciences Education

Abstract:Learning embryology remains difficult, since it requires understanding of many complex phenomena. The temporal evolution of developmental events has classically been illustrated using cartoons, which create difficulty in linking spatial and temporal aspects, such correlation being the keystone of descriptive embryology. We synthesized the bibliographic data from recent studies of atrial septal development. On the basis of this synthesis, consensus on the stages of atrial septation as seen in the human heart has been reached by a group of experts in cardiac embryology and pediatric cardiology. This has permitted the preparation of three-dimensional (3D) computer graphic objects for the anatomical components involved in the different stages of normal human atrial septation. We have provided a virtual guide to the process of normal atrial septation, the animation providing an appreciation of the temporal and morphologic events necessary to separate the systemic and pulmonary venous returns. We have shown that our animations of normal human atrial septation increase significantly the teaching of the complex developmental processes involved, and provide a new dynamic for the process of learning.

education, scientific disciplines
Virtual Learning Environment for Medical Education Based on VRML and VTK

JF Lu,ZG Pan,H Lin,MM Zhang,JY Shi

DOI: https://doi.org/10.1016/j.cag.2004.12.015

IF: 1.821

2005-01-01

Computers & Graphics

Abstract:Virtual reality (VR) is being applied to a wide range of medical areas, including medical education/training, surgery and diagnostics assistance. In the medical education field, VR opens new realms in the teaching of medicine and creates new effective learning procedures for the students. In contrast with the expensive immersive virtual reality learning environment (VRLE) such as CAVE, ImmersaDesk, virtual reality modeling language (VRML) technology provides a cheap and simple way to create such an environment and can be easily deployed in the classroom. In this paper, we describe some traditional application of VR in medical education and design a prototype of VRLE system based on VRML and visualization toolkit (VTK). The system architecture and module design are described in detail and some results are presented.
Fetal heart segmentation in a virtual reality environment

DOI: https://doi.org/10.1007/s10554-024-03157-0

2024-06-05

The International Journal of Cardiovascular Imaging

Abstract:This study presents the initial results of a pilot project using the Elucis Virtual Reality (VR) platform for fetal heart segmentation. Twelve fetal heart cases, ranging in gestational age from 24 to 30 weeks, including various cardiac conditions, were reconstructed using 3D models facilitated by the Elucis platform's integration of automated algorithms and manual adjustments. The models, which were evaluated by four experts in virtual and 3D printed formats, were of high quality and offered improved visuospatial visualization and detailed anatomical insights. This research highlights the potential of VR technology to improve prenatal diagnosis and planning for complex cardiac conditions, suggesting significant implications for continuing medical education and clinical practice in fetal cardiology.

radiology, nuclear medicine & medical imaging,cardiac & cardiovascular systems
Interactive teaching of medical 3D cardiac anatomy: atrial anatomy enhanced by ECG and 3D visualization

Danila Potyagaylo,Peter M. van Dam,Marcin Kuniewicz,Damian Dolega-Dolegowski,Agnieszka Pregowska,Andrew Atkinson,Halina Dobrzynski,Klaudia Proniewska

DOI: https://doi.org/10.3389/fmed.2024.1422017

IF: 3.9

2024-07-04

Frontiers in Medicine

Abstract:The most commonly applied way of teaching students to convey the foundations of human anatomy and physiology involves textbooks and lectures. This way of transmitting knowledge causes difficulties for students, especially in the context of three-dimensional imaging of organ structures, and as a consequence translates into difficulties with imagining them. Even despite the rapid uptake of knowledge dissemination provided by online materials, including courses and webinars, there is a clear need for learning programs featuring first-hand immersive experiences tailored to suit individual study paces. In this paper, we present an approach to enhance a classical study program by combining multi-modality data and representing them in a Mixed Reality (MR)-based environment. The advantages of the proposed approach have been proven by the conducted investigation of the relationship between atrial anatomy, its electrophysiological characteristics, and resulting P wave morphology on the electrocardiogram (ECG). Another part of the paper focuses on the role of the sinoatrial node in ECG formation, while the MR-based visualization of combined micro-computed tomography (micro-CT) data with non-invasive CineECG imaging demonstrates the educational application of these advanced technologies for teaching cardiac anatomy and ECG correlations.

medicine, general & internal
Enhancing Medical Anatomy Education through Virtual Reality (VR): Design, Development, and Evaluation

Myint Zu Than,Kian Meng Yap

2024-11-08

Abstract:Modern medicine demands innovations in medical education, particularly in the learning of human anatomy, traditionally taught through textbooks, dissections, and lectures. Virtual Reality (VR) has emerged as a promising tool to address the limitations of these conventional methods by emphasising vision-based and active learning. However, current VR educational tools are often inaccessible due to high costs and specialised equipment requirements. This paper details the design and development of an accessible, desktop-based VR system aimed at enhancing anatomy education by leveraging the user's visual perception to promote a meaningful and interactive learning experience. The Virtual Anatomy Lab was designed to enable students to interact with a 3D Skull model to complete tasks virtually via an interactive user interface (UI) with the help of common devices like a mouse and keyboard. As part of the study, a group of medical students from prestigious medical schools throughout Malaysia were invited to evaluate the built system to offer feedback and determine its overall efficiency and usability in fulfilling their learning goals. The results and findings from user evaluations were then analysed to discuss its effectiveness and areas for future improvement.

Human-Computer Interaction
Integrating light-sheet imaging with virtual reality to recapitulate developmental cardiac mechanics.

Yichen Ding,Arash Abiri,Parinaz Abiri,Shuoran Li,Chih-Chiang Chang,Kyung In Baek,Jeffrey J Hsu,Elias Sideris,Yilei Li,Juhyun Lee,Tatiana Segura,Thao P Nguyen,Alexander Bui,René R Sevag Packard,Peng Fei,Tzung K Hsiai

DOI: https://doi.org/10.1172/jci.insight.97180

IF: 9.4958

2017-01-01

JCI Insight

Abstract:Currently, there is a limited ability to interactively study developmental cardiac mechanics and physiology. We therefore combined light-sheet fluorescence microscopy (LSFM) with virtual reality (VR) to provide a hybrid platform for 3D architecture and time-dependent cardiac contractile function characterization. By taking advantage of the rapid acquisition, high axial resolution, low phototoxicity, and high fidelity in 3D and 4D (3D spatial + 1D time or spectra), this VR-LSFM hybrid methodology enables interactive visualization and quantification otherwise not available by conventional methods, such as routine optical microscopes. We hereby demonstrate multiscale applicability of VR-LSFM to (a) interrogate skin fibroblasts interacting with a hyaluronic acid-based hydrogel, (b) navigate through the endocardial trabecular network during zebrafish development, and (c) localize gene therapy-mediated potassium channel expression in adult murine hearts. We further combined our batch intensity normalized segmentation algorithm with deformable image registration to interface a VR environment with imaging computation for the analysis of cardiac contraction. Thus, the VR-LSFM hybrid platform demonstrates an efficient and robust framework for creating a user-directed microenvironment in which we uncovered developmental cardiac mechanics and physiology with high spatiotemporal resolution.
Towards Anatomy Education with Generative AI-based Virtual Assistants in Immersive Virtual Reality Environments

Jicheng Li,Gavin Caulfield,Vuthea Chheang,D. Rajasekaran,Behdokht Kiafar,Megha Patel,Rommy Marquez-Hernandez,Shayla Sharmin,R. Barmaki

DOI: https://doi.org/10.1109/AIxVR59861.2024.00011

2023-06-29

Abstract:Virtual reality (VR) and interactive 3D visualization systems have enhanced educational experiences and environments, particularly in complicated subjects such as anatomy education. VR-based systems surpass the potential limitations of traditional training approaches in facilitating interactive engagement among students. However, research on embodied virtual assistants that leverage generative artificial intelligence (AI) and verbal communication in the anatomy education context is underrepresented. In this work, we introduce a VR environment with a generative AI-embodied virtual assistant to support participants in responding to varying cognitive complexity anatomy questions and enable verbal communication. We assessed the technical efficacy and usability of the proposed environment in a pilot user study with 16 participants. We conducted a within-subject design for virtual assistant configuration (avatar- and screen-based), with two levels of cognitive complexity (knowledge- and analysis-based). The results reveal a significant difference in the scores obtained from knowledge- and analysis-based questions in relation to avatar configuration. Moreover, results provide insights into usability, cognitive task load, and the sense of presence in the proposed virtual assistant configurations. Our environment and results of the pilot study offer potential benefits and future research directions beyond medical education, using generative AI and embodied virtual agents as customized virtual conversational assistants.

Computer Science,Education
EchoSim4D: A Proof-of-Concept Gamified XR Echocardiography Training Simulator for Neonates using 4D Ultrasound Volume

Deepthy Rose Jose,Venkataseshan Sundaram,M Manivannan

2024-12-09

Abstract:Neonatal echocardiography is vital for early detection of heart anomalies in newborns, enabling timely, non-invasive interventions where 4D ultrasound, adds the dimension of time to 3D imaging, enhances diagnostic capabilities by visualizing real-time heart dynamics. However, training for 4D neonatal echocardiography is limited by the lack of simulators that support 4D Ultrasound volume visualization within gamified environments. This paper introduces EchoSim4D, an XR-based simulator leveraging novel pipeline for visualizing 4D volume data in Unity, incorporating real-time volume reconstruction, and a preloaded version optimized for low-end systems. EchoSim4D integrates a sensor-equipped manikin and a custom 3D-printed transducer with a 6-DOF sensor, replicating the precise probe maneuvers necessary for neonatal echocardiography. In a validation study with postgraduate medical students (0-5 years of experience), supervised by a domain expert, EchoSim4D demonstrated high visual fidelity and training efficacy. Findings suggest that 4D visualization techniques hold significant potential for advancing medical training in neonatal echocardiography.

Human-Computer Interaction,Image and Video Processing
Virtual Reality for Interactive Medical Analysis.

Casey R. Koger,Sohail S. Hassan,Jie Yuan,Yichen Ding

DOI: https://doi.org/10.3389/frvir.2022.782854

2022-01-01

Frontiers in Virtual Reality

Abstract:Molecular imaging along with 3-dimensional (3-D) or 4-D (3-D spatial + 1-D temporal) visualization is widely used in clinical diagnosis and surgical planning. However, the pre-defined perspective and confined manipulation limit the in-depth exploration and analysis in 3-D/4-D. To overcome this obstacle, we utilized virtual reality (VR) to interact with CT images of the cardiopulmonary system in a 3-D immersive environment. We implemented manipulative functionalities into the VR environment that altered the cardiopulmonary models to interactively generate new data analysis perspectives. We successfully sliced a CT cardiac model showing in-depth surface visualizations of the ventricles and atria. Our customized framework enables enhanced data interpretation interactivity of CT images and establishes a user-directed manipulative VR platform derived from imaging results for remote medical practices including training, education, and investigation.
Enhancing medical anatomy education with the integration of virtual reality into traditional lab settings

Andres Neyem,Matías Cadile,Sebastián A. Burgos‐Martínez,Emilio Farfán Cabello,Oscar Inzunza,Macarena Soto Alvarado,R. Shane Tubbs,Nicolás E. Ottone

DOI: https://doi.org/10.1002/ca.24213

2024-09-09

Clinical Anatomy

Abstract:In medical education, traditional anatomy labs have relied heavily on the hands‐on dissection of cadavers to teach the complex spatial relationships within the human body. However, the advent of virtual reality (VR) technology offers the potential for significantly enhancing this traditional approach by providing immersive, interactive 3D visualizations that can overcome some of the limitations of physical specimens. This study explores the integration of VR into a traditional gross anatomy lab to enrich the learning experience for medical students. Methods included the deployment of a VR application developed to complement the dissection process, featuring detailed 3D models of human anatomy that students could manipulate and explore digitally. Approximately 60 s‐year medical students participated in the lab, where they engaged with both traditional dissection and the VR application. Results indicated that the VR integration not only increased engagement and satisfaction but also improved the students' ability to understand anatomical structures and their spatial relationships. Moreover, feedback from students suggested more efficient learning and retention than with traditional methods alone. We conclude that VR technology can significantly enhance medical anatomy education by providing an adjunct to traditional dissection, potentially replacing certain aspects of physical specimens with digital simulations that offer repeatable, detailed exploration without the associated logistical and ethical constraints.

anatomy & morphology
A Novel Virtual Reality Medical Image Display System for Group Discussions of Congenital Heart Disease: Development and Usability Testing (Preprint)

Byeol Kim,Yue-Hin Loke,Paige Mass,Matthew R Irwin,Conrad Capeland,Laura Olivieri,Axel Krieger

DOI: https://doi.org/10.2196/preprints.20633

2020-05-31

Abstract:BACKGROUND The complex 3-dimensional (3D) nature of anatomical abnormalities in congenital heart disease (CHD) necessitates multidisciplinary group discussions centered around the review of medical images such as magnetic resonance imaging. Currently, group viewings of medical images are constrained to 2-dimensional (2D) cross-sectional displays of 3D scans. However, 2D display methods could introduce additional challenges since they require physicians to accurately reconstruct the images mentally into 3D anatomies for diagnosis, staging, and planning of surgery or other therapies. Virtual reality (VR) software may enhance diagnosis and care of CHD via 3D visualization of medical images. Yet, present-day VR developments for medicine lack the emphasis on multiuser collaborative environments, and the effect of displays and level of immersion for diagnosing CHDs have not been studied. OBJECTIVE The objective of the study was to evaluate and compare the diagnostic accuracies and preferences of various display systems, including the conventional 2D display and a novel group VR software, in group discussions of CHD. METHODS A total of 22 medical trainees consisting of 1 first-year, 10 second-year, 4 third-year, and 1 fourth-year residents and 6 medical students, who volunteered for the study, were formed into groups of 4 to 5 participants. Each group discussed three diagnostic cases of CHD with varying structural complexity using conventional 2D display and group VR software. A group VR software, Cardiac Review 3D, was developed by our team using the Unity engine. By using different display hardware, VR was classified into nonimmersive and full-immersive settings. The discussion time, diagnostic accuracy score, and peer assessment were collected to capture the group and individual diagnostic performances. The diagnostic accuracies for each participant were scored by two experienced cardiologists following a predetermined answer rubric. At the end of the study, all participants were provided a survey to rank their preferences of the display systems for performing group medical discussions. RESULTS Diagnostic accuracies were highest when groups used the full-immersive VR compared with the conventional and nonimmersive VR (χ 2 2 =9.0, P =.01) displays. Differences between the display systems were more prominent with increasing case complexity (χ 2 2 =14.1, P <.001) where full-immersive VR had accuracy scores that were 54.49% and 146.82% higher than conventional and nonimmersive VR, respectively. The diagnostic accuracies provided by the two cardiologists for each participant did not statistically differ from each other ( t =–1.01, P =.31). The full-immersive VR was ranked as the most preferred display for performing group CHD discussions by 68% of the participants. CONCLUSIONS The most preferred display system among medical trainees for visualizing medical images during group diagnostic discussions is full-immersive VR, with a trend toward improved diagnostic accuracy in complex anatomical abnormalities. Immersion is a crucial feature of displays of medical images for diagnostic accuracy in collaborative discussions.
Embodied Cognition and Virtual Reality in Learning to Visualize Anatomy

MD Robert W. Jyung,John B. Black,Susan Jang

Abstract:This study examines the facilitative effects of embodiment of a complex internal anatomical structure through three-dimensional (“3-D”) interactivity in a virtual reality (“VR”) program. Since Shepard and Metzler’s influential 1971 study, it has been known that 3-D objects (e.g., multiple-armed cube or external body parts) are visually and motorically embodied in our minds. Such findings confirm the theory that our mental images, and rotations of these images, are in fact confined by the laws of physics and biomechanics, because we perceive, think and reason in an embodied fashion. With the advancement of new technologies, virtual reality programs for medical education now enable users to interact directly in a 3-D environment with internal anatomical structures. Given that such structures are not readily viewable to users and thus not previously susceptible to embodiment, coupled with the VR environment affording all possible degrees of rotation, how people learn from these programs raises new questions. If we embody external anatomical parts we can see, such as our hands and feet, can we embody internal anatomical parts we cannot see? Does manipulating the anatomical part in virtual space facilitate the user’s embodiment of that structure and therefore the ability to visualize the structure mentally?

Psychology,Computer Science
Use of Patient-Specific “4D” Tele-Education to Enhance Actual and Perceived Knowledge in Congenital Heart Disease (CHD) Patients

Molly Clarke,Karin Hamann,Nancy Klein,Laura Olivieri,Yue-Hin Loke

DOI: https://doi.org/10.32604/chd.2024.046328

IF: 2.419

2024-01-01

Congenital Heart Disease

Abstract:Patients with congenital heart disease (CHD) will transition to lifelong adult congenital cardiac care. However, their structural heart disease is challenging to convey via two-dimensional drawings. This study utilized a tele-educational environment, with personalized three-dimensional (3D) modeling and health Details (3D + Details = “4D”), to improve actual and perceived knowledge, both important components of transition readiness in CHD patients. Participants aged ≥13 years with a history of CHD and cardiac magnetic resonance imaging (MRI) studies were eligible. Cardiac MRI datasets were then used to segment and create 3D heart models (using Mimics, Materialize Inc.). Participants first completed the MyHeart Questionnaire, a validated survey of actual knowledge. A tele-educational session was then scheduled, during which participants were shown a 3D model of a normal heart, followed by their personal 3D heart model and specific health details. Participants then repeated the actual knowledge survey, in addition to questionnaires assessing perceived knowledge pre- and post-session, as well as a satisfaction survey. Twenty-two patients were included. Actual knowledge increased from 75% ± 15% to 89% ± 20% (p = 0.00043) and perceived knowledge increased in five of seven questions. Actual knowledge correlated with perceived knowledge (r = 0.608, p < 0.0001). Ninety-one percent of participants ranked the 3D model as “very satisfactory” and ninety-five percent ranked the educational session as “very helpful” or “extremely helpful.” The use of “4D” tele-education increased both actual and perceived knowledge and may help improve transition readiness in CHD patients.

cardiac & cardiovascular systems
A Novel Virtual Reality Medical Image Display System for Group Discussions of Congenital Heart Disease: Development and Usability Testing

Byeol Kim,Yue-Hin Loke,Paige Mass,Matthew R Irwin,Conrad Capeland,Laura Olivieri,Axel Krieger

DOI: https://doi.org/10.2196/20633

2020-12-08

JMIR Cardio

Abstract:Background The complex 3-dimensional (3D) nature of anatomical abnormalities in congenital heart disease (CHD) necessitates multidisciplinary group discussions centered around the review of medical images such as magnetic resonance imaging. Currently, group viewings of medical images are constrained to 2-dimensional (2D) cross-sectional displays of 3D scans. However, 2D display methods could introduce additional challenges since they require physicians to accurately reconstruct the images mentally into 3D anatomies for diagnosis, staging, and planning of surgery or other therapies. Virtual reality (VR) software may enhance diagnosis and care of CHD via 3D visualization of medical images. Yet, present-day VR developments for medicine lack the emphasis on multiuser collaborative environments, and the effect of displays and level of immersion for diagnosing CHDs have not been studied. Objective The objective of the study was to evaluate and compare the diagnostic accuracies and preferences of various display systems, including the conventional 2D display and a novel group VR software, in group discussions of CHD. Methods A total of 22 medical trainees consisting of 1 first-year, 10 second-year, 4 third-year, and 1 fourth-year residents and 6 medical students, who volunteered for the study, were formed into groups of 4 to 5 participants. Each group discussed three diagnostic cases of CHD with varying structural complexity using conventional 2D display and group VR software. A group VR software, Cardiac Review 3D, was developed by our team using the Unity engine. By using different display hardware, VR was classified into nonimmersive and full-immersive settings. The discussion time, diagnostic accuracy score, and peer assessment were collected to capture the group and individual diagnostic performances. The diagnostic accuracies for each participant were scored by two experienced cardiologists following a predetermined answer rubric. At the end of the study, all participants were provided a survey to rank their preferences of the display systems for performing group medical discussions. Results Diagnostic accuracies were highest when groups used the full-immersive VR compared with the conventional and nonimmersive VR (χ22=9.0, P=.01) displays. Differences between the display systems were more prominent with increasing case complexity (χ22=14.1, P<.001) where full-immersive VR had accuracy scores that were 54.49% and 146.82% higher than conventional and nonimmersive VR, respectively. The diagnostic accuracies provided by the two cardiologists for each participant did not statistically differ from each other (t=–1.01, P=.31). The full-immersive VR was ranked as the most preferred display for performing group CHD discussions by 68% of the participants. Conclusions The most preferred display system among medical trainees for visualizing medical images during group diagnostic discussions is full-immersive VR, with a trend toward improved diagnostic accuracy in complex anatomical abnormalities. Immersion is a crucial feature of displays of medical images for diagnostic accuracy in collaborative discussions.

[Anatomical and technical bases of microsurgical repair of blood vessels and nerves].

Simulating Developmental Cardiac Morphology in Virtual Reality Using a Deformable Image Registration Approach

Virtual Reality–based Methods for Training Novice Electrophysiology Trainees—A Pilot Study

Virtual reality and cardiac anatomy: Exploring immersive three‐dimensional cardiac imaging, a pilot study in undergraduate medical anatomy education

Immersive XR Anatomy Teaching Tools: Review of four custom‐built virtual spaces, their deployments and educational value

[Elementary neurophysiological mechanisms of learning].

Integrating 4-D light-sheet imaging with interactive virtual reality to recapitulate developmental cardiac mechanics and physiology

A new dynamic 3D virtual methodology for teaching the mechanics of atrial septation as seen in the human heart

Virtual Learning Environment for Medical Education Based on VRML and VTK

Fetal heart segmentation in a virtual reality environment

Interactive teaching of medical 3D cardiac anatomy: atrial anatomy enhanced by ECG and 3D visualization

Enhancing Medical Anatomy Education through Virtual Reality (VR): Design, Development, and Evaluation

Integrating light-sheet imaging with virtual reality to recapitulate developmental cardiac mechanics.

Towards Anatomy Education with Generative AI-based Virtual Assistants in Immersive Virtual Reality Environments

EchoSim4D: A Proof-of-Concept Gamified XR Echocardiography Training Simulator for Neonates using 4D Ultrasound Volume

Virtual Reality for Interactive Medical Analysis.

Enhancing medical anatomy education with the integration of virtual reality into traditional lab settings

A Novel Virtual Reality Medical Image Display System for Group Discussions of Congenital Heart Disease: Development and Usability Testing (Preprint)

Embodied Cognition and Virtual Reality in Learning to Visualize Anatomy

Use of Patient-Specific “4D” Tele-Education to Enhance Actual and Perceived Knowledge in Congenital Heart Disease (CHD) Patients

A Novel Virtual Reality Medical Image Display System for Group Discussions of Congenital Heart Disease: Development and Usability Testing