[Elementary neurophysiological mechanisms of learning].

L. Voronin

Успехи физиологических наук

Abstract:

What problem does this paper attempt to address?

Immersive XR Anatomy Teaching Tools: Review of four custom‐built virtual spaces, their deployments and educational value

Kristen Ramirez,Greg Dorsainville,Jillian Lieber,Kira Melamud,Andrew Clayburn,Victoria Harnik,Michael Poles,So‐Young Oh

DOI: https://doi.org/10.1096/fasebj.2022.36.s1.r4156

2022-05-01

The FASEB Journal

Abstract:Use of digital anatomical teaching resources mitigate trends of decreased anatomy contact hours, elimination of cadaveric specimens or student‐led dissections of them, remote or hybrid learning in response to COVID‐19, and to integrate anatomy content with radiology, surgery and other clinical applications. While there are a plethora of atlases built with cadaveric images, radiology, and artist‐rendered 3D models, we often find a disconnect between the complex geometry of many anatomical structures and the 2D screen interfaces used by students to access these digital resources. The open‐source Mozilla Hubs platform allows for the creation of customizable 3D virtual spaces, accessible via URL on a mobile, desktop, or virtual reality (VR) device. This platform was used to create four educational experiences deployed to first and second year medical students during pre‐clerkship courses: a desktop‐based tour of the surface and chambers of the heart; a VR tour of the chambers of the heart; a desktop‐based foregut escape room integrated with questions and multimedia clinical supplements; and a VR tour of the structure and neurovasculature of the pterygopalatine fossa. In each experience, the students are immersed within these anatomical spaces, encouraged to explore and appreciate the spatial relationships and orientations of key internal structures. When applicable, radiological imaging, videos, and animations display physiologic processes, the flow of blood and other fluids, and the functionality of a given structure in vivo. Audio and text instructions, labels, and additional information guide student learning, encouraging directed exploration while immersed in the experience. This presentation will discuss the four experiences, display real‐time video capture of the interactions and spaces, their deployment, educational value, and student reception. Students’ feedback suggests that the context and timing of the deployment of these experiences is crucial for student learning and appreciation, including the role of faculty assistance and training on how to navigate the interface prior to the educational intervention. Qualitative feedback and performance on pre‐ and post‐ experience quizzes show that these experiences are both statistically and perceptually valuable educational resources, and that the novel nature of this experience is engaging and exciting to students when deployed appropriately. This presentation will conclude with suggestions for best practices in choosing, developing, and deploying custom immersive educational interventions to anatomy learners.

cell biology,biochemistry & molecular biology,biology
Enhancing Medical Anatomy Education through Virtual Reality (VR): Design, Development, and Evaluation

Myint Zu Than,Kian Meng Yap

2024-11-08

Abstract:Modern medicine demands innovations in medical education, particularly in the learning of human anatomy, traditionally taught through textbooks, dissections, and lectures. Virtual Reality (VR) has emerged as a promising tool to address the limitations of these conventional methods by emphasising vision-based and active learning. However, current VR educational tools are often inaccessible due to high costs and specialised equipment requirements. This paper details the design and development of an accessible, desktop-based VR system aimed at enhancing anatomy education by leveraging the user's visual perception to promote a meaningful and interactive learning experience. The Virtual Anatomy Lab was designed to enable students to interact with a 3D Skull model to complete tasks virtually via an interactive user interface (UI) with the help of common devices like a mouse and keyboard. As part of the study, a group of medical students from prestigious medical schools throughout Malaysia were invited to evaluate the built system to offer feedback and determine its overall efficiency and usability in fulfilling their learning goals. The results and findings from user evaluations were then analysed to discuss its effectiveness and areas for future improvement.

Human-Computer Interaction
BrainTrain: brain simulator for medical VR application

Bundit Panchaphongsaphak,Rainer Burgkart,Robert Riener

Abstract:The brain is known as the most complex organ in the human body. Due to its complexity, learning and understanding the anatomy and functions of the cerebral cortex without effective learning assistance is rather difficult for medical novices and students in health and biological sciences. In this paper, we present a new virtual reality (VR) simulator for neurological education and neurosurgery. The system is based on a new three-dimensional (3D) user-computer interface design with a tangible object and a force-torque sensor. The system is combined with highly interactive computer-generated graphics and acoustics to provide multi-modal interactions through the user's sensory channels (vision, tactile, haptic and auditory). The system allows the user to feel the simulated object from its physical model that formed the interface device, while exploring or interacting with the mimicked computer-generated object in the virtual environment (VE). Unlike other passive interface devices, our system can detect the position and orientation of the interacting force in real-time, based on the system's set-up and a force-torque data acquisition technique. As long as the user is touching the model, the positions of the user's fingertip in the VE can be determined and is synchronized with the finger's motion in the physical world without requirement of an additional six-degree-of-freedom tracking device. The prior works have shown the use of the system set-up in medical applications. We demonstrate the system for neurological education and neurosurgery as a recent application. The main functions of the simulator contribute to education in neuroanatomy and visualization for diagnostic and pre-surgery planning. Once the user has touched the model, the system will mark the associated anatomy region and will provide the information of the region in terms of text note and/or sound. The user can switch from anatomy to the brain's function module, which will give details of motor, sensory or other cortical functions associated to the touch areas. In addition, the user can generate and visualize arbitrary cross-sectional images from corresponding to the magnetic resonance imaging (MRI) datasets either for training or for diagnostic purpose. The user can manipulate the cross-section image interactively and intuitively by moving the finger on the interface device.
Immersive Anatomical Scenes that Enable Multiple Users to Occupy the Same Virtual Space: A Tool for Surgical Planning and Education

Alex J. Deakyne,Erik N. Gaasedelen,Tinen L. Iles,Paul A. Iaizzo

DOI: https://doi.org/10.48550/arXiv.2012.02596

2020-11-05

Abstract:3D modeling is becoming a well-developed field of medicine, but its applicability can be limited due to the lack of software allowing for easy utilizations of generated 3D visualizations. By leveraging recent advances in virtual reality, we can rapidly create immersive anatomical scenes as well as allow multiple users to occupy the same virtual space: i.e., over a local or distributed network. This setup is ideal for pre-surgical planning and education, allowing users to identify and study structures of interest. I demonstrate here such a pipeline on a broad spectrum of anatomical models and discuss its applicability to the medical field and its future prospects.3D modeling is becoming a well-developed field of medicine, but its applicability can be limited due to the lack of software allowing for easy utilizations of generated 3D visualizations. By leveraging recent advances in virtual reality, we can rapidly create immersive anatomical scenes as well as allow multiple users to occupy the same virtual space: i.e., over a local or distributed network. This setup is ideal for pre-surgical planning and education, allowing users to identify and study structures of interest. I demonstrate here such a pipeline on a broad spectrum of anatomical models and discuss its applicability to the medical field and its future prospects.

Human-Computer Interaction,Graphics
Virtual Reality Educational Tool for Human Anatomy

Santiago González Izard,Juan A. Juanes Méndez,Pablo Ruisoto Palomera

DOI: https://doi.org/10.1007/s10916-017-0723-6

IF: 4.92

2017-03-22

Journal of Medical Systems

Abstract:Virtual Reality is becoming widespread in our society within very different areas, from industry to entertainment. It has many advantages in education as well, since it allows visualizing almost any object or going anywhere in a unique way. We will be focusing on medical education, and more specifically anatomy, where its use is especially interesting because it allows studying any structure of the human body by placing the user inside each one. By allowing virtual immersion in a body structure such as the interior of the cranium, stereoscopic vision goggles make these innovative teaching technologies a powerful tool for training in all areas of health sciences. The aim of this study is to illustrate the teaching potential of applying Virtual Reality in the field of human anatomy, where it can be used as a tool for education in medicine. A Virtual Reality Software was developed as an educational tool. This technological procedure is based entirely on software which will run in stereoscopic goggles to give users the sensation of being in a virtual environment, clearly showing the different bones and foramina which make up the cranium, and accompanied by audio explanations. Throughout the results the structure of the cranium is described in detailed from both inside and out. Importance of an exhaustive morphological knowledge of cranial fossae is further discussed. Application for the design of microsurgery is also commented.

health care sciences & services,medical informatics
[Anatomical and technical bases of microsurgical repair of blood vessels and nerves].

J. Comtet

Abstract:
Deformable Torso Anatomy Education with Three-Dimensional Autostereoscopic Visualization and Free-Hand Interaction.

Nan Zhang,Hongkai Wang,Tianqi Huang,Xinran Zhang,Hongen Liao

DOI: https://doi.org/10.1109/vrw55335.2022.00127

2022-01-01

Abstract:Virtual reality/augmented reality has advantages in immersive learning and conveying meta-information in anatomy education. In this study, we present an interactive naked-eye 3D torso anatomy education environment based on population anatomical information. In particular, we utilize the deformable anatomy models, constructed from big data of healthy adults, to convey the anatomy knowledge of truthfulness organ shapes and population anatomical variances. In addition, the proposed anatomy education system is conveyed by free-hand 3D autostereoscopic visualization, which supports multi-user and glass-free. A user study with fourteen students was implemented and demonstrates that the system is appropriate and useful for torso anatomy education.
A Large-Scale Feasibility Study of Screen-based 3D Visualization and Augmented Reality Tools for Human Anatomy Education: Exploring Gender Perspectives in Learning Experience

Roghayeh Leila Barmaki,Kangsoo Kim,Zhang Guo,Qile Wang,Kevin Yu,Rebecca Pearlman,Nassir Navab

2024-02-01

Abstract:Anatomy education is an indispensable part of medical training, but traditional methods face challenges like limited resources for dissection in large classes and difficulties understanding 2D anatomy in textbooks. Advanced technologies, such as 3D visualization and augmented reality (AR), are transforming anatomy learning. This paper presents two in-house solutions that use handheld tablets or screen-based AR to visualize 3D anatomy models with informative labels and in-situ visualizations of the muscle anatomy. To assess these tools, a user study of muscle anatomy education involved 236 premedical students in dyadic teams, with results showing that the tablet-based 3D visualization and screen-based AR tools led to significantly higher learning experience scores than traditional textbook. While knowledge retention didn't differ significantly, ethnographic and gender analysis showed that male students generally reported more positive learning experiences than female students. This study discusses the implications for anatomy and medical education, highlighting the potential of these innovative learning tools considering gender and team dynamics in body painting anatomy learning interventions.

Human-Computer Interaction,Graphics
Creating Virtual Models and 3D Movies Using DemoMaker for Anatomical Education

David L Miles,Dongmei Cui

DOI: https://doi.org/10.1007/978-3-031-36727-4_8

Abstract:Three-dimensional (3D) anatomy models have been used for education in health professional schools globally. Virtual technology has become more popular for online teaching since the COVID-19 pandemic. This chapter will describe a project in which a series of virtual anatomical models of organs and structures were developed for educational purposes, and it will describe in detail how to build three-dimensional (3D) movies using DemoMaker. Although setting up the 3D system was complicated and challenging, the process of reconstructing 3D models from radiographic images and the steps of creating animations and 3D movies are exponentially simpler. These efforts require minimal training, thus allowing most people to be able to engage in this modeling process and utilize the moviemaking steps. Amira® software and computed tomographic angiography (CTA) data were used to create 3D models of the lungs, heart, liver, stomach, kidney, etc. The anatomical locations of these structures within the body can be identified and visualized by recording information from multiple CTA slices using volume and surface segmentation. Ultimately, these virtual 3D models can be displayed via dual projectors onto a specialized silver screen and visualized stereoscopically by viewers as long as they wear 3D polarized glasses. Once these 3D movies are created, they can be played automatically on a computer screen, silver screen, 3D system playback screen, and video player, and they can be embedded into PowerPoint lecture slides. Both virtual models and movies are suitable for self-directed learning, face-to-face class teaching, and virtual anatomy education. Model animations and 3D movie displays offer students the opportunities to learn about anatomy and the anatomical positions of organs in the body and their 3D relationships to one another. By observing and studying these 3D models, students have the potential to be able to compartmentalize the anatomical information and retain it at a higher level than students learning corresponding anatomy without similar resources.
An Interactive System for Visualizing 3D Human Organ Models

Un-Hong Wong,Hon-Cheng Wong,Zesheng Tang

DOI: https://doi.org/10.1109/CAD-CG.2005.21

2005-01-01

Abstract:Demonstrations play a major role in education process. Although many specimen are readily available, particularly in medicine and biology, demonstrations are commonly performed by showing these static specimen to medical or biological students. Interactive demonstrations can significantly impacts learning. An interactive system for visualizing 3D human organ models can fulfill this need. In this paper, we present techniques to realize such a system which can let the user select and view one or several major organ models extracted from segmented Visible Human dataset interactively through a simple graphical user interface. The stereoscopic views of these organ models are also achieved with this system running on a PC-based stereo-ready system. In our system, the Marching Cubes algorithm is used but new implementation we proposed to greatly improve both the speed and quality of surface rendering results is performed. This new implementation can generate the Marching Cubes cases on-the-fly within the surface extraction process of the models by considering the relationship of the vertices, borders, and surfaces of each voxel. We also describe a new method for specifying the normals for the extracted triangles without the need of physical information (such as intensity values stored in a medical Computed Tomography (CT) dataset) stored in the voxels. These normals will be used for lighting the extracted models later. Furthermore, a memory arrangement scheme is designed to enhance the usability of the system.
Enhance Medical Education and Training Using Interactive Autostereoscopic 3D Display by In Situ 3D Interaction

Guowen Chen,Cong Ma,Xinran Zhang,Hongen Liao

DOI: https://doi.org/10.1007/978-981-10-9035-6_160

2019-01-01

Abstract:In this study, we proposed to combine autostereoscopic 3D display and interactive display to enhance medical education and training, which could be an alternative to the traditional medical education. We developed an enhanced 3D rendering algorithm for medical education and training based on the traditional lens based rendering algorithm (LBR). We used the system to perform a user study of medical visualization and education with a heart phantom, and a human-computer interaction device to capture hand motions, rotations, and gestures. Structure of the heart was labeled and validated by physician ahead. Furthermore, we devided 40 users (20 women and 20 men) into two groups: control group and experimental group, to operate a user study on anatomical structure of the heart phantom. Experimental results showed that our algorithm can achieve higher rendering performance than the traditional LBR. User test showed that 3D education system equipped by the enhanced LBR can achieve interactive display, and can thus promote education experience and reduce education time consuming. Further work includes more user studies on medical education and increasing frame rate of rendering for more versatile hardware configurations.
Platelet factor XIIIa release during platelet aggregation and plasma clot strength measured by thrombelastography in patients with coronary artery disease treated with clopidogrel

R. Kreutz,Janelle Owens,Deshun Lu,P. Nystrom,Yan Jin,Y. Kreutz,Z. Desta,D. Flockhart

DOI: https://doi.org/10.3109/09537104.2014.916793

2015-05-14

Platelets

Abstract:Abstract It has been estimated that up to half of circulating factor XIIIa (FXIIIa) is stored in platelets. The release of FXIIIa from platelets upon stimulation with adenosine diphosphate (ADP) in patients with coronary artery disease treated with dual antiplatelet therapy has not been previously examined. Samples from 96 patients with established coronary artery disease treated with aspirin and clopidogrel were examined. Platelet aggregation was performed by light transmittance aggregometry in platelet-rich plasma (PRP), with platelet-poor plasma (PPP) as reference, and ADP 5 µM as agonist. Kaolin-activated thrombelastography (TEG) was performed in citrate PPP. PRP after aggregation was centrifuged and plasma supernatant (PSN) collected. FXIIIa was measured in PPP and PSN. Platelet aggregation after stimulation with ADP 5 µM resulted in 24% additional FXIIIa release in PSN as compared to PPP (99.3 ± 27 vs. 80.3 ± 24%, p < 0.0001). FXIIIa concentration in PSN correlated with maximal plasma clot strength (TEG-G) (r = 0.48, p < 0.0001), but not in PPP (r = 0.15, p = 0.14). Increasing quartiles of platelet-derived FXIIIa were associated with incrementally higher TEG-G (p = 0.012). FXIIIa release was similar between clopidogrel responders and non-responders (p = 0.18). In summary, platelets treated with aspirin and clopidogrel release a significant amount of FXIIIa upon aggregation by ADP. Platelet-derived FXIIIa may contribute to differences in plasma TEG-G, and thus, in part, provide a mechanistic explanation for high clot strength observed as a consequence of platelet activation. Variability in clopidogrel response does not significantly influence FXIIIa release from platelets.
Enhancing Visualisation of Anatomical Presentation and Education Using Marker-based Augmented Reality Technology on Web-based Platform

I. Wang,M. Nguyen,H. Le,W. Yan,S. Hooper

DOI: https://doi.org/10.1109/avss.2018.8639147

2018-01-01

Abstract:The domain of teaching medicine involves the mastery of many complex skills that almost always need to be performed in real life situations following very high professional standards. However, this training is not always possible for various reasons such as ethics, safety and costs. Virtual reality (VR) and augmented reality (AR) have started to be widely used as alternative medical teaching practices. Our proposed AR system works online, so no installation is required on a users device; it only requires a generic colour web-cam to track a pictorial AR tag which contains a hidden QR code. These QR codes contain data, such as the ID of a three-dimensional (3D) model, and merge it with text so that it can be used as both an identity and tag pattern in the AR marker. The system can then show the corresponding computer-generated 3D anatomical models of organs; relevant text information about the subject is displayed above the AR Tag. The tag is numerically encrypted and decrypted and detectable by shape and orientation. Different from other similar techniques, our AR Tag is both a bar-code and a template marker, QR code is used to load a previously setup website, and then the detail of that QR code is used as a template to identify the border and orientation of the marker. The system is thus faster and more robust that allows users to control and navigate the 3D environment by zooming in and out and rotating left and right. It is hoped that this virtual environment will help reduce the need for real-life surgical practice, instead of increasing intuition, the direct 3D perception of the human body and other 3D medical imaging data (mimesis). This system could even be further developed to present the framework of a patient’s anatomy.
Personalized Augmented Reality for Anatomy Education

Meng Ma,Pascal Fallavollita,Ina Seelbach,Anna Maria Von der Heide,Ekkehard Euler,Jens Waschke,Nassir Navab

DOI: https://doi.org/10.1002/ca.22675

2015-01-01

Clinical Anatomy

Abstract:Anatomy education is a challenging but vital element in forming future medical professionals. In this work, a personalized and interactive augmented reality system is developed to facilitate education. This system behaves as a “magic mirror” which allows personalized in‐situ visualization of anatomy on the user's body. Real‐time volume visualization of a CT dataset creates the illusion that the user can look inside their body. The system comprises a RGB‐D sensor as a real‐time tracking device to detect the user moving in front of a display. In addition, the magic mirror system shows text information, medical images, and 3D models of organs that the user can interact with. Through the participation of 7 clinicians and 72 students, two user studies were designed to respectively assess the precision and acceptability of the magic mirror system for education. The results of the first study demonstrated that the average precision of the augmented reality overlay on the user body was 0.96 cm, while the results of the second study indicate 86.1% approval for the educational value of the magic mirror, and 91.7% approval for the augmented reality capability of displaying organs in three dimensions. The usefulness of this unique type of personalized augmented reality technology has been demonstrated in this paper. Clin. Anat. 29:446–453, 2016. © 2015 Wiley Periodicals, Inc.
A Naked Eye 3D Display and Interaction System for Medical Education and Training

Guowen Chen,Tianqi Huang,Zhencheng Fan,Xinran Zhang,Hongen Liao

DOI: https://doi.org/10.1016/j.jbi.2019.103319

IF: 8

2019-01-01

Journal of Biomedical Informatics

Abstract:To provide natural simulated objects and intuitive user interaction in medical education and training, we propose a naked eye 3D display and interaction system. The current 3D rendering algorithms for naked eye 3D displays are not suitable for medical use, due to the requirements of displaying and interacting with high quality medical images and simulating soft tissues. Because the traditional 3D rendering procedure and vertex indexing in collision detection require substantial computing power when using a naked eye 3D display, the current method cannot achieve fluent displays and interactions. Thus, we develop a novel octree-based 3D rendering and interaction algorithm for high quality medical models to improve the rendering rate and obtain smooth human machine interactions when using the naked eye 3D display device. We also valuate the soft-body phantom simulation of the naked eye 3D display device by combining the traditional 3D rendering algorithm with the elastic 3D simulation to simulate deformable tissues. We integrate an incremental interaction method and a Kalman filter-based hand tracking method to achieve a larger user interaction range and robust hand tracking. We used the proposed system to perform human-computer interactions with rigid phantoms and soft-body phantoms. The experimental results showed that the proposed rendering algorithm for rigid phantoms could achieve higher rendering performance (50 FPS) than the traditional rendering algorithm (9.8 FPS). The user experiments showed that the 3D simulation system equipped with the enhanced rendering algorithm could achieve fluent interactions when using the naked eye 3D display, thus promoting education experiences and reducing task completion times.
Gamified Learning and Assessment Using ARCS with Next-Generation AIoMT Integrated 3D Animation and Virtual Reality Simulation

Abhishek Kumar,Abdul Khader Jilani Saudagar,Mohammed Alkhathami,Badr Alsamani,Muhammad Badruddin Khan,Mozaherul Hoque Abul Hasanat,Zakir Hussain Ahmed,Ankit Kumar,Bhavana Srinivasan

DOI: https://doi.org/10.3390/electronics12040835

IF: 2.9

2023-02-07

Electronics

Abstract:In higher education institutions (HEI), particularly in biology and medical education, the use of 3D animation, virtual reality, and simulation offers great potential in terms of enhancing learning and engaging students. Higher education researchers are still investigating virtual reality's possibilities and outcomes in various fields. This study focuses on the effects of 3D gamification using an Artificial Intelligence integrated Internet of Medical Things (AIoMT) implemented with virtual reality application for biology and medical students to learn about the human brain. Nowadays, both theoretical and practical education frequently incorporate virtual reality and augmented reality. Virtual tours of the human body's systems are offered to biology students so that they may comprehend such systems' functions. This study focuses on the use of 3D animation, virtual reality, and simulation in medical education, with a specific focus on the effects of a 3D gamification app using the Internet of Medical Things (AIoMT) on medical professionals' passion for learning. This study uses the ARCS model and SEM analysis to examine the impact of virtual reality on students' motivation and learning. The results show that virtual reality positively impacts motivation and the understanding of the concept-to-execution process through practice and simulation-based training. To assess how well students are learning, what they are analyzing, and how well they can understand the objects of analysis, a 3D-simulation-based and user-feedback-based design has been developed using the proposed research methodology. According to this article's findings, a smartphone app that uses virtual reality can help medical professionals better understand the concept-to-execution process through practice. VR simulation-based training, as well as Biology teachers or medical colleges, can offer high-definition 3D VR models rather than organs in jars to understand the human anatomy and its functions more experientially and effectively.

engineering, electrical & electronic,computer science, information systems,physics, applied
Virtual Learning Environment for Medical Education Based on VRML and VTK

JF Lu,ZG Pan,H Lin,MM Zhang,JY Shi

DOI: https://doi.org/10.1016/j.cag.2004.12.015

IF: 1.821

2005-01-01

Computers & Graphics

Abstract:Virtual reality (VR) is being applied to a wide range of medical areas, including medical education/training, surgery and diagnostics assistance. In the medical education field, VR opens new realms in the teaching of medicine and creates new effective learning procedures for the students. In contrast with the expensive immersive virtual reality learning environment (VRLE) such as CAVE, ImmersaDesk, virtual reality modeling language (VRML) technology provides a cheap and simple way to create such an environment and can be easily deployed in the classroom. In this paper, we describe some traditional application of VR in medical education and design a prototype of VRLE system based on VRML and visualization toolkit (VTK). The system architecture and module design are described in detail and some results are presented.
The Role of Mental and Motor Processes in Conceiving, Developing and Validating 3D Interactive Human Anatomy Learning Tools

Nady Hoyek,Franck Di Rienzo,Aymeric Guillot,Christian Collet

DOI: https://doi.org/10.1096/fasebj.2020.34.s1.01867

2020-04-01

The FASEB Journal

Abstract:Understanding human anatomy requires several mental and motor processes: i) mental imagery: the ability to mentally represent a physical object, a concept or a situation; ii) mental rotation: the ability to mentally turn the image of an object in the three space planes; iii) motor imagery: the ability to imagine a human movement without any real movement execution. These mental and motor processes have been used in Lyon 1 university to conceive and develop hundreds of 3D animations that are used to teach anatomy for undergraduate allied health sciences students, especially kinesiology students. All our animations are available in our YouTube Chanel “Anatomie 3D Lyon”. Our approach is experimentally validated through several paradigms. For instance, we found a significant correlation between anatomy examination results and visuo‐spatial ability tests (Guillot et al., 2007). We also showed that mental rotation training enhanced the acquisition of anatomical information requiring visuo‐spatial ability (Hoyek et al., 2009). Our 3D animations, when used in real learning condition, enhance the acquisition of anatomy knowledge requiring spatial ability as compared to 2D images (Hoyek et al., 2014). We further showed the efficiency of 3D animations compared to static 3D images in the mental representation and description of the scapula (Berney et al. 2015). In sum, 3D animations are efficient in teaching and learning anatomy, however their passive visualization lacks interaction, which is essential for anatomy learning. In our actual funded projects (Antepulsio and An@tomy 2020) we are developing new interactive tools that allow both personal body experience and good spatial representation of anatomical structures. This approach is based on evidences that body movements could improve learning of different knowledge by augmenting or enriching traces in long‐term memory. This embodied perspective is particularly relevant for functional anatomy learning as the knowledge to acquire could be specifically related to the learner’s body in motion. Our new prototypes as well as our related preliminary results will be presented during the conference. All our experiments were approved by our local ethic board. They were conducted on our kinesiology students with their understanding and consent. Support or Funding Information 1) Agence Nationale de la Recherche: project An@tomy20202) Fond Unique Interministériel: project ANTEPULSIO
An AR Edutainment System Supporting Bone Anatomy Learning.

Philipp Stefan,Patrick Wucherer,Yuji Oyamada,Meng Ma,Alexander Schoch,Motoko Kanegae,Naoki Shimizu,Tatsuya Kodera,Sebastien Callier,Matthias Weigl,Maki Sugimoto,Pascal Fallavollita,Hideo Saito,Nassir Navab

DOI: https://doi.org/10.1109/vr.2014.6802077

2014-01-01

Abstract:We present a medical Augmented Reality (AR) edutainment system for bone anatomy learning. This learning environment, called AR bone puzzle, is a metaphor for bone anatomy learning with AR visualization and intuitive interaction. AR bone puzzle uses its user's body as a puzzle frame and computer generated virtual bones as puzzle pieces. Users learn bone anatomy by assembling the virtual bone pieces on their body. Key features of this system are 3D AR visualization and intuitive gesture based user interaction.
A Novel Virtual Reality Medical Image Display System for Group Discussions of Congenital Heart Disease: Development and Usability Testing (Preprint)

Byeol Kim,Yue-Hin Loke,Paige Mass,Matthew R Irwin,Conrad Capeland,Laura Olivieri,Axel Krieger

DOI: https://doi.org/10.2196/preprints.20633

2020-05-31

Abstract:BACKGROUND The complex 3-dimensional (3D) nature of anatomical abnormalities in congenital heart disease (CHD) necessitates multidisciplinary group discussions centered around the review of medical images such as magnetic resonance imaging. Currently, group viewings of medical images are constrained to 2-dimensional (2D) cross-sectional displays of 3D scans. However, 2D display methods could introduce additional challenges since they require physicians to accurately reconstruct the images mentally into 3D anatomies for diagnosis, staging, and planning of surgery or other therapies. Virtual reality (VR) software may enhance diagnosis and care of CHD via 3D visualization of medical images. Yet, present-day VR developments for medicine lack the emphasis on multiuser collaborative environments, and the effect of displays and level of immersion for diagnosing CHDs have not been studied. OBJECTIVE The objective of the study was to evaluate and compare the diagnostic accuracies and preferences of various display systems, including the conventional 2D display and a novel group VR software, in group discussions of CHD. METHODS A total of 22 medical trainees consisting of 1 first-year, 10 second-year, 4 third-year, and 1 fourth-year residents and 6 medical students, who volunteered for the study, were formed into groups of 4 to 5 participants. Each group discussed three diagnostic cases of CHD with varying structural complexity using conventional 2D display and group VR software. A group VR software, Cardiac Review 3D, was developed by our team using the Unity engine. By using different display hardware, VR was classified into nonimmersive and full-immersive settings. The discussion time, diagnostic accuracy score, and peer assessment were collected to capture the group and individual diagnostic performances. The diagnostic accuracies for each participant were scored by two experienced cardiologists following a predetermined answer rubric. At the end of the study, all participants were provided a survey to rank their preferences of the display systems for performing group medical discussions. RESULTS Diagnostic accuracies were highest when groups used the full-immersive VR compared with the conventional and nonimmersive VR (χ 2 2 =9.0, P =.01) displays. Differences between the display systems were more prominent with increasing case complexity (χ 2 2 =14.1, P <.001) where full-immersive VR had accuracy scores that were 54.49% and 146.82% higher than conventional and nonimmersive VR, respectively. The diagnostic accuracies provided by the two cardiologists for each participant did not statistically differ from each other ( t =–1.01, P =.31). The full-immersive VR was ranked as the most preferred display for performing group CHD discussions by 68% of the participants. CONCLUSIONS The most preferred display system among medical trainees for visualizing medical images during group diagnostic discussions is full-immersive VR, with a trend toward improved diagnostic accuracy in complex anatomical abnormalities. Immersion is a crucial feature of displays of medical images for diagnostic accuracy in collaborative discussions.

[Elementary neurophysiological mechanisms of learning].

Immersive XR Anatomy Teaching Tools: Review of four custom‐built virtual spaces, their deployments and educational value

Enhancing Medical Anatomy Education through Virtual Reality (VR): Design, Development, and Evaluation

BrainTrain: brain simulator for medical VR application

Immersive Anatomical Scenes that Enable Multiple Users to Occupy the Same Virtual Space: A Tool for Surgical Planning and Education

Virtual Reality Educational Tool for Human Anatomy

[Anatomical and technical bases of microsurgical repair of blood vessels and nerves].

Deformable Torso Anatomy Education with Three-Dimensional Autostereoscopic Visualization and Free-Hand Interaction.

A Large-Scale Feasibility Study of Screen-based 3D Visualization and Augmented Reality Tools for Human Anatomy Education: Exploring Gender Perspectives in Learning Experience

Creating Virtual Models and 3D Movies Using DemoMaker for Anatomical Education

An Interactive System for Visualizing 3D Human Organ Models

Enhance Medical Education and Training Using Interactive Autostereoscopic 3D Display by In Situ 3D Interaction

Platelet factor XIIIa release during platelet aggregation and plasma clot strength measured by thrombelastography in patients with coronary artery disease treated with clopidogrel

Enhancing Visualisation of Anatomical Presentation and Education Using Marker-based Augmented Reality Technology on Web-based Platform

Personalized Augmented Reality for Anatomy Education

A Naked Eye 3D Display and Interaction System for Medical Education and Training

Gamified Learning and Assessment Using ARCS with Next-Generation AIoMT Integrated 3D Animation and Virtual Reality Simulation

Virtual Learning Environment for Medical Education Based on VRML and VTK

The Role of Mental and Motor Processes in Conceiving, Developing and Validating 3D Interactive Human Anatomy Learning Tools

An AR Edutainment System Supporting Bone Anatomy Learning.

A Novel Virtual Reality Medical Image Display System for Group Discussions of Congenital Heart Disease: Development and Usability Testing (Preprint)