A Large-Scale Feasibility Study of Screen-based 3D Visualization and Augmented Reality Tools for Human Anatomy Education: Exploring Gender Perspectives in Learning Experience

Roghayeh Leila Barmaki,Kangsoo Kim,Zhang Guo,Qile Wang,Kevin Yu,Rebecca Pearlman,Nassir Navab

2024-02-01

Abstract:Anatomy education is an indispensable part of medical training, but traditional methods face challenges like limited resources for dissection in large classes and difficulties understanding 2D anatomy in textbooks. Advanced technologies, such as 3D visualization and augmented reality (AR), are transforming anatomy learning. This paper presents two in-house solutions that use handheld tablets or screen-based AR to visualize 3D anatomy models with informative labels and in-situ visualizations of the muscle anatomy. To assess these tools, a user study of muscle anatomy education involved 236 premedical students in dyadic teams, with results showing that the tablet-based 3D visualization and screen-based AR tools led to significantly higher learning experience scores than traditional textbook. While knowledge retention didn't differ significantly, ethnographic and gender analysis showed that male students generally reported more positive learning experiences than female students. This study discusses the implications for anatomy and medical education, highlighting the potential of these innovative learning tools considering gender and team dynamics in body painting anatomy learning interventions.

Human-Computer Interaction,Graphics

What problem does this paper attempt to address?

The paper attempts to address several key challenges in anatomical education:

1. **Limitations of Traditional Teaching Methods**: Traditional anatomical teaching methods (such as textbooks and cadaver dissections) face challenges like limited resources, large class sizes, and difficulties in conducting face-to-face learning, especially in large-scale courses. These methods often struggle to provide interactivity and realism, leading to difficulties for students in understanding and memorizing anatomical structures.

2. **Application of 3D Visualization and Augmented Reality Technologies**: To overcome the aforementioned issues, researchers have developed a 3D visualization tool based on handheld tablets (Tablet-3D) and a screen-based augmented reality tool (Screen-AR), aiming to improve the anatomical learning experience through dynamic, interactive 3D models.

3. **Impact of Gender Differences**: The study also explores how gender factors influence learning experiences and outcomes. Specifically, researchers aim to understand through experiments whether there are significant differences in learning experiences between male and female students when using these new technologies.

### Research Questions
To systematically evaluate the effectiveness of these tools, the researchers posed the following research questions:

- **RQ1**: Compared to traditional textbooks, do tablet-based 3D visualization and augmented reality technologies improve students' anatomical learning experiences?
- **RQ2**: Do tablet-based 3D visualization and augmented reality technologies enhance students' anatomical learning outcomes, such as test scores or knowledge retention?
- **RQ3**: In the context of anatomical learning experiences, does augmented reality technology have specific advantages over tablet-based 3D visualization?
- **RQ4**: Does the gender of students affect the effectiveness of digital technologies, or what overall impact does it have on the learning experience?

### Methods
The researchers designed a large-scale user study involving 236 pre-medical students, who were randomly assigned to one of three learning tool conditions: traditional textbooks, tablet-based 3D visualization tools (Tablet-3D), and screen-based augmented reality tools (Screen-AR). Students participated in muscle drawing activities in pairs and used the assigned learning tools to complete the tasks. Researchers collected students' subjective evaluations and knowledge retention data through questionnaires.

### Results
The study results indicate:

- **Learning Experience**: Students using Tablet-3D and Screen-AR reported higher learning experience scores compared to those using traditional textbooks, especially in terms of "ease of drawing" and "ease of finding muscles." However, gender analysis showed that male students generally reported more positive learning experiences, particularly in "ease of drawing" and "ease of finding muscles."
- **Short-term Knowledge Retention**: Although the differences in knowledge retention among the different learning tools were not significant, Tablet-3D and Screen-AR still showed certain advantages in some aspects.

### Discussion
The researchers discussed the potential implications of these findings for anatomical and medical education, particularly the application potential of these innovative learning tools in considering gender and team dynamics. While these technologies excel in improving learning experiences, further research is needed to optimize their application across different genders and team compositions.