Kinect for interactive AR anatomy learning

Meng Ma,Pascal Fallavollita,Tobias Blum,Ulrich Eck,Christian Sandor,Simon Weidert,Jens Waschke,Nassir Navab
DOI: https://doi.org/10.1109/ISMAR.2013.6671803
2013-01-01
Abstract:Education of anatomy is a challenging but crucial element in educating medical professionals, but also for general education of pupils. Our research group has previously developed a prototype of an Augmented Reality (AR) magic mirror which allows intuitive visualization of realistic anatomical information on the user. However, the current overlay is imprecise as the magic mirror depends on the skeleton output from Kinect. These imprecisions affect the quality of education and learning. Hence, together with clinicians we have defined bone landmarks which users can touch easily on their body while standing in front of the sensor. We demonstrate that these landmarks allow the proper deformation of medical data within the magic mirror and onto the human body, resulting in a more precise augmentation.
What problem does this paper attempt to address?