Enhancing Visualisation of Anatomical Presentation and Education Using Marker-based Augmented Reality Technology on Web-based Platform

I. Wang,M. Nguyen,H. Le,W. Yan,S. Hooper
DOI: https://doi.org/10.1109/avss.2018.8639147
2018-01-01
Abstract:The domain of teaching medicine involves the mastery of many complex skills that almost always need to be performed in real life situations following very high professional standards. However, this training is not always possible for various reasons such as ethics, safety and costs. Virtual reality (VR) and augmented reality (AR) have started to be widely used as alternative medical teaching practices. Our proposed AR system works online, so no installation is required on a users device; it only requires a generic colour web-cam to track a pictorial AR tag which contains a hidden QR code. These QR codes contain data, such as the ID of a three-dimensional (3D) model, and merge it with text so that it can be used as both an identity and tag pattern in the AR marker. The system can then show the corresponding computer-generated 3D anatomical models of organs; relevant text information about the subject is displayed above the AR Tag. The tag is numerically encrypted and decrypted and detectable by shape and orientation. Different from other similar techniques, our AR Tag is both a bar-code and a template marker, QR code is used to load a previously setup website, and then the detail of that QR code is used as a template to identify the border and orientation of the marker. The system is thus faster and more robust that allows users to control and navigate the 3D environment by zooming in and out and rotating left and right. It is hoped that this virtual environment will help reduce the need for real-life surgical practice, instead of increasing intuition, the direct 3D perception of the human body and other 3D medical imaging data (mimesis). This system could even be further developed to present the framework of a patient’s anatomy.
What problem does this paper attempt to address?