Abstract:Introduction: There is a tremendous scope of hardware and software development going on in augmented reality (AR), also in trauma and orthopaedic surgery. However, there are only a few systems available for intra-operative 3D imaging and guidance, most of them rely on peri- and intra-operative X-ray imaging. Especially in complex situations such as pelvic surgery or multifragmentary multilevel fractures, intra-operative 3D imaging and implant tracking systems have proven to be of great advantage for the outcome of the surgery and can help reduce X-ray exposure, at least for the surgical team (Ochs et al. in Injury 41:1297 1305, 2010). Yet, the current systems do not provide the ability to have a dynamic live view from the perspective of the surgeon. Our study describes a prototype AR-based system for live tracking which does not rely on X-rays. Materials and methods: A protype live-view intra-operative guidance system using an AR head-mounted device (HMD) was developed and tested on the implantation of a medullary nail in a tibia fracture model. Software algorithms that allow live view and tracking of the implant, fracture fragments and soft tissue without the intra-operative use of X-rays were derived. Results: The implantation of a medullar tibia nail is possible while only relying on AR-guidance and live view without the intra-operative use of X-rays. Conclusions: The current paper describes a feasibility study with a prototype of an intra-operative dynamic live tracking and imaging system that does not require intra-operative use of X-rays and dynamically adjust to the perspective of the surgeons due to an AR HMD. To our knowledge, the current literature does not describe any similar systems. This could be the next step in surgical imaging and education and a promising way to improve patient care.

Utilizing Augmented Reality for Reconstruction of Fractured, Fragmented and Damaged Craniofacial Remains in Forensic Anthropology

The Preliminary Application of Augmented Reality in Unilateral Orbitozygomatic Maxillary Complex Fractures Treatment

Creating Augmented Reality Holograms for Polytrauma Patients Using 3D Slicer and Holomedicine Medical Image Platform

Virtual multi-fracture craniofacial reconstruction using computer vision and graph matching

Reality-augmented Virtual Fluoroscopy for Computer-Assisted Diaphyseal Long Bone Fracture Osteosynthesis: A Novel Technique and Feasibility Study Results

Augmented Reality Registration System for Visualization of Skull Landmarks

The Affordances of 3D and 4D Digital Technologies for Computerized Facial Depiction

Augmented Reality for Interactive Visualization of 3D Maxillofacial Prosthetic Data

Virtual Reassembly of Fractured Bones for Orthopedic Surgery

Augmented Virtual Fluoroscopy for Minimally Invasive Diaphyseal Long Bone Fracture Reduction and Osteosynthesis

Facial Model Collection for Medical Augmented Reality in Oncologic Cranio-Maxillofacial Surgery.

Virtual reality and 3D animation in forensic visualization

Facial reconstruction using 3-D computerized method: A scoping review of Methods, current Status, and future developments

Augmented Reality (AR) and Fracture Mapping Model on Middle-Aged Femoral Neck Fracture: A Proof-of-concept Towards Interactive Visualization

Prediction methods for soft tissue structures in forensic facial reconstruction: A review for reconstruction of nose, eyes, mouth and ears

Next step trauma and orthopaedic surgery: integration of augmented reality for reduction and nail implantation of tibial fractures

A detailed review of forensic facial reconstruction techniques

Preliminary reports of augmented-reality assisted craniofacial bone fracture reduction

An augmented reality tool for learning spatial anatomy on mobile devices

Complex Craniofacial Cases through Augmented Reality Guidance in Surgical Oncology: A Technical Report

Virtual anthropology? Reliability of three-dimensional photogrammetry as a forensic anthropology measurement and documentation technique