Augmented Reality-based Feedback for Technician-in-the-loop C-arm Repositioning

Mathias Unberath,Javad Fotouhi,Jonas Hajek,Andreas Maier,Greg Osgood,Russell Taylor,Mehran Armand,Nassir Navab
DOI: https://doi.org/10.48550/arXiv.1806.08814
2018-06-23
Abstract:Interventional C-arm imaging is crucial to percutaneous orthopedic procedures as it enables the surgeon to monitor the progress of surgery on the anatomy level. Minimally invasive interventions require repeated acquisition of X-ray images from different anatomical views to verify tool placement. Achieving and reproducing these views often comes at the cost of increased surgical time and radiation dose to both patient and staff. This work proposes a marker-free "technician-in-the-loop" Augmented Reality (AR) solution for C-arm repositioning. The X-ray technician operating the C-arm interventionally is equipped with a head-mounted display capable of recording desired C-arm poses in 3D via an integrated infrared sensor. For C-arm repositioning to a particular target view, the recorded C-arm pose is restored as a virtual object and visualized in an AR environment, serving as a perceptual reference for the technician. We conduct experiments in a setting simulating orthopedic trauma surgery. Our proof-of-principle findings indicate that the proposed system can decrease the 2.76 X-ray images required per desired view down to zero, suggesting substantial reductions of radiation dose during C-arm repositioning. The proposed AR solution is a first step towards facilitating communication between the surgeon and the surgical staff, improving the quality of surgical image acquisition, and enabling context-aware guidance for surgery rooms of the future. The concept of technician-in-the-loop design will become relevant to various interventions considering the expected advancements of sensing and wearable computing in the near future.
Computer Vision and Pattern Recognition
What problem does this paper attempt to address?
This paper aims to solve the problem of re - positioning of C - arm X - ray imaging systems in minimally invasive orthopedic surgeries. Specifically, the paper proposes a technician - involved solution based on augmented reality (AR) to reduce the number of times X - ray images need to be obtained from different anatomical perspectives during the surgical process in order to verify tool placement. This solution can not only reduce the surgical time and the radiation dose for patients and medical staff, but also improve the quality of surgical image acquisition and provide situation - awareness guidance for future operating rooms. ### Main Problems 1. **Increased Surgical Time and Radiation Dose**: In minimally invasive interventions, in order to verify tool placement, X - ray images are usually repeatedly obtained from different anatomical perspectives. This not only increases the surgical time but also the radiation dose for patients and medical staff. 2. **Difficulties in C - arm Repositioning**: Achieving and reproducing these specific perspectives are often very difficult because the internal anatomical positions are not obvious and the C - arm system has multiple degrees of freedom, causing technicians to reach the required perspectives through trial and error repeatedly. ### Solutions The paper proposes a marker - free "technician - involved" augmented reality (AR) solution: - **Data Acquisition**: X - ray technicians wear a head - mounted display device (HMD) with an integrated infrared sensor, which can record the required C - arm postures. - **Data Storage and Restoration**: When the C - arm needs to be re - positioned to a specific target perspective, the recorded C - arm postures are restored and visualized as virtual objects in the AR environment, providing technicians with an intuitive reference. - **Experimental Verification**: Experiments were carried out in an environment simulating orthopedic trauma surgeries. The results show that the system can reduce the 2.76 X - ray images required for each required perspective to zero, significantly reducing the radiation dose during the C - arm re - positioning process. ### Experimental Results - **Dose Reduction**: After using the AR system, the C - arm can be re - positioned without additional X - ray images, significantly reducing the radiation dose. - **Reduction of Operational Errors**: The AR system helps prevent operational errors, such as restoring the wrong perspective. - **Perceptual Feedback Challenges**: There are challenges in currently relying on perception as the only performance feedback mechanism. Future work should explore methods of providing quantitative feedback in real - time to further improve the performance of the system. ### Conclusion The AR system proposed in this paper provides an effective solution for C - arm re - positioning, which can improve the quality of surgical image acquisition while reducing the radiation dose. However, the perceptual quality and tracking accuracy of the system still need to be further improved to meet the requirements of clinical applications.