Abstract:Objective In contrast to the rising amount of financial investments for research and development in medical technology worldwide is the lack of usability and clinical readiness of the produced systems. We evaluated an augmented reality (AR) setup under development for preoperative perforator vessel mapping for elective autologous breast reconstruction. Methods In this grant-supported research pilot, we used magnetic resonance angiography data (MR-A) of the trunk to superimpose the scans on the corresponding patients with hands-free AR goggles to identify regions-of-interest for surgical planning. Perforator location was assessed using MR-A imaging (MR-A projection) and Doppler ultrasound data (3D distance) and confirmed intraoperatively in all cases. We evaluated usability (System Usability Scale, SUS), data transfer load and documented personnel hours for software development, correlation of image data, as well as processing duration to clinical readiness (time from MR-A to AR projections per scan). Results All perforator locations were confirmed intraoperatively, and we found a strong correlation between MR-A projection and 3D distance measurements (Spearman r = 0.894). The overall usability (SUS) was 67 ± 10 (=moderate to good). The presented setup for AR projections took 173 min to clinical readiness (=availability on AR device per patient). Conclusion In this pilot, we calculated development investments based on project-approved grant-funded personnel hours with a moderate to good usability outcome resulting from some limitations: assessment was based on one-time testing with no previous training, a time lag of AR visualizations on the body and difficulties in spatial AR orientation. The use of AR systems can provide new opportunities for future surgical planning, but has more potential for educational (e.g., patient information) or training purposes of medical under- and postgraduates (spatial recognition of imaging data associated with anatomical structures and operative planning). We expect future usability improvements with refined user interfaces, faster AR hardware and artificial intelligence-enhanced visualization techniques.

Augmenting Image-Guided Procedures through In Situ Visualization of 3D Ultrasound via a Head-Mounted Display

Augmented reality in the operating room: a clinical feasibility study

Ultrasound in augmented reality: a mixed-methods evaluation of head-mounted displays in image-guided interventions

In Situ Visualization for 3D Ultrasound-Guided Interventions with Augmented Reality Headset

A Web-Based Augmented Reality Approach to Instantly View and Display 4D Medical Images

Towards a First-Person Perspective Mixed Reality Guidance System for Needle Interventions

Augmented reality for point-of-care ultrasound-guided vascular access in pediatric patients using Microsoft HoloLens 2: a preliminary evaluation

Real-time ultrasound AR 3D visualization toward better topological structure perception for hepatobiliary surgery

Mixed Reality in Visceral Surgery: Development of a Suitable Workflow and Evaluation of Intraoperative Use-cases

A mixed reality telemedicine system for collaborative ultrasound diagnostics and ultrasound-guided interventions

Real-time freehand 3D ultrasound imaging

Evaluation of an augmented reality navigational guidance platform for percutaneous procedures in a cadaver model

3-D Augmented Reality for MRI-guided Surgery Using Integral Videography Autostereoscopic Image Overlay.

An Augmented Reality-Assisted Visualization System for Potential Applications in Prostate Biopsy

HoloPOCUS: Portable Mixed-Reality 3D Ultrasound Tracking, Reconstruction and Overlay

A Novel Augmented Reality Ultrasound Framework Using an RGB-D Camera and a 3D-printed Marker

Early preclinical experience of a mixed reality ultrasound system with active GUIDance for NEedle-based interventions: The GUIDE study

On-the-fly Augmented Reality for Orthopaedic Surgery Using a Multi-Modal Fiducial

Workflow assessment of an augmented reality application for planning of perforator flaps in plastic reconstructive surgery: Game or game changer?

A System for Mixed-Reality Holographic Overlays of Real-Time Rendered 3D-Reconstructed Imaging Using a Video Pass-through Head-Mounted Display—A Pathway to Future Navigation in Chest Wall Surgery

Real-time in Situ Three-Dimensional Integral Videography and Surgical Navigation Using Augmented Reality: a Pilot Study