Abstract:Background: An ideal 3D cartilage framework and accurate anatomical location are the most important factors to carry out a satisfactory reconstruction of the ear. To streamline this process, we developed an augmented reality assistance system, HoloLens Ear Image Guidance, which is based on computed tomography (CT) data, tailor-made navigation kits to guide reconstruction, data processing software, and HoloLens hardware. The objective of this study is to verify its feasibility in a clinical setting. Methods: This study first validated our system in healthy controls and then extrapolated data to test on patients with microtia. First, three healthy volunteers were recruited, and reconstructive navigation kits were made using 3D printing. CT data were collected for the head and neck and imported into the HoloLens Ear Image Guidance Application to generate a personalized 3D virtual ear image. Volunteers then wore the navigation kits while researchers observed them through the HoloLens to check accuracy, track delay, and view the ear image guide.Ten patients with unilateral microtia were recruited and CT data were collected, and reconstructive navigation kits were made to assist with surgery. The procedure was monitored to record the surgeon's experience wearing the HoloLens, the patients' complications associated with wearing navigation kit, and to measure the symmetry between the reconstructed ear and the reference counterpart. Results: In control patients, the deviation between the virtual image and the real ear was less than 2.4% (±0.22%); the tracking delay was less than 1.26 s (±0.09 s), the display effect was good, and surgeons did not report discomfort or dizziness while wearing the HoloLens. Volunteers did not report any pain from holding the navigation reference in their mouth during the test. Following validation, the HoloLens-assisted procedures were not associated with surgeon discomfort or dizziness. No complications were noted in patients including injury to the oral mucosa. Symmetry between the reconstructed ear and the contralateral ear was noted to be satisfactory in HoloLens-assisted surgery. Conclusions: The HoloLens Ear Image Guidance initially met clinical demands in registration accuracy, tracking speed, and subjective user experience, which can be used as the basis for continual software improvements and clinical application.

Enhancing surgical navigation: a robust hand–eye calibration method for the Microsoft HoloLens 2

Augmented reality in the operating room: a clinical feasibility study

Registration made easy -- standalone orthopedic navigation with HoloLens

A Wearable Augmented Reality Navigation System for Surgical Telementoring Based on Microsoft HoloLens

Inside-Out Instrument Tracking for Surgical Navigation in Augmented Reality

Nail it! vision-based drift correction for accurate mixed reality surgical guidance

Simulated augmented reality-based calibration of optical see-through head mound display for surgical navigation

From microscope to head-mounted display: integrating hand tracking into microsurgical augmented reality

Augmented reality calibration using feature triangulation iteration-based registration for surgical navigation

979 Enhancing Surgical Training Through Augmented Reality: A Pilot Study on the Use of the Microsoft HoloLens for Live-Streaming from Theatre

A Feasibility Study of HoloLens Ear Image Guidance for Ear Reconstruction

Semi-Automatic Infrared Calibration for Augmented Reality Systems in Surgery

Feasibility of using a low-cost head-mounted augmented reality device in the operating room

STTAR: Surgical Tool Tracking Using Off-the-Shelf Augmented Reality Head-Mounted Displays

Mixed reality based teleoperation and visualization of surgical robotics

Unified Calibration Technique for Augmented-Reality Ultrasound-Guided Interventions

Utility of optical see-through head mounted displays in augmented reality-assisted surgery: A systematic review

Stereoscopic calibration for augmented reality visualization in microscopic surgery

High-precision Three-dimensional Space See-through Surgical Navigation

The Feasibility and Accuracy of Holographic Navigation with Laser Crosshair Simulator Registration on a Mixed-Reality Display

Augmented Reality Surgical Navigation System Integrated with Deep Learning