Abstract:Augmented reality surgery systems are playing an increasing role in the operating room, but applying such systems to neurosurgery presents particular challenges. In addition to using augmented reality technology to display the position of the surgical target position in 3D in real time, the application must also display the scalpel entry point and scalpel orientation, with accurate superposition on the patient. To improve the intuitiveness, efficiency, and accuracy of extra-ventricular drain surgery, this paper proposes an augmented reality surgical navigation system which accurately superimposes the surgical target position, scalpel entry point, and scalpel direction on a patient's head and displays this data on a tablet. The accuracy of the optical measurement system (NDI Polaris Vicra) was first independently tested, and then complemented by the design of functions to help the surgeon quickly identify the surgical target position and determine the preferred entry point. A tablet PC was used to display the superimposed images of the surgical target, entry point, and scalpel on top of the patient, allowing for correct scalpel orientation. Digital imaging and communications in medicine (DICOM) results for the patient's computed tomography were used to create a phantom and its associated AR model. This model was then imported into the application, which was then executed on the tablet. In the preoperative phase, the technician first spent 5-7 min to superimpose the virtual image of the head and the scalpel. The surgeon then took 2 min to identify the intended target position and entry point position on the tablet, which then dynamically displayed the superimposed image of the head, target position, entry point position, and scalpel (including the scalpel tip and scalpel orientation). Multiple experiments were successfully conducted on the phantom, along with six practical trials of clinical neurosurgical EVD. In the 2D-plane-superposition model, the optical measurement system (NDI Polaris Vicra) provided highly accurate visualization (2.01 ± 1.12 mm). In hospital-based clinical trials, the average technician preparation time was 6 min, while the surgeon required an average of 3.5 min to set the target and entry-point positions and accurately overlay the orientation with an NDI surgical stick. In the preparation phase, the average time required for the DICOM-formatted image processing and program import was 120 ± 30 min. The accuracy of the designed augmented reality optical surgical navigation system met clinical requirements, and can provide a visual and intuitive guide for neurosurgeons. The surgeon can use the tablet application to obtain real-time DICOM-formatted images of the patient, change the position of the surgical entry point, and instantly obtain an updated surgical path and surgical angle. The proposed design can be used as the basis for various augmented reality brain surgery navigation systems in the future.

How do I do it? Real-time three-dimensional robotic C-arm navigation for ventriculoperitoneal shunting

Ventriculoatrial Shunt As a Feasible Regimen for Certain Patients of Hydrocephalus: Clinical Features and Surgical Management

Usage of Neuronavigation System to Treat a Case of Traumatic Acute Subdural Hematoma after Two-Side Ventriculoperitoneal Shunt

The Clinical Application of Robot-Assisted Ventriculoperitoneal Shunting in the Treatment of Hydrocephalus

Pre-Clinical Development of Robot-Assisted Ventriculoscopy for 3-D Image Reconstruction and Guidance of Deep Brain Neurosurgery

Real-time 3D Transesophageal Echocardiography for the Placement of Ventriculoatrial Shunt: A Case Series and Technical Note

Electromagnetic Navigation Improves Accuracy and Reduces Complications of Ventriculoperitoneal Shunts in Patients with Idiopathic Normal Pressure Hydrocephalus: A Single-Center Clinical Experience

Intraoperative cone-beam computed tomography for catheter placement verification in pediatric hydrocephalus: technical note

Frameless neuronavigation with computer vision and real-time tracking for bedside external ventricular drain placement: a cadaveric study

Pilot study of a new type of machine vision-assisted stereotactic neurosurgery for EVD placement

Augmented Reality Surgical Navigation System for External Ventricular Drain

Complications Associated With Ventriculoperitoneal Shunt Surgery for Normal Pressure Hydrocephalus Using Stereotactic Navigation and Abdominal Laparoscopy: A Single-Institution Case Series

Freehand stereotactic ventricular catheter insertion for ventriculoperitoneal shunts based on individualized radio-anatomical landmarks

VascularPilot3D: Toward a 3D fully autonomous navigation for endovascular robotics

A novel system for navigation- and robot-assisted craniofacial surgery

The impact of real-time ultrasound guidance for ventricular catheter placement in cerebrospinal fluid shunts – a single center study.

A Novel Remote-Controlled Robotic System For Cerebrovascular Intervention

Improving Successful Cannulation of External Ventricular Drain: 3D-Printed Surgical Guide for Inexperienced Neurosurgeons

Motor Channelling for Safe and Effective Dynamic Constraints in Minimally Invasive Surgery

Motion-adapted Catheter Navigation with Real-Time Instantiation and Improved Visualisation.

Augmented Reality Surgical Navigation System Integrated with Deep Learning