Abstract:OBJECTIVE A major obstacle to improving bedside neurosurgical procedure safety and accuracy with image guidance technologies is the lack of a rapidly deployable, real-time registration and tracking system for a moving patient. This deficiency explains the persistence of freehand placement of external ventricular drains, which has an inherent risk of inaccurate positioning, multiple passes, tract hemorrhage, and injury to adjacent brain parenchyma. Here, the authors introduce and validate a novel image registration and real-time tracking system for frameless stereotactic neuronavigation and catheter placement in the nonimmobilized patient. METHODS Computer vision technology was used to develop an algorithm that performed near-continuous, automatic, and marker-less image registration. The program fuses a subject’s preprocedure CT scans to live 3D camera images (Snap-Surface), and patient movement is incorporated by artificial intelligence–driven recalibration (Real-Track). The surface registration error (SRE) and target registration error (TRE) were calculated for 5 cadaveric heads that underwent serial movements (fast and slow velocity roll, pitch, and yaw motions) and several test conditions, such as surgical draping with limited anatomical exposure and differential subject lighting. Six catheters were placed in each cadaveric head (30 total placements) with a simulated sterile technique. Postprocedure CT scans allowed comparison of planned and actual catheter positions for user error calculation. RESULTS Registration was successful for all 5 cadaveric specimens, with an overall mean (± standard deviation) SRE of 0.429 ± 0.108 mm for the catheter placements. Accuracy of TRE was maintained under 1.2 mm throughout specimen movements of low and high velocities of roll, pitch, and yaw, with the slowest recalibration time of 0.23 seconds. There were no statistically significant differences in SRE when the specimens were draped or fully undraped (p = 0.336). Performing registration in a bright versus a dimly lit environment had no statistically significant effect on SRE (p = 0.742 and 0.859, respectively). For the catheter placements, mean TRE was 0.862 ± 0.322 mm and mean user error (difference between target and actual catheter tip) was 1.674 ± 1.195 mm. CONCLUSIONS This computer vision–based registration system provided real-time tracking of cadaveric heads with a recalibration time of less than one-quarter of a second with submillimetric accuracy and enabled catheter placements with millimetric accuracy. Using this approach to guide bedside ventriculostomy could reduce complications, improve safety, and be extrapolated to other frameless stereotactic applications in awake, nonimmobilized patients.

Clinical Patient Tracking in the Presence of Transient and Permanent Occlusions via Geodesic Feature

Exploit Spatiotemporal Contextual Information for 3D Single Object Tracking Via Memory Networks

Towards Non-Invasive Patient Tracking: Optical Image Analysis For Spine Tracking During Spinal Surgery Procedures

Towards Optical Imaging for Spine Tracking without Markers in Navigated Spine Surgery

Spatiotemporal Strategies for Joint Segmentation and Motion Tracking from Cardiac Image Sequences

Multi-View 3D Skin Feature Recognition and Localization for Patient Tracking in Spinal Surgery Applications

Robust tracking of deformable anatomical structures with severe occlusions using deformable geometrical primitives

Frameless neuronavigation with computer vision and real-time tracking for bedside external ventricular drain placement: a cadaveric study

Context Specific Descriptors for Tracking Deforming Tissue.

Deep Active Contours for Real-time 6-Dof Object Tracking

Human Spine Motion Capture using Perforated Kinesiology Tape

Markerless Inside-Out Tracking for Interventional Applications

Real-time tracking of vertebral body movement with implantable reference microsensors

Probabilistic tracking of affine-invariant anisotropic regions.

GLAMR: Global Occlusion-Aware Human Mesh Recovery with Dynamic Cameras

Holographic patient tracking after bed movement for augmented reality neuronavigation using a head-mounted display

A Quasi-Spherical Triangle-Based Approach for Efficient 3-D Soft-Tissue Motion Tracking

A-MFST: Adaptive Multi-Flow Sparse Tracker for Real-Time Tissue Tracking Under Occlusion

Automatic registration with continuous pose updates for marker-less surgical navigation in spine surgery

Visual Tracking Of Players Through Occlusions In Low Resolution

Markerless Motion Capture Using Appearance and Inertial Data