Abstract:Surgical navigation systems involve various technologies of segmentation, calibration, registration, tracking, and visualization. These systems aim to superimpose multisource information in the surgical field and provide surgeons with a composite overlay (augmented-reality) view, improving the operative precision and experience. Surgical 3-D tracking is the key to build these systems. Unfortunately, surgical 3-D tracking is still a challenge to endoscopic and robotic navigation systems and easily gets trapped in image artifacts, tissue deformation, and inaccurate positional (e.g., electromagnetic) sensor measurements. This work explores a new monocular endoscope hybrid 3-D tracking method called spatially constrained adaptive differential evolution that combines two spatial constraints with observation-recall adaptive propagation and observation-based fitness computing for stochastic optimization. Specifically, we spatially constraint inaccurate electromagnetic sensor measurements to the centerline of anatomical tubular structures to keep them physically locating inside the tubes, as well as interpolate these measurements to reduce jitter errors for smooth 3-D tracking. We then propose observation-recall adaptive propagation with fitness computing to precisely fuse the constrained sensor measurements, preoperative images, and endoscopic video sequences for accurate hybrid 3-D tracking. Additionally, we also propose a new marker-free hybrid registration strategy to precisely align positional sensor measurements to preoperative images. Our new framework was evaluated on a large amount of clinical data acquired from various surgical endoscopic procedures, with the experimental results showing that it certainly outperforms current surgical 3-D approaches. In particular, the position and rotation errors were significantly reduced from (6.55, 11.4) to (3.02 mm, 8.54 °).

Endoscope-based Hybrid Navigation System for Minimally Invasive Ventral Spine Surgeries.

Endoscope As A Tracking Tool For Computer Assisted Minimally Invasive Ventral Spine Surgeries

Applications of navigation in full-endoscopic spine surgery

A System for Video-Based Navigation for Endoscopic Endonasal Skull Base Surgery

A New Simple, Cost-Effective Navigation System (EASY Navigator) for Neurosurgical Interventions

Toward Video-Based Navigation for Endoscopic Endonasal Skull Base Surgery

Multisource Differential Fusion Driven Monocular Endoscope Hybrid 3-D Tracking for Advanced Endoscopic Navigation Surgery

Navigation Techniques in Endoscopic Spine Surgery

Fusion of Augmented Reality Imaging with the Endoscopic View for Endonasal Skull Base Surgery; a Novel Application for Surgical Navigation Based on Intraoperative Cone Beam Computed Tomography and Optical Tracking

Towards Non-Invasive Patient Tracking: Optical Image Analysis For Spine Tracking During Spinal Surgery Procedures

Towards Optical Imaging for Spine Tracking without Markers in Navigated Spine Surgery

A Novel Endoscopic Navigation System: Simultaneous Endoscope and Radial Ultrasound Probe Tracking Without External Trackers.

Autonomous Magnetic Navigation in Endoscopic Image Mosaics

Hybrid optical-vision tracking in laparoscopy: accuracy of navigation and ultrasound reconstruction

Novel Method for Registering an Endoscope in an Operative Setup

The Future of Endoscopic Navigation: A Review of Advanced Endoscopic Vision Technology

Navigation in Endoscopic Soft Tissue Surgery: Perspectives and Limitations

Optimization-Based Tracking Method for Active Navigation in Orthopedic Surgeries

A lumen-adapted navigation scheme with spatial awareness from monocular vision for autonomous robotic endoscopy

Toward Human-Out-of-the-Loop Endoscope Navigation Based on Context Awareness for Enhanced Autonomy in Robotic Surgery

Autonomous Intelligent Navigation for Flexible Endoscopy Using Monocular Depth Guidance and 3-D Shape Planning