Abstract:This paper presents a sensor fusion-based surgical instrument tracking system which uses multiple monocular modules. The system is an optical tracking system, which has been widely utilized in the image-guide surgery because of its high accuracy and precision. However, the line-of-sight occlusion problem which remains unresolved in current systems frustrates surgeons during the operation. To address this challenge, we propose a surgical instrument tracking system based on multiple monocular modules. The rationale is to enable the system to track the surgical instruments inside the surgical site from different views. Three sensor fusion algorithms are proposed to integrate all sensor data from the multimodule system. In order to show the feasibility of the tracking system, simulations and comparison experiments have been carried out. The intensive investigation results give a practical instruction to the real implementation of the proposed system in image-guided interventions. Moreover, an image-guided surgical trial by using a cadaver head has been carried out to validate the feasibility of the proposed system and the tracking algorithms. The results from both the simulation and the cadaver trial have shown the effectiveness of the proposed robust fusion algorithm. Note to Practitioners—Optical tracking system (OTS) for image-guided surgery has suffered from line-of-sight (LoS) occlusion and field-of-view (FoV) limitation problems for a long time; nevertheless, no satisfactory solution has been given yet. In the real-world practice, surgeons and assistants have to manually adjust the position and orientation of the optical tracker during operation. This interrupts the surgery process and degrades the efficiency of the surgical procedure. Instead of using one tracker for the image-guided surgery, our approach is to utilize distributed modular trackers to avoid LoS occlusion and maintain FoV of the OTS. Based on our previous work, this paper is to provide an optimal fusion algorithm that takes the advantage of the multiple modules and validate the system in both the simulation and the real-world surgical environment.

A solution of multiple targets tracking for linear CCD based optical positioning system applied to image guided surgery

Towards Tracking by 2D-Target Registration for Surgical Optical Tracking System

Linear CCD Based Optical Tracking Using Stereo Correspondence Algorithm

Wearable Surgical Optical Tracking System Based on Multi-Modular Sensor Fusion

Surgical Instrument Tracking by Multiple Monocular Modules and a Sensor Fusion Approach

An intelligent tracking system for surgical instruments in complex surgical environment

Tracking-by-Registration: A Robust Approach for Optical Tracking System in Surgical Navigation.

Robust Stereo Matching Algorithm Based on Spatial Constraints under Rectification.

Pipeline Architecture and Parallel Computation-Based Real-Time Stereovision Tracking System for Surgical Navigation

Design of an Accurate Near Infrared Optical Tracking System in Surgical Navigation

High Accuracy Visible Light Positioning Based on Multi-target Tracking Algorithm

Robust Stereo-Match Algorithm for Infrared Markers in Image-Guided Optical Tracking System.

A Novel Marker Tracking Method Based on Extended Kalman Filter for Multi-Camera Optical Tracking Systems

Cognitive tracking of surgical instruments based on stereo vision and depth sensing

An Optical Tracking System with Defaced Marker Detection.

Real-time Surgical Tool Tracking and Pose Estimation Using a Hybrid Cylindrical Marker.

Real-Time Optimization-Based Tracking Method for Active Optical Navigation in Orthopedic Surgeries: An Experimental Study

Exploring Multi-Target Tracking Method Using Spatially Multiplexed Superposition Imaging Technique

Optimization-Based Tracking Method for Active Navigation in Orthopedic Surgeries

Analysis of precision in tumor tracking based on optical positioning system during radiotherapy.

Multiple Infrared Markers Based Real-Time Stereo Vision Positioning System for Surgical Navigation