Abstract:This paper presents a sensor fusion-based surgical instrument tracking system which uses multiple monocular modules. The system is an optical tracking system, which has been widely utilized in the image-guide surgery because of its high accuracy and precision. However, the line-of-sight occlusion problem which remains unresolved in current systems frustrates surgeons during the operation. To address this challenge, we propose a surgical instrument tracking system based on multiple monocular modules. The rationale is to enable the system to track the surgical instruments inside the surgical site from different views. Three sensor fusion algorithms are proposed to integrate all sensor data from the multimodule system. In order to show the feasibility of the tracking system, simulations and comparison experiments have been carried out. The intensive investigation results give a practical instruction to the real implementation of the proposed system in image-guided interventions. Moreover, an image-guided surgical trial by using a cadaver head has been carried out to validate the feasibility of the proposed system and the tracking algorithms. The results from both the simulation and the cadaver trial have shown the effectiveness of the proposed robust fusion algorithm. Note to Practitioners—Optical tracking system (OTS) for image-guided surgery has suffered from line-of-sight (LoS) occlusion and field-of-view (FoV) limitation problems for a long time; nevertheless, no satisfactory solution has been given yet. In the real-world practice, surgeons and assistants have to manually adjust the position and orientation of the optical tracker during operation. This interrupts the surgery process and degrades the efficiency of the surgical procedure. Instead of using one tracker for the image-guided surgery, our approach is to utilize distributed modular trackers to avoid LoS occlusion and maintain FoV of the OTS. Based on our previous work, this paper is to provide an optimal fusion algorithm that takes the advantage of the multiple modules and validate the system in both the simulation and the real-world surgical environment.

Online occlusion-free optimization scheme for active optical navigation system in robotic orthopedic surgeries

An Occlusion-Free Intraoperative Active Navigation System for Orthopedic Surgery

Spatially Compact Visual Navigation System for Automated Suturing Robot Towards Oral and Maxillofacial Surgery

Spatially Compact Visual Navigation System for Automated Suturing Robot Toward Oral and Maxillofacial Surgery

A low-cost, open-source-based optical surgical navigation system using stereoscopic vision

Real-time Navigation in Orthognathic Surgery.

Visual servoing control for robot-assisted micro-invasive surgery systems based on optical positioning

A New Forecasting Kinematic Algorithm of Automatic Navigation for A Laparoscopic Minimally Invasive Surgical Robotic System

Automatic Tracking Motion Based on Flexible Forbidden Virtual Fixtures Design in Robot Assisted Nasal Surgery

Tracking-by-Registration: A Robust Approach for Optical Tracking System in Surgical Navigation.

Automatic Surgical Field of View Control in Robot-Assisted Nasal Surgery

Robotic Navigation Autonomy for Subretinal Injection via Intelligent Real-Time Virtual iOCT Volume Slicing

Real-Time Marker-Free Patient Registration and Image-Based Navigation Using Stereovision for Dental Surgery.

A Novel Precise Optical Navigation System for Craniomaxillofacial Surgery Registered With an Occlusal Splint

Surgical Instrument Tracking by Multiple Monocular Modules and a Sensor Fusion Approach

Constrained Motion Planning for a Robotic Endoscope Holder based on Hierarchical Quadratic Programming

Intraoperative Surgical Navigation Based On Laser Scanner For Image-Guided Oral And Maxillofacial Surgery

Data-driven Holistic Framework for Automated Laparoscope Optimal View Control with Learning-based Depth Perception

A Robust Pose Optimization Scheme With Spatial Geometry Awareness for Hybrid Bronchoscopic Navigation

A new method of surgical navigation for orthognathic surgery: optical tracking guided free-hand repositioning of the maxillomandibular complex.

Safety Tracking Motion Control Based on Forbidden Virtual Fixtures in Robot Assisted Nasal Surgery.