Abstract:Background and objective: Real time localization and shape extraction of guide wire in fluoroscopic images plays a significant role in the image guided navigation during cerebral and cardiovascular interventions. Given the complexity of the non-rigid and sparse characteristics of guide wire structures, and the low SNR(Signal Noise Ratio) of fluoroscopic images, traditional handcrafted guide wire tracking methods such as Frangi filter, Hessian Matrix, or open active contour usually produce insufficient accuracy with high computational cost, and may require extra human intervention for proper initialization or correction. The application of deep learning techniques to guide wire tracking is reported to produce significant improvement in guide wire localization accuracy, but the heavy calculation cost is still a concern. Method: In this paper we propose a two phase deep learning scheme for accurate and real time guide wire shape extraction in fluoroscopic sequences. In the first phase we train a guide wire localization network to pick image regions containing guide wire structures. From the picked image regions, we train a guide wire shape extraction network in the second phase to mark the guide wire pixels. Results: We report that our proposed method can accurately distinguish about 99% of the guide wire structure pixels, and the falsely detected pixels in the background are close to 0, the average offset from the ground truth is less than 1 pixel. For extreme cases where traditional handcrafted method may fail, our proposed method can still extract guide wire completely and accurately. The processing time for a 512 × 512 pixels image is 78 ms. Conclusion: Compared with the traditional filtering based method from our previous work, we show that our proposed method can achieve more accurate and stable performance. Compared with other deep learning methods, our proposed method significantly improve calculation efficiency to meet the real time requirement of clinical applications.

Real Time Detection and Tracking of Guide Wire/Catheter for Interventional Embolization Robot based on Deep Learning

Vision-Based Real-Time Tracking of Surgical Instruments in Robot-Assisted Laparoscopic Surgery

Real-time guidewire tracking and segmentation in intraoperative x-ray

A Deep-Learning-Based Guidewire Compliant Control Method for the Endovascular Surgery Robot

Machine Learning-Based Surgical State Perception and Collaborative Control for a Vascular Interventional Robot

Guide-wire Detecting Using a Modified Cascade Classifier in Interventional Radiology

Study on Autonomous Delivery of Guidewire Based on Improved YOLOV5s on Vascular Model Platform

Transferring Virtual Surgical Skills to Reality: AI Agents Mastering Surgical Decision Making in Vascular Interventional Robotics

A Surgeon Preference-Guided Autonomous Instrument Tracking Method With a Robotic Flexible Endoscope Based on dVRK Platform

Towards real time guide wire shape extraction in fluoroscopic sequences: A two phase deep learning scheme to extract sparse curvilinear structures

Guidewire Feeding Method Based on Deep Reinforcement Learning for Vascular Intervention Robot

Design and Performance Evaluation of Real-time Endovascular Interventional Surgical Robotic System with High Accuracy

A novel noncontact detection method of surgeon’s operation for a master-slave endovascular surgery robot

Operation and Force Analysis of the Guide Wire in a Minimally Invasive Vascular Interventional Surgery Robot System

Deep Learning Assisted Robotic Magnetic Anchored and Guided Endoscope for Real-Time Instrument Tracking

Real Time Surgical Instrument Object Detection Using YOLOv7

Learning-based Endovascular Navigation Through the Use of Non-Rigid Registration for Collaborative Robotic Catheterization

A vascular interventional surgical robot based on surgeon’s operating skills

Endovascular Tool Segmentation with Multi-lateral Branched Network during Robot-assisted Catheterization

Design of Vascular Interventional Surgical Robot with Network Time Delay Analysis for Master-slave Teleoperation

Design and Performance Evaluation of Interventional Surgery Robot System