Abstract:Instrument segmentation plays a vital role in 3D ultrasound (US) guided cardiac intervention. Efficient and accurate segmentation during the operation is highly desired since it can facilitate the operation, reduce the operational complexity, and therefore improve the outcome. Nevertheless, current image-based instrument segmentation methods are not efficient nor accurate enough for clinical usage. Lately, fully convolutional neural networks (FCNs), including 2D and 3D FCNs, have been used in different volumetric segmentation tasks. However, 2D FCN cannot exploit the 3D contextual information in the volumetric data, while 3D FCN requires high computation cost and a large amount of training data. Moreover, with limited computation resources, 3D FCN is commonly applied with a patch-based strategy, which is therefore not efficient for clinical applications. To address these, we propose a POI-FuseNet, which consists of a patch-of-interest (POI) selector and a FuseNet. The POI selector can efficiently select the interested regions containing the instrument, while FuseNet can make use of 2D and 3D FCN features to hierarchically exploit contextual information. Furthermore, we propose a hybrid loss function, which consists of a contextual loss and a class-balanced focal loss, to improve the segmentation performance of the network. With the collected challenging ex-vivo dataset on RF-ablation catheter, our method achieved a Dice score of 70.5%, superior to the state-of-the-art methods. In addition, based on the pre-trained model from ex-vivo dataset, our method can be adapted to the in-vivo dataset on guidewire and achieves a Dice score of 66.5% for a different cardiac operation. More crucially, with POI-based strategy, segmentation efficiency is reduced to around 1.3 seconds per volume, which shows the proposed method is promising for clinical use.

Lightweight Double Attention-Fused Networks for Intraoperative Stent Segmentation

A Lightweight Recurrent Attention Network for Real-Time Guidewire Segmentation and Tracking in Interventional X-Ray Fluoroscopy.

Attention-Guided Lightweight Network for Real-Time Segmentation of Robotic Surgical Instruments

DFA-Net: Dual multi-scale feature aggregation network for vessel segmentation in X-ray digital subtraction angiography

Multi-Task Deep Convolutional Neural Network for the Segmentation of Type B Aortic Dissection

LDCNet: Lightweight dynamic convolution network for laparoscopic procedures image segmentation

Centerline-supervision multi-task learning network for coronary angiography segmentation

3D Pyramidal Densely Connected Network with Cross-Frame Uncertainty Guidance for Intravascular Ultrasound Sequence Segmentation.

Real-time guidewire tracking and segmentation in intraoperative x-ray

A Deep Segmentation Network of Multi-Scale Feature Fusion Based on Attention Mechanism for IVOCT Lumen Contour

A Real-Time Multifunctional Framework for Guidewire Morphological and Positional Analysis in Interventional X-Ray Fluoroscopy

SPIRONet: Spatial-Frequency Learning and Topological Channel Interaction Network for Vessel Segmentation

Automated segmentation of metal stent and bioresorbable vascular scaffold in intravascular optical coherence tomography images using deep learning architectures

Fully automated intracranial aneurysm detection and segmentation from digital subtraction angiography series using an end-to-end spatiotemporal deep neural network

Abdominal Aortic Aneurysm Segmentation with a Small Number of Training Subjects

LightAWNet: Lightweight adaptive weighting network based on dynamic convolutions for medical image segmentation

Robust Landmark-based Stent Tracking in X-ray Fluoroscopy

Real-Time Guidewire Segmentation And Tracking In Endovascular Aneurysm Repair

PaI-Net: A Modified U-Net of Reducing Semantic Gap for Surgical Instrument Segmentation

Efficient and Robust Instrument Segmentation in 3D Ultrasound Using Patch-of-Interest-FuseNet with Hybrid Loss

ADF-Net: A novel adaptive dual-stream encoding and focal attention decoding network for skin lesion segmentation