Abstract:Instrument segmentation plays a vital role in 3D ultrasound (US) guided cardiac intervention. Efficient and accurate segmentation during the operation is highly desired since it can facilitate the operation, reduce the operational complexity, and therefore improve the outcome. Nevertheless, current image-based instrument segmentation methods are not efficient nor accurate enough for clinical usage. Lately, fully convolutional neural networks (FCNs), including 2D and 3D FCNs, have been used in different volumetric segmentation tasks. However, 2D FCN cannot exploit the 3D contextual information in the volumetric data, while 3D FCN requires high computation cost and a large amount of training data. Moreover, with limited computation resources, 3D FCN is commonly applied with a patch-based strategy, which is therefore not efficient for clinical applications. To address these, we propose a POI-FuseNet, which consists of a patch-of-interest (POI) selector and a FuseNet. The POI selector can efficiently select the interested regions containing the instrument, while FuseNet can make use of 2D and 3D FCN features to hierarchically exploit contextual information. Furthermore, we propose a hybrid loss function, which consists of a contextual loss and a class-balanced focal loss, to improve the segmentation performance of the network. With the collected challenging ex-vivo dataset on RF-ablation catheter, our method achieved a Dice score of 70.5%, superior to the state-of-the-art methods. In addition, based on the pre-trained model from ex-vivo dataset, our method can be adapted to the in-vivo dataset on guidewire and achieves a Dice score of 66.5% for a different cardiac operation. More crucially, with POI-based strategy, segmentation efficiency is reduced to around 1.3 seconds per volume, which shows the proposed method is promising for clinical use.

Weakly-supervised Learning for Catheter Segmentation in 3D Frustum Ultrasound

Feasibility Study of Catheter Segmentation in 3D Frustum Ultrasounds by DCNN

Efficient Catheter Segmentation in 3D Cardiac Ultrasound using Slice-Based FCN With Deep Supervision and F-Score Loss

Deep Q-Network-Driven Catheter Segmentation in 3D US by Hybrid Constrained Semi-Supervised Learning and Dual-UNet

Catheter Segmentation in Three-Dimensional Ultrasound Images by Feature Fusion and Model Fitting

Segmentation of Cardiac Tissues and Organs for CCTA Images Based on a Deep Learning Model

Improving Catheter Segmentation & Localization in 3D Cardiac Ultrasound Using Direction-Fused FCN

Automated Catheter Localization in Volumetric Ultrasound Using 3D Patch-Wise U-Net with Focal Loss

Medical Instrument Segmentation in 3D US by Hybrid Constrained Semi-Supervised Learning

CATHETER DETECTION IN 3D ULTRASOUND USING TRIPLANAR-BASED CONVOLUTIONAL NEURAL NETWORKS

Catheter localization in 3D ultrasound using voxel-of-interest-based ConvNets for cardiac intervention

Feature Study on Catheter Detection in Three-Dimensional Ultrasound

Fast Catheter Segmentation from Echocardiographic Sequences Based on Segmentation from Corresponding X-ray Fluoroscopy for Cardiac Catheterization Interventions.

Catheter Detection in 3D Ultrasound by CNN

3D Pyramidal Densely Connected Network with Cross-Frame Uncertainty Guidance for Intravascular Ultrasound Sequence Segmentation.

PA-Seg: Learning from Point Annotations for 3D Medical Image Segmentation using Contextual Regularization and Cross Knowledge Distillation

Weakly-Supervised White and Grey Matter Segmentation in 3D Brain Ultrasound

Efficient and Robust Instrument Segmentation in 3D Ultrasound Using Patch-of-Interest-FuseNet with Hybrid Loss

CathFlow: Self-Supervised Segmentation of Catheters in Interventional Ultrasound Using Optical Flow and Transformers

Supervised Machine Learning for Coronary Artery Lumen Segmentation in Intravascular Ultrasound Images.

Weakly-Supervised Learning via Multi-Lateral Decoder Branching for Guidewire Segmentation in Robot-Assisted Cardiovascular Catheterization