Abstract:Instrument segmentation plays a vital role in 3D ultrasound (US) guided cardiac intervention. Efficient and accurate segmentation during the operation is highly desired since it can facilitate the operation, reduce the operational complexity, and therefore improve the outcome. Nevertheless, current image-based instrument segmentation methods are not efficient nor accurate enough for clinical usage. Lately, fully convolutional neural networks (FCNs), including 2D and 3D FCNs, have been used in different volumetric segmentation tasks. However, 2D FCN cannot exploit the 3D contextual information in the volumetric data, while 3D FCN requires high computation cost and a large amount of training data. Moreover, with limited computation resources, 3D FCN is commonly applied with a patch-based strategy, which is therefore not efficient for clinical applications. To address these, we propose a POI-FuseNet, which consists of a patch-of-interest (POI) selector and a FuseNet. The POI selector can efficiently select the interested regions containing the instrument, while FuseNet can make use of 2D and 3D FCN features to hierarchically exploit contextual information. Furthermore, we propose a hybrid loss function, which consists of a contextual loss and a class-balanced focal loss, to improve the segmentation performance of the network. With the collected challenging ex-vivo dataset on RF-ablation catheter, our method achieved a Dice score of 70.5%, superior to the state-of-the-art methods. In addition, based on the pre-trained model from ex-vivo dataset, our method can be adapted to the in-vivo dataset on guidewire and achieves a Dice score of 66.5% for a different cardiac operation. More crucially, with POI-based strategy, segmentation efficiency is reduced to around 1.3 seconds per volume, which shows the proposed method is promising for clinical use.

Feasibility Study of Catheter Segmentation in 3D Frustum Ultrasounds by DCNN

Improving Catheter Segmentation & Localization in 3D Cardiac Ultrasound Using Direction-Fused FCN

Catheter Segmentation in Three-Dimensional Ultrasound Images by Feature Fusion and Model Fitting

Weakly-supervised Learning for Catheter Segmentation in 3D Frustum Ultrasound

Efficient Catheter Segmentation in 3D Cardiac Ultrasound using Slice-Based FCN With Deep Supervision and F-Score Loss

Automated Catheter Localization in Volumetric Ultrasound Using 3D Patch-Wise U-Net with Focal Loss

CATHETER DETECTION IN 3D ULTRASOUND USING TRIPLANAR-BASED CONVOLUTIONAL NEURAL NETWORKS

Feature Study on Catheter Detection in Three-Dimensional Ultrasound

Catheter Detection in 3D Ultrasound by CNN

Catheter localization in 3D ultrasound using voxel-of-interest-based ConvNets for cardiac intervention

3D Pyramidal Densely Connected Network with Cross-Frame Uncertainty Guidance for Intravascular Ultrasound Sequence Segmentation.

Deep Q-Network-Driven Catheter Segmentation in 3D US by Hybrid Constrained Semi-Supervised Learning and Dual-UNet

Efficient and Robust Instrument Segmentation in 3D Ultrasound Using Patch-of-Interest-FuseNet with Hybrid Loss

Fast Catheter Segmentation from Echocardiographic Sequences Based on Segmentation from Corresponding X-ray Fluoroscopy for Cardiac Catheterization Interventions.

Efficient Medical Instrument Detection in 3D Volumetric Ultrasound Data

Automatic needle segmentation in 3D ultrasound images using 3D improved Hough transform

Automatic Tumor Segmentation in 3D Automated Breast Ultrasound Using Convolutional Neural Network

Automatic Coronary Artery Segmentation of CCTA Images with an Efficient Feature-Fusion-and-Rectification 3D-Unet

CathFlow: Self-Supervised Segmentation of Catheters in Interventional Ultrasound Using Optical Flow and Transformers

Automatic needle segmentation in 3D ultrasound images using 3D Hough transform

ACNN: a Full Resolution DCNN for Medical Image Segmentation