Abstract:Objective. Automated biopsy needle segmentation in 3D ultrasound images can be used for biopsy navigation, but it is quite challenging due to the low ultrasound image resolution and interference similar to the needle appearance. For 3D medical image segmentation, such deep learning (DL) networks as convolutional neural network (CNN) and transformer have been investigated. However, these segmentation methods require numerous labeled data for training, have difficulty in meeting the real-time segmentation requirement and involve high memory consumption. Approach. In this paper, we have proposed the temporal information-based semi-supervised training framework for fast and accurate needle segmentation. Firstly, a novel circle transformer module based on the static and dynamic features has been designed after the encoders for extracting and fusing the temporal information. Then, the consistency constraints of the outputs before and after combining temporal information are proposed to provide the semi-supervision for the unlabeled volume. Finally, the model is trained using the loss function which combines the cross-entropy and Dice similarity coefficient (DSC) based segmentation loss with mean square error based consistency loss. The trained model with the single ultrasound volume input is applied to realize the needle segmentation in ultrasound volume. Main results. Experimental results on three needle ultrasound datasets acquired during the beagle biopsy show that our approach is superior to the most competitive mainstream temporal segmentation model and semi-supervised method by providing higher DSC (77.1% vs 76.5%), smaller needle tip position (1.28mm vs 1.87mm) and length (1.78mm vs 2.19mm) errors on the kidney dataset as well as DSC (78.5% vs 76.9%), needle tip position (0.86mm vs 1.12mm) and length (1.01mm vs 1.26mm) errors on the prostate dataset. Significance. The proposed method can significantly enhance needle segmentation accuracy by training with sequential images at no additional cost. This enhancement may further improve the effectiveness of biopsy navigation systems.

Needle Segmentation Using the 3D Hough Transform in 3D Ultrasound Images

Needle Segmentation in US Images Based on Real-time Gray-scale Hough Transformation

Three-Dimensional Stitching of Binocular Endoscopic Images Based on Feature Points

3D Ultrasound Reconstruction Based on Rotational Scanning Coping with Calibration Uncertainty

Automatic Spinal Ultrasound Image Segmentation and Deployment for Real-time Spine Volumetric Reconstruction

Catheter Segmentation in Three-Dimensional Ultrasound Images by Feature Fusion and Model Fitting

Feasibility Study of Catheter Segmentation in 3D Frustum Ultrasounds by DCNN

Reconstruction Algorithms and Realization of Freehand 3D Ultrasonic

A temporal enhanced semi-supervised training framework for needle segmentation in 3D ultrasound images

Efficient Medical Instrument Detection in 3D Volumetric Ultrasound Data

Three-Dimensional Reconstruction of Ultrasound Images Based on Area Iteration.

Automated Detection of the Fetal Brain Midline and the Fetal Skull in 3-D Ultrasound Images Using the Modified Hough Transform

Needle Segmentation Using GAN: Restoring Thin Instrument Visibility in Robotic Ultrasound

Segmentation MC Algorithm-Based Method for Ultrasound Image 3-D Reconstruction

Weakly supervised multi-needle detection in 3D ultrasound images with bidirectional convolutional sparse coding

Improving Catheter Segmentation & Localization in 3D Cardiac Ultrasound Using Direction-Fused FCN

Robust Segmentation of Various Anatomies in 3D Ultrasound Using Hough Forests and Learned Data Representations

Local-global active contour model based on tensor-based representation for 3D ultrasound vessel segmentation

Weakly-supervised Learning for Catheter Segmentation in 3D Frustum Ultrasound

Deep Learning-based Breast Tumor Detection and Segmentation in 3D Ultrasound Image

Automatic and accurate needle detection in 2D ultrasound during robot-assisted needle insertion process