Abstract:Objective. Automated biopsy needle segmentation in 3D ultrasound images can be used for biopsy navigation, but it is quite challenging due to the low ultrasound image resolution and interference similar to the needle appearance. For 3D medical image segmentation, such deep learning (DL) networks as convolutional neural network (CNN) and transformer have been investigated. However, these segmentation methods require numerous labeled data for training, have difficulty in meeting the real-time segmentation requirement and involve high memory consumption. Approach. In this paper, we have proposed the temporal information-based semi-supervised training framework for fast and accurate needle segmentation. Firstly, a novel circle transformer module based on the static and dynamic features has been designed after the encoders for extracting and fusing the temporal information. Then, the consistency constraints of the outputs before and after combining temporal information are proposed to provide the semi-supervision for the unlabeled volume. Finally, the model is trained using the loss function which combines the cross-entropy and Dice similarity coefficient (DSC) based segmentation loss with mean square error based consistency loss. The trained model with the single ultrasound volume input is applied to realize the needle segmentation in ultrasound volume. Main results. Experimental results on three needle ultrasound datasets acquired during the beagle biopsy show that our approach is superior to the most competitive mainstream temporal segmentation model and semi-supervised method by providing higher DSC (77.1% vs 76.5%), smaller needle tip position (1.28mm vs 1.87mm) and length (1.78mm vs 2.19mm) errors on the kidney dataset as well as DSC (78.5% vs 76.9%), needle tip position (0.86mm vs 1.12mm) and length (1.01mm vs 1.26mm) errors on the prostate dataset. Significance. The proposed method can significantly enhance needle segmentation accuracy by training with sequential images at no additional cost. This enhancement may further improve the effectiveness of biopsy navigation systems.

Motion Informed Needle Segmentation in Ultrasound Images

Robust Needle Localization and Enhancement Algorithm for Ultrasound by Deep Learning and Beam Steering Methods

A temporal enhanced semi-supervised training framework for needle segmentation in 3D ultrasound images

Optical Flow-Based Tracking of Needles and Needle-Tip Localization Using Circular Hough Transform in Ultrasound Images

Automatic and accurate needle detection in 2D ultrasound during robot-assisted needle insertion process

Needle tracking in low-resolution ultrasound volumes using deep learning

A Novel Method for Enhanced Needle Localization Using Ultrasound-Guidance

Invisible Needle Detection in Ultrasound: Leveraging Mechanism-Induced Vibration

Needle Detection and Localisation for Robot‐assisted Subretinal Injection Using Deep Learning

MLESAC Based Localization of Needle Insertion Using 2D Ultrasound Images

Automatic needle segmentation in 3D ultrasound images

Needle Segmentation in Volumetric Optical Coherence Tomography Images for Ophthalmic Microsurgery

Automatic Needle Segmentation in Three-Dimensional Ultrasound Images Using Two Orthogonal Two-Dimensional Image Projections

Biopsy Needle Segmentation using Deep Networks on inhomogeneous Ultrasound Images.

A CNN Segmentation-Based Approach to Object Detection and Tracking in Ultrasound Scans with Application to the Vagus Nerve Detection

Needle Tip Tracking Based on Optical Imaging and AI

Needle Segmentation Using GAN: Restoring Thin Instrument Visibility in Robotic Ultrasound

Guidewire Segmentation in 4D Ultrasound Sequences Using Recurrent Fully Convolutional Networks

Medical needle tip tracking based on Optical Imaging and AI

Improving Needle Tip Tracking and Detection in Ultrasound-based Navigation System Using Deep Learning-enabled Approach

Needle Segmentation in 3D Ultrasound Images Based on Phase Grouping