Abstract:Breast tumor segmentation of ultrasound images provides valuable information of tumors for early detection and diagnosis. Accurate segmentation is challenging due to low image contrast between areas of interest; speckle noises, and large inter-subject variations in tumor shape and size. This paper proposes a novel Multi-scale Dynamic Fusion Network (MDF-Net) for breast ultrasound tumor segmentation. It employs a two-stage end-to-end architecture with a trunk sub-network for multiscale feature selection and a structurally optimized refinement sub-network for mitigating impairments such as noise and inter-subject variation via better feature exploration and fusion. The trunk network is extended from UNet++ with a simplified skip pathway structure to connect the features between adjacent scales. Moreover, deep supervision at all scales, instead of at the finest scale in UNet++, is proposed to extract more discriminative features and mitigate errors from speckle noise via a hybrid loss function. Unlike previous works, the first stage is linked to a loss function of the second stage so that both the preliminary segmentations and refinement subnetworks can be refined together at training. The refinement sub-network utilizes a structurally optimized MDF mechanism to integrate preliminary segmentation information (capturing general tumor shape and size) at coarse scales and explores inter-subject variation information at finer scales. Experimental results from two public datasets show that the proposed method achieves better Dice and other scores over state-of-the-art methods. Qualitative analysis also indicates that our proposed network is more robust to tumor size/shapes, speckle noise and heavy posterior shadows along tumor boundaries. An optional post-processing step is also proposed to facilitate users in mitigating segmentation artifacts. The efficiency of the proposed network is also illustrated on the "Electron Microscopy neural structures segmentation dataset". It outperforms a state-of-the-art algorithm based on UNet-2022 with simpler settings. This indicates the advantages of our MDF-Nets in other challenging image segmentation tasks with small to medium data sizes.

DBL-Net: A dual-branch learning network with information from spatial and frequency domains for tumor segmentation and classification in breast ultrasound image

Automatic tumor segmentation in breast ultrasound images using a dilated fully convolutional network combined with an active contour model.

Breast Tumor Classification in Ultrasound Images by Fusion of Deep Convolutional Neural Network and Shallow LBP Feature

ACL-DUNet: A tumor segmentation method based on multiple attention and densely connected breast ultrasound images

DDRA-Net: Dual-Channel Deep Residual Attention UPerNet for Breast Lesions Segmentation in Ultrasound Images

Tumor Segmentation in Breast Ultrasound Image by Means of Res Path Combined with Dense Connection Neural Network

Fully automatic tumor segmentation of breast ultrasound images with deep learning

Multi-task Learning for Segmentation and Classification of Tumors in 3D Automated Breast Ultrasound Images

Tumor segmentation in automated whole breast ultrasound using bidirectional LSTM neural network and attention mechanism

Tumor Classification in Automated Breast Ultrasound (ABUS) Based on a Modified Extracting Feature Network

DBF-Net: A Dual-Branch Network with Feature Fusion for Ultrasound Image Segmentation

CBAM-RIUnet: Breast Tumor Segmentation With Enhanced Breast Ultrasound and Test-Time Augmentation

Multi-task learning for segmentation and classification of breast tumors from ultrasound images

MDF-Net: A Multi-Scale Dynamic Fusion Network for Breast Tumor Segmentation of Ultrasound Images

Using BI-RADS Stratifications as Auxiliary Information for Breast Masses Classification in Ultrasound Images

An RDAU-NET model for lesion segmentation in breast ultrasound images

Combining a Fully Convolutional Network and an Active Contour Model for Automatic 2D Breast Tumor Segmentation from Ultrasound Images.

Multilevel Perception Boundary-guided Network for Breast Lesion Segmentation in Ultrasound Images

GBE-Net: Global Boundary Enhancement Network for breast lesion segmentation in ultrasound images

Breast Cancer Segmentation From Ultrasound Images Using Deep Dual-Decoder Technology With Attention Network