Abstract:Background: Breast ultrasound (BUS) imaging is one of the most prevalent approaches for the detection of breast cancers. Tumor segmentation of BUS images can facilitate doctors in localizing tumors and is a necessary step for computer-aided diagnosis systems. While the majority of clinical BUS scans are normal ones without tumors, segmentation approaches such as U-Net often predict mass regions for these images. Such false-positive problem becomes serious if a fully automatic artificial intelligence system is used for routine screening. Methods: In this study, we proposed a novel model which is more suitable for routine BUS screening. The model contains a classification branch that determines whether the image is normal or with tumors, and a segmentation branch that outlines tumors. Two branches share the same encoder network. We also built a new dataset that contains 1600 BUS images from 625 patients for training and a testing dataset with 130 images from 120 patients for testing. The dataset is the largest one with pixel-wise masks manually segmented by experienced radiologists. Our code is available at https://github.com/szhangNJU/BUS_segmentation. Results: The area under the receiver operating characteristic curve (AUC) for classifying images into normal/abnormal categories was 0.991. The dice similarity coefficient (DSC) for segmentation of mass regions was 0.898, better than the state-of-the-art models. Testing on an external dataset gave a similar performance, demonstrating a good transferability of our model. Moreover, we simulated the use of the model in actual clinic practice by processing videos recorded during BUS scans; the model gave very low false-positive predictions on normal images without sacrificing sensitivities for images with tumors. Conclusions: Our model achieved better segmentation performance than the state-of-the-art models and showed a good transferability on an external test set. The proposed deep learning architecture holds potential for use in fully automatic BUS health screening.

A Multimodal Fusion Model for Breast Tumor Segmentation in Ultrasound Images

Breast Tumor Classification in Ultrasound Images by Fusion of Deep Convolutional Neural Network and Shallow LBP Feature

Fuzzy Semantic Segmentation of Breast Ultrasound Image with Breast Anatomy Constraints

MsGoF: Breast lesion classification on ultrasound images by multi-scale gradational-order fusion framework

Bilateral Cross-Modal Fusion Network for Multimodal Whole-Body Tumor Segmentation

MFU-Net: a deep multimodal fusion network for breast cancer segmentation with dual-layer spectral detector CT

Automatic tumor segmentation in breast ultrasound images using a dilated fully convolutional network combined with an active contour model.

Automated Breast Tumor Detection and Segmentation with a Novel Computational Framework of Whole Ultrasound Images

Multi-task learning for segmentation and classification of breast tumors from ultrasound images

Anatomy-guided Weakly Supervised Breast Lesion Segmentation Fusing Contour and Semantic Information.

A Cross-attention and Multi-level Feature Fusion Network for Breast Lesion Segmentation in Ultrasound Images

Automated Segmentation of Ultrasonic Breast Lesions Using Statistical Texture Classification and Active Contour Based on Probability Distance.

Automatic Identification of Breast Ultrasound Image Based on Supervised Block-Based Region Segmentation Algorithm and Features Combination Migration Deep Learning Model

Multi-task Learning for Segmentation and Classification of Tumors in 3D Automated Breast Ultrasound Images

Boundary-guided and Region-aware Network with Global Scale-adaptive for Accurate Segmentation of Breast Tumors in Ultrasound Images

Fully automatic tumor segmentation of breast ultrasound images with deep learning

Deep learning‐based multimodal fusion network for segmentation and classification of breast cancers using B‐mode and elastography ultrasound images

Automatic breast ultrasound (ABUS) tumor segmentation based on global and local feature fusion

A2DMN: Anatomy-Aware Dilated Multiscale Network for Breast Ultrasound Semantic Segmentation

Breast Ultrasound Tumor Classification Using a Hybrid Multitask CNN-Transformer Network

Semi-automatic breast ultrasound image segmentation based on mean shift and graph cuts.