Abstract:Background: Breast ultrasound (BUS) imaging is one of the most prevalent approaches for the detection of breast cancers. Tumor segmentation of BUS images can facilitate doctors in localizing tumors and is a necessary step for computer-aided diagnosis systems. While the majority of clinical BUS scans are normal ones without tumors, segmentation approaches such as U-Net often predict mass regions for these images. Such false-positive problem becomes serious if a fully automatic artificial intelligence system is used for routine screening. Methods: In this study, we proposed a novel model which is more suitable for routine BUS screening. The model contains a classification branch that determines whether the image is normal or with tumors, and a segmentation branch that outlines tumors. Two branches share the same encoder network. We also built a new dataset that contains 1600 BUS images from 625 patients for training and a testing dataset with 130 images from 120 patients for testing. The dataset is the largest one with pixel-wise masks manually segmented by experienced radiologists. Our code is available at https://github.com/szhangNJU/BUS_segmentation. Results: The area under the receiver operating characteristic curve (AUC) for classifying images into normal/abnormal categories was 0.991. The dice similarity coefficient (DSC) for segmentation of mass regions was 0.898, better than the state-of-the-art models. Testing on an external dataset gave a similar performance, demonstrating a good transferability of our model. Moreover, we simulated the use of the model in actual clinic practice by processing videos recorded during BUS scans; the model gave very low false-positive predictions on normal images without sacrificing sensitivities for images with tumors. Conclusions: Our model achieved better segmentation performance than the state-of-the-art models and showed a good transferability on an external test set. The proposed deep learning architecture holds potential for use in fully automatic BUS health screening.

Deep Weakly-Supervised Breast Tumor Segmentation in Ultrasound Images with Explicit Anatomical Constraints

Weakly-supervised Deep Learning for Breast Tumor Segmentation in Ultrasound Images

Anatomy-guided Weakly Supervised Breast Lesion Segmentation Fusing Contour and Semantic Information.

Semi-supervised Deep Learning for Breast Anatomy Decomposition in Ultrasound Images

Fuzzy Semantic Segmentation of Breast Ultrasound Image with Breast Anatomy Constraints

Automated Breast Tumor Detection and Segmentation with a Novel Computational Framework of Whole Ultrasound Images

Balancing Regional and Global Information: an Interactive Segmentation Framework for Ultrasound Breast Lesion.

Fully automatic tumor segmentation of breast ultrasound images with deep learning

Tumor segmentation in automated whole breast ultrasound using bidirectional LSTM neural network and attention mechanism

Automatic tumor segmentation in breast ultrasound images using a dilated fully convolutional network combined with an active contour model.

Automatic Breast Ultrasound Tumor Segmentation Via One-Stage Hierarchical Target Activation Network

Dense Prediction and Local Fusion of Superpixels: A Framework for Breast Anatomy Segmentation in Ultrasound Image with Scarce Data

Deep Learning-based Breast Tumor Detection and Segmentation in 3D Ultrasound Image

Multi-task Learning for Segmentation and Classification of Tumors in 3D Automated Breast Ultrasound Images

An efficient framework for lesion segmentation in ultrasound images using global adversarial learning and region-invariant loss

Automatic Tumor Segmentation in 3D Automated Breast Ultrasound Using Convolutional Neural Network

A2DMN: Anatomy-Aware Dilated Multiscale Network for Breast Ultrasound Semantic Segmentation

Breast Lesion Segmentation in Ultrasound Images by CDeep3M

Automated Segmentation of Ultrasonic Breast Lesions Using Statistical Texture Classification and Active Contour Based on Probability Distance.

Segmentation of breast ultrasound image with semantic classification of superpixels.

Joint localization and classification of breast tumors on ultrasound images using a novel auxiliary attention-based framework