Abstract:Breast UltraSound (BUS) imaging is a commonly used diagnostic tool in the field of counter fighting breast diseases, especially for early detection and diagnosis of breast cancer. Due to the inherent characteristics of ultrasound images such as blurry boundaries and diverse tumor morphologies, it is challenging for doctors to manually segment breast tumors. In recent years, the Convolutional Neural Network (CNN) technology has been widely applied to automatically segment BUS images. However, due to the inherent limitations of CNNs in capturing global contextual information, it is difficult to capture the full context. To address this issue, the paper proposes a novel BGRD-TransUNet model for breast lesion segmentation, based on TransUNet. The proposed model, first, replaces the original ResNet50 backbone network of TransUNet with DenseNet121 for initial feature extraction. Next, newly designed Residual Multi-Scale Feature Modules (RMSFMs) are employed to extract features from various layers of DenseNet121, thus capturing richer features within specific layers. Thirdly, a Boundary Guidance (BG) network is added to enhance the contour information of BUS images. Additionally, newly designed Boundary Attentional Feature Fusion Modules (BAFFMs) are used to integrate edge information and features extracted through RMSFMs. Finally, newly designed Parallel Channel and Spatial Attention Modules (PCSAMs) are used to refine feature extraction using channel and spatial attention. An extensive experimental testing performed on two public datasets demonstrates that the proposed BGRD-TransUNet model outperforms all state-of-the-art medical image segmentation models, participating in the experiments, according to all evaluation metrics used (except for few separate cases), including the two most important and widely used metrics in the field of medical image segmentation, namely the Intersection over Union (IoU) and Dice Similarity Coefficient (DSC). More specifically, on the BUSI dataset and dataset B, BGRD-TransUNet achieves IoU values of 76.77% and 86.61%, and DSC values of 85.08% and 92.47%, respectively, which are higher by 7.27 and 3.64, and 5.81 and 2.54 percentage points, than the corresponding values achieved by the baseline (TransUNet).

A deep supervised transformer U‐shaped full‐resolution residual network for the segmentation of breast ultrasound image

TF-Unet:An Automatic Cardiac MRI Image Segmentation Method

BGRD-TransUNet: A Novel TransUNet-Based Model for Ultrasound Breast Lesion Segmentation

Automatic tumor segmentation in breast ultrasound images using a dilated fully convolutional network combined with an active contour model.

Fully automatic tumor segmentation of breast ultrasound images with deep learning

HAU-Net: Hybrid CNN-transformer for breast ultrasound image segmentation

A dual-stage transformer and MLP-based network for breast ultrasound image segmentation

Residual Swin Transformer Unet with Consistency Regularization for Automatic Breast Ultrasound Tumor Segmentation.

Dilated transformer: residual axial attention for breast ultrasound image segmentation

A dual-branch and dual attention transformer and CNN hybrid network for ultrasound image segmentation

Breast Ultrasound Tumor Classification Using a Hybrid Multitask CNN-Transformer Network

Fuzzy Semantic Segmentation of Breast Ultrasound Image with Breast Anatomy Constraints

A Hybrid Enhanced Attention Transformer Network for Medical Ultrasound Image Segmentation

An RDAU-NET model for lesion segmentation in breast ultrasound images

Region Aware Transformer for Automatic Breast Ultrasound Tumor Segmentation

Deep Weakly-Supervised Breast Tumor Segmentation in Ultrasound Images with Explicit Anatomical Constraints

DDRA-Net: Dual-Channel Deep Residual Attention UPerNet for Breast Lesions Segmentation in Ultrasound Images

MFMSNet: A Multi-frequency and Multi-scale Interactive CNN-Transformer Hybrid Network for breast ultrasound image segmentation

Tumor Segmentation in Breast Ultrasound Image by Means of Res Path Combined with Dense Connection Neural Network

Automatic Breast Ultrasound Tumor Segmentation Via One-Stage Hierarchical Target Activation Network

TransU²-Net: An Effective Medical Image Segmentation Framework Based on Transformer and U²-Net