Abstract:Background: The segmentation of breast ultrasound (US) images has been a challenging task, mainly due to limited data and the inherent image characteristics involved, such as low contrast and speckle noise. Although convolutional neural network-based (CNN-based) methods have made significant progress over the past decade, they lack the ability to model long-range interactions. Recently, the transformer method has been successfully applied to the tasks of computer vision. It has a strong ability to capture distant interactions. However, most transformer-based methods with excellent performance rely on pre-training on large datasets, making it infeasible to directly apply them to medical images analysis, especially that of breast US images with limited high-quality labels. Therefore, it is of great significance to find a robust and efficient transformer-based method for use on small breast US image datasets.Methods: We developed a dilated transformer (DT) method which mainly uses the proposed residual axial attention layers to build encoder blocks and the introduced dilation module (DM) to further increase the receptive field. We evaluated the proposed method on 2 breast US image datasets using the 5-fold cross-validation method. Dataset A was a public dataset with 562 images, while dataset B was a private dataset with 878 images. Ground truth (GT) was delineated by 2 radiologists with more than 5 years of experience. The evaluation was followed by related ablation experiments.Results: The DT was found to be comparable with the state-of-the-art (SOTA) CNN-based method and outperformed the related transformer-based method, medical transformer (MT), on both datasets. Especially on dataset B, the DT outperformed the MT on metrics of Jaccard index (JI) and Dice similarity coefficient (DSC) by 2.67% and 4.68%, respectively. Meanwhile, when compared with Unet, the DT improved JI and DSC by 4.89% and 4.66%, respectively. Moreover, the results of the ablation experiments showed that each add-on part of the DT is important and contributes to the segmentation accuracy.Conclusions: The proposed transformer-based method could achieve advanced segmentation performance on different small breast US image datasets without pretraining.

ATFE-Net: Axial Transformer and Feature Enhancement-based CNN for ultrasound breast mass segmentation

HAU-Net: Hybrid CNN-transformer for breast ultrasound image segmentation

MFMSNet: A Multi-frequency and Multi-scale Interactive CNN-Transformer Hybrid Network for breast ultrasound image segmentation

A Hybrid Enhanced Attention Transformer Network for Medical Ultrasound Image Segmentation

Axial Attention Transformer Networks: A New Frontier in Breast Cancer Detection

Mass segmentation in automated breast ultrasound using an enhanced attentive UNet

HCTNet: A hybrid CNN-transformer network for breast ultrasound image segmentation

MF-Net: Multiple-feature Extraction Network for Breast Lesion Segmentation in Ultrasound Images

A Cross-attention and Multi-level Feature Fusion Network for Breast Lesion Segmentation in Ultrasound Images

A dual-branch and dual attention transformer and CNN hybrid network for ultrasound image segmentation

Improved breast ultrasound tumor classification using dual-input CNN with GAP-guided attention loss

Dilated transformer: residual axial attention for breast ultrasound image segmentation

A Multi-Task Transformer with Local-Global Feature Interaction and Multiple Tumoral Region Guidance for Breast Cancer Diagnosis

CFATransUnet: Channel-wise cross fusion attention and transformer for 2D medical image segmentation

Augmented Transformer network for MRI brain tumor segmentation

A Multiscale Nonlocal Feature Extraction Network for Breast Lesion Segmentation in Ultrasound Images.

A dual-stage transformer and MLP-based network for breast ultrasound image segmentation

BiFTransNet: A unified and simultaneous segmentation network for gastrointestinal images of CT & MRI

BMCS-Net: A Bi-directional multi-scale cascaded segmentation network based on transformer-guided feature Aggregation for medical images

Tumor segmentation in automated whole breast ultrasound using bidirectional LSTM neural network and attention mechanism

ACL-DUNet: A tumor segmentation method based on multiple attention and densely connected breast ultrasound images