Abstract:Background: The segmentation of breast ultrasound (US) images has been a challenging task, mainly due to limited data and the inherent image characteristics involved, such as low contrast and speckle noise. Although convolutional neural network-based (CNN-based) methods have made significant progress over the past decade, they lack the ability to model long-range interactions. Recently, the transformer method has been successfully applied to the tasks of computer vision. It has a strong ability to capture distant interactions. However, most transformer-based methods with excellent performance rely on pre-training on large datasets, making it infeasible to directly apply them to medical images analysis, especially that of breast US images with limited high-quality labels. Therefore, it is of great significance to find a robust and efficient transformer-based method for use on small breast US image datasets.Methods: We developed a dilated transformer (DT) method which mainly uses the proposed residual axial attention layers to build encoder blocks and the introduced dilation module (DM) to further increase the receptive field. We evaluated the proposed method on 2 breast US image datasets using the 5-fold cross-validation method. Dataset A was a public dataset with 562 images, while dataset B was a private dataset with 878 images. Ground truth (GT) was delineated by 2 radiologists with more than 5 years of experience. The evaluation was followed by related ablation experiments.Results: The DT was found to be comparable with the state-of-the-art (SOTA) CNN-based method and outperformed the related transformer-based method, medical transformer (MT), on both datasets. Especially on dataset B, the DT outperformed the MT on metrics of Jaccard index (JI) and Dice similarity coefficient (DSC) by 2.67% and 4.68%, respectively. Meanwhile, when compared with Unet, the DT improved JI and DSC by 4.89% and 4.66%, respectively. Moreover, the results of the ablation experiments showed that each add-on part of the DT is important and contributes to the segmentation accuracy.Conclusions: The proposed transformer-based method could achieve advanced segmentation performance on different small breast US image datasets without pretraining.

An Efficient Transformer for Placental Vessel Segmentation.

Real-time placental vessel segmentation in fetoscopic laser surgery for Twin-to-Twin Transfusion Syndrome

Deep Placental Vessel Segmentation for Fetoscopic Mosaicking

Development Of Placenta Mapping System For Treatment Of Twin-To-Twin Transfusion Syndrome (Ttts)

TCU-Net: Transformer Embedded in Convolutional U-Shaped Network for Retinal Vessel Segmentation

Deep 3D Vessel Segmentation Based on Cross Transformer Network.

MTPA_Unet: Multi-Scale Transformer-Position Attention Retinal Vessel Segmentation Network Joint Transformer and CNN

TLTNet: A novel transscale cascade layered transformer network for enhanced retinal blood vessel segmentation

Transformer and convolutional based dual branch network for retinal vessel segmentation in OCTA images

Vision Transformers increase efficiency of 3D cardiac CT multi-label segmentation

Transformer Connections: Improving Segmentation in Blurred Near‐Infrared Blood Vessel Image in Different Depth

TiM-Net: Transformer in M-Net for Retinal Vessel Segmentation

OCT2Former: A retinal OCT-angiography vessel segmentation transformer

A Multi-Branch Hybrid Transformer Networkfor Corneal Endothelial Cell Segmentation

Dual encoder network with transformer-CNN for multi-organ segmentation

A Transformer-Assisted Cascade Learning Network for Choroidal Vessel Segmentation

MobileUtr: Revisiting the relationship between light-weight CNN and Transformer for efficient medical image segmentation

Dilated transformer: residual axial attention for breast ultrasound image segmentation

Left Ventricle Segmentation in Echocardiography with Transformer

HT-Net: A Hybrid Transformer Network for Fundus Vessel Segmentation

TDCAU-Net: retinal vessel segmentation using transformer dilated convolutional attention-based U-Net method