Abstract:Introduction: Ultrasound imaging has become a crucial tool in medical diagnostics, offering real-time visualization of internal organs and tissues. However, challenges such as low contrast, high noise levels, and variability in image quality hinder accurate interpretation. To enhance the diagnostic accuracy and support treatment decisions, precise segmentation of organs and lesions in ultrasound image is essential. Recently, several deep learning methods, including convolutional neural networks (CNNs) and Transformers, have reached significant milestones in medical image segmentation. Nonetheless, there remains a pressing need for methods capable of seamlessly integrating global context with local fine-grained information, particularly in addressing the unique challenges posed by ultrasound images. Methods: In this paper, to address these issues, we propose DDTransUNet, a hybrid network combining Transformer and CNN, with a dual-branch encoder and dual attention mechanism for ultrasound image segmentation. DDTransUNet adopts a Swin Transformer branch and a CNN branch to extract global context and local fine-grained information. The dual attention comprising Global Spatial Attention (GSA) and Global Channel Attention (GCA) modules to capture long-range visual dependencies. A novel Cross Attention Fusion (CAF) module effectively fuses feature maps from both branches using cross-attention. Results: Experiments on three ultrasound image datasets demonstrate that DDTransUNet outperforms previous methods. In the TN3K dataset, DDTransUNet achieves IoU, Dice, HD95 and ACC metrics of 73.82%, 82.31%, 16.98 mm, and 96.94%, respectively. In the BUS-BRA dataset, DDTransUNet achieves 80.75%, 88.23%, 8.12 mm, and 98.00%. In the CAMUS dataset, DDTransUNet achieves 82.51%, 90.33%, 2.82 mm, and 96.87%. Discussion: These results indicate that our method can provide valuable diagnostic assistance to clinical practitioners.

HAU-Net: Hybrid CNN-transformer for breast ultrasound image segmentation

HCTNet: A hybrid CNN-transformer network for breast ultrasound image segmentation

A Hybrid Enhanced Attention Transformer Network for Medical Ultrasound Image Segmentation

HmsU-Net: A hybrid multi-scale U-net based on a CNN and transformer for medical image segmentation

Accurate segmentation of breast tumors using AE U-net with HDC model in ultrasound images

A Hybrid Attentional Guidance Network for Tumors Segmentation of Breast Ultrasound Images.

A dual-branch and dual attention transformer and CNN hybrid network for ultrasound image segmentation

BRAU-Net++: U-Shaped Hybrid CNN-Transformer Network for Medical Image Segmentation

MFMSNet: A Multi-frequency and Multi-scale Interactive CNN-Transformer Hybrid Network for breast ultrasound image segmentation

HCT-Unet: multi-target medical image segmentation via a hybrid CNN-transformer Unet incorporating multi-axis gated multi-layer perceptron

UCTNet: Uncertainty-guided CNN-Transformer hybrid networks for medical image segmentation

HTC-Net: A hybrid CNN-transformer framework for medical image segmentation

UJAT-Net: A U-Net Combined Joint-Attention and Transformer for Breast Tubule Segmentation in H&E Stained Images

A Multi-Task Transformer with Local-Global Feature Interaction and Multiple Tumoral Region Guidance for Breast Cancer Diagnosis

A dual-stage transformer and MLP-based network for breast ultrasound image segmentation

ATFE-Net: Axial Transformer and Feature Enhancement-based CNN for ultrasound breast mass segmentation

AAU-Net: An Adaptive Attention U-Net for Breast Lesions Segmentation in Ultrasound Images

Effective hybrid attention network based on pseudo-color enhancement in ultrasound image segmentation

HCT-net: hybrid CNN-transformer model based on a neural architecture search network for medical image segmentation

Axial Attention Transformer Networks: A New Frontier in Breast Cancer Detection

ECU-Net: multi-scale salient boundary detection and contrast feature enhancement U-Net for breast ultrasound image segmentation