Abstract:Automatic segmentation of medical images provides a reliable scientific basis for disease diagnosis and analysis. Notably, most existing methods that combine the strengths of convolutional neural networks (CNNs) and Transformers have made significant progress. However, there are some limitations in the current integration of CNN and Transformer technology in two key aspects. Firstly, most methods either overlook or fail to fully incorporate the complementary nature between local and global features. Secondly, the significance of integrating the multi-scale encoder features from the dual-branch network to enhance the decoding features is often disregarded in methods that combine CNN and Transformer. To address this issue, we present a groundbreaking dual-branch cross-attention fusion network (DCFNet), which efficiently combines the power of Swin Transformer and CNN to generate complementary global and local features. We then designed the Feature Cross-Fusion (FCF) module to efficiently fuse local and global features. In the FCF, the utilization of the Channel-wise Cross-fusion Transformer (CCT) serves the purpose of aggregating multi-scale features, and the Feature Fusion Module (FFM) is employed to effectively aggregate dual-branch prominent feature regions from the spatial perspective. Furthermore, within the decoding phase of the dual-branch network, our proposed Channel Attention Block (CAB) aims to emphasize the significance of the channel features between the up-sampled features and the features generated by the FCF module to enhance the details of the decoding. Experimental results demonstrate that DCFNet exhibits enhanced accuracy in segmentation performance. Compared to other state-of-the-art (SOTA) methods, our segmentation framework exhibits a superior level of competitiveness. DCFNet’s accurate segmentation of medical images can greatly assist medical professionals in making crucial diagnoses of lesion areas in advance.

SF-SegFormer: Stepped-Fusion Segmentation Transformer for Brain Tissue Image Via Inter-Group Correlation and Enhanced Multi-layer Perceptron

Mmformer: Multimodal Medical Transformer for Incomplete Multimodal Learning of Brain Tumor Segmentation

SegCoFusion: an Integrative Multimodal Volumetric Segmentation Cooperating with Fusion Pipeline to Enhance Lesion Awareness.

STF-Net: sparsification transformer coding guided network for subcortical brain structure segmentation

A multi-path adaptive fusion network for multimodal brain tumor segmentation

3D Brainformer: 3D Fusion Transformer for Brain Tumor Segmentation

TransSea: Hybrid CNN-Transformer with Semantic Awareness for 3D Brain Tumor Segmentation

A conflict-free multi-modal fusion network with spatial reinforcement transformers for brain tumor segmentation

Dual encoder network with transformer-CNN for multi-organ segmentation

TransSea: Hybrid CNN–Transformer With Semantic Awareness for 3-D Brain Tumor Segmentation

Diff-SFCT: A Diffusion Model with Spatial-Frequency Cross Transformer for Medical Image Segmentation.

ConvFormer: Combining CNN and Transformer for Medical Image Segmentation

Bi-Fusion of Structure and Deformation at Multi-Scale for Joint Segmentation and Registration

Hybrid-Fusion Transformer for Multisequence MRI

DCFNet: An Effective Dual-Branch Cross-Attention Fusion Network for Medical Image Segmentation

Sub-pixel multi-scale fusion network for medical image segmentation

SACNet: A Spatially Adaptive Convolution Network for 2D Multi-organ Medical Segmentation

nnSegNeXt: A 3D Convolutional Network for Brain Tissue Segmentation Based on Quality Evaluation

MRF-Net: A multi-branch residual fusion network for fast and accurate whole-brain MRI segmentation

FD-FCN: 3D Fully Dense and Fully Convolutional Network for Semantic Segmentation of Brain Anatomy

Feature fusion and latent feature learning guided brain tumor segmentation and missing modality recovery network