Abstract:Background and Objectives: Transformers using self-attention mechanisms have recently advanced medical imaging by modeling long-range semantic dependencies, though they lack CNNs’ ability to capture local spatial details. This study introduced a novel segmentation network derived from a mixed CNN-Transformer (MixFormer) feature extraction backbone to enhance medical image segmentation. Method: The MixFormer network seamlessly integrates global and local information from Transformer and CNN architectures during the downsampling process. To comprehensively capture the inter-scale perspective, we introduced a Multi-scale Spatial-aware Fusion (MSAF) module, enabling effective interaction between coarse and fine feature representations. Additionally, we proposed a Mixed Multi-branch Dilated Attention (MMDA) module to bridge the semantic gap between encoding and decoding stages while emphasizing specific regions. Lastly, we implemented a CNN-based upsampling approach to recover low-level features, substantially improving segmentation accuracy. Results: Experimental validations on prevalent medical image datasets demonstrated the superior performance of MixFormer. On the Synapse dataset, our approach achieved a mean Dice Similarity Coefficient (DSC) of 82.64% and a mean Hausdorff Distance (HD) of 12.67 mm. On the ACDC dataset, the DSC was 91.01%. On the ISIC 2018 dataset, the model achieved a mean Intersection over Union (mIOU) of 0.841, Accuracy of 0.958, Precision of 0.910, Recall of 0.934, and an F1 score of 0.913. For the Kvasir-SEG dataset, we recorded a mean Dice of 0.9247, mIOU of 0.8615, Precision of 0.9181, and Recall of 0.9463. On the CVC-ClinicDB dataset, the results were a mean Dice of 0.9441, mIOU of 0.8922, Precision of 0.9437, and Recall of 0.9458. Conclusion: These findings underscore the superior segmentation performance of MixFormer compared to most mainstream segmentation networks such as CNNs and other Transformerbased structures.

ResX: Feature Extraction Block for Medical Image Segmentation

3D Multiple-Contextual ROI-Attention Network for Efficient and Accurate Volumetric Medical Image Segmentation.

MixFormer: a Mixed CNN-Transformer Backbone for Medical Image Segmentation

Spectrally-Enforced Global Receptive Field for Contextual Medical Image Segmentation and Classification

A Multi-Scale Context Aware Attention Model for Medical Image Segmentation

Biomedical image segmentation based on full-Resolution network

DRINet for Medical Image Segmentation

RFE-UNet: Remote Feature Exploration with Local Learning for Medical Image Segmentation

Res2-UNeXt: a novel deep learning framework for few-shot cell image segmentation

Hybrid dilation and attention residual U-Net for medical image segmentation

Res2Net: A New Multi-Scale Backbone Architecture

ConvMedSegNet:A multi-receptive field depthwise convolutional neural network for medical image segmentation

TriConvUNeXt: A Pure CNN-Based Lightweight Symmetrical Network for Biomedical Image Segmentation

Segmentation of medical images using an attention embedded lightweight network

MSDEnet: Multi-scale detail enhanced network based on human visual system for medical image segmentation

Morphological Operation Residual Blocks: Enhancing 3D Morphological Feature Representation in Convolutional Neural Networks for Semantic Segmentation of Medical Images

X-Net: a dual encoding–decoding method in medical image segmentation

Multi-Receptive-Field CNN for Semantic Segmentation of Medical Images

Lossless segmentation of cardiac medical images by a resolution consistent network with nondamage data preprocessing

ResGANet: Residual Group Attention Network for Medical Image Classification and Segmentation

DRA-Net: Medical image segmentation based on adaptive feature extraction and region-level information fusion