Abstract:Accurate segmentation of medical images is crucial for disease diagnosis and understanding disease changes. Deep learning methods, utilizing encoder-decoder structures, have demonstrated cutting-edge performance in various medical image segmentation tasks. However, the pooling operation in the encoding stage results in feature loss, which makes the network lack the ability to fuse multi-scale information at different levels, hinders its effective perception of multi-scale information, and leads to poor segmentation performance. Drawing inspiration from the U-shaped network, this study introduces a multi-branch feature hybrid attention and adaptive receptive field network (MFHARFNet) for medical image segmentation. Building upon the encoder-decoder framework, we initially devise a multi-branch feature hybrid attention module (MFHAM) to seamlessly integrate feature maps of varying scales, capturing both fine-grained features and coarse-grained semantics across the entire scale. Furthermore, we redesign the skip connection to amalgamate feature information from different branches in the encoder stage and efficiently transmit it to the decoder, providing the decoder with global context feature maps at different levels. Finally, the adaptive receptive field (ARF) module is introduced in the decoder feature reconstruction stage to adapt and focus on related fields, ensuring the model's adaptation to different segmentation target features, and achieving different weights for the output of different convolution kernels to improve segmentation performance. We comprehensively evaluate our method on medical image segmentation tasks, by using four public datasets across CT and MRI. Remarkably, MFHARFNet method consistently outperforms other state-of-the-art methods, exceeding UNet by 2.1%, 0.9%, 6.6% and 1.0% on Dice on ATLAS, LiTs, BraTs2019 and Spine and intervertebral disc datasets, respectively. In addition, MFHARFNet minimizes network parameters and computational complexity as much as possible. The source codes are in https://github.com/OneHundred99/MFHARFNet.

CH-Net: A Cross Hybrid Network for Medical Image Segmentation

MixFormer: a Mixed CNN-Transformer Backbone for Medical Image Segmentation

MH-Net: Model-data-driven hybrid-fusion network for medical image segmentation

MHA-Net: A Multibranch Hybrid Attention Network for Medical Image Segmentation

Mmy-net: a Multimodal Network Exploiting Image and Patient Metadata for Simultaneous Segmentation and Diagnosis

HD 2 A-Net: A novel dual gated attention network using comprehensive hybrid dilated convolutions for medical image segmentation

VCMix-Net: A hybrid network for medical image segmentation

HCT-net: hybrid CNN-transformer model based on a neural architecture search network for medical image segmentation

Effective hybrid attention network based on pseudo-color enhancement in ultrasound image segmentation

Dual-attention transformer-based hybrid network for multi-modal medical image segmentation

DCACNet: Dual context aggregation and attention-guided cross deconvolution network for medical image segmentation

ConvMedSegNet:A multi-receptive field depthwise convolutional neural network for medical image segmentation

CASF-Net: Cross-attention and Cross-scale Fusion Network for Medical Image Segmentation

Hybrid dilation and attention residual U-Net for medical image segmentation

Swin Deformable Attention Hybrid U-Net for Medical Image Segmentation

HybridCANet: UNet-like Network Bridging CNN and Attention for Multimodal Brain Image Segmentation.

An Improved Medical Image Segmentation Framework with Channel-Height-Width-Spatial Attention Module

BCU-Net: Bridging ConvNeXt and U-Net for medical image segmentation

MFHARFNet: Multi-branch feature hybrid and adaptive receptive field network for image segmentation

Medical image segmentation based on self-supervised hybrid fusion network

MFH‐Net: A Hybrid CNN‐Transformer Network Based Multi‐Scale Fusion for Medical Image Segmentation