Abstract:Accurate segmentation of medical images is crucial for disease diagnosis and understanding disease changes. Deep learning methods, utilizing encoder-decoder structures, have demonstrated cutting-edge performance in various medical image segmentation tasks. However, the pooling operation in the encoding stage results in feature loss, which makes the network lack the ability to fuse multi-scale information at different levels, hinders its effective perception of multi-scale information, and leads to poor segmentation performance. Drawing inspiration from the U-shaped network, this study introduces a multi-branch feature hybrid attention and adaptive receptive field network (MFHARFNet) for medical image segmentation. Building upon the encoder-decoder framework, we initially devise a multi-branch feature hybrid attention module (MFHAM) to seamlessly integrate feature maps of varying scales, capturing both fine-grained features and coarse-grained semantics across the entire scale. Furthermore, we redesign the skip connection to amalgamate feature information from different branches in the encoder stage and efficiently transmit it to the decoder, providing the decoder with global context feature maps at different levels. Finally, the adaptive receptive field (ARF) module is introduced in the decoder feature reconstruction stage to adapt and focus on related fields, ensuring the model's adaptation to different segmentation target features, and achieving different weights for the output of different convolution kernels to improve segmentation performance. We comprehensively evaluate our method on medical image segmentation tasks, by using four public datasets across CT and MRI. Remarkably, MFHARFNet method consistently outperforms other state-of-the-art methods, exceeding UNet by 2.1%, 0.9%, 6.6% and 1.0% on Dice on ATLAS, LiTs, BraTs2019 and Spine and intervertebral disc datasets, respectively. In addition, MFHARFNet minimizes network parameters and computational complexity as much as possible. The source codes are in https://github.com/OneHundred99/MFHARFNet.

AMFF-NET: Adaptive Multi-Layer Feature Fusion Network for Medical Image Segmentation

AFFSegNet: Adaptive Feature Fusion Segmentation Network for Microtumors and Multi-Organ Segmentation

Sub-pixel multi-scale fusion network for medical image segmentation

MFH‐Net: A Hybrid CNN‐Transformer Network Based Multi‐Scale Fusion for Medical Image Segmentation

DAMAF: dual attention network with multi-level adaptive complementary fusion for medical image segmentation

CRMEFNet: A coupled refinement, multiscale exploration and fusion network for medical image segmentation

CFNet: A Medical Image Segmentation Method Using the Multi-View Attention Mechanism and Adaptive Fusion Strategy

MAFUNet: Multi-Attention Fusion Network for Medical Image Segmentation

MFHARFNet: Multi-branch feature hybrid and adaptive receptive field network for image segmentation

Dual-feature Fusion Attention Network for Small Object Segmentation.

AMFF-net: Adaptive Multi-Modal Feature Fusion Network for Image Classification

MpMsCFMA-Net: Multi-path Multi-scale Context Feature Mixup and Aggregation Network for medical image segmentation

TPAFNet: Transformer-Driven Pyramid Attention Fusion Network for 3D Medical Image Segmentation

M4FNet: Multimodal Medical Image Fusion Network Via Multi-Receptive-field and Multi-Scale Feature Integration.

AFT-Net: Active Fusion-Transduction for Multi-stream Medical Image Segmentation.

Multi-perspective feature compensation enhanced network for medical image segmentation

AMMNet: A multimodal medical image fusion method based on an attention mechanism and MobileNetV3

CCFNet: Collaborative Cross-Fusion Network for Medical Image Segmentation

CASF-Net: Cross-attention and Cross-scale Fusion Network for Medical Image Segmentation

FAFuse: A Four-Axis Fusion framework of CNN and transformer for medical image segmentation

MFA-Net: Multiple Feature Association Network for Medical Image Segmentation