Abstract:Accurate segmentation of medical images is crucial for disease diagnosis and understanding disease changes. Deep learning methods, utilizing encoder-decoder structures, have demonstrated cutting-edge performance in various medical image segmentation tasks. However, the pooling operation in the encoding stage results in feature loss, which makes the network lack the ability to fuse multi-scale information at different levels, hinders its effective perception of multi-scale information, and leads to poor segmentation performance. Drawing inspiration from the U-shaped network, this study introduces a multi-branch feature hybrid attention and adaptive receptive field network (MFHARFNet) for medical image segmentation. Building upon the encoder-decoder framework, we initially devise a multi-branch feature hybrid attention module (MFHAM) to seamlessly integrate feature maps of varying scales, capturing both fine-grained features and coarse-grained semantics across the entire scale. Furthermore, we redesign the skip connection to amalgamate feature information from different branches in the encoder stage and efficiently transmit it to the decoder, providing the decoder with global context feature maps at different levels. Finally, the adaptive receptive field (ARF) module is introduced in the decoder feature reconstruction stage to adapt and focus on related fields, ensuring the model's adaptation to different segmentation target features, and achieving different weights for the output of different convolution kernels to improve segmentation performance. We comprehensively evaluate our method on medical image segmentation tasks, by using four public datasets across CT and MRI. Remarkably, MFHARFNet method consistently outperforms other state-of-the-art methods, exceeding UNet by 2.1%, 0.9%, 6.6% and 1.0% on Dice on ATLAS, LiTs, BraTs2019 and Spine and intervertebral disc datasets, respectively. In addition, MFHARFNet minimizes network parameters and computational complexity as much as possible. The source codes are in https://github.com/OneHundred99/MFHARFNet.

Multi-Receptive-Field CNN for Semantic Segmentation of Medical Images

3D Multiple-Contextual ROI-Attention Network for Efficient and Accurate Volumetric Medical Image Segmentation.

Multi-Scale and Multi-Branch Convolutional Neural Network for Retinal Image Segmentation

ConvMedSegNet:A multi-receptive field depthwise convolutional neural network for medical image segmentation

Contextual-wise Discriminative Feature Extraction and Robust Network Learning for Subcortical Structure Segmentation

A novel MCF-Net: Multi-level context fusion network for 2D medical image segmentation

MCRNet: Multi-level Context Refinement Network for Semantic Segmentation in Breast Ultrasound Imaging

MpMsCFMA-Net: Multi-path Multi-scale Context Feature Mixup and Aggregation Network for medical image segmentation

MC-Net: multi-scale context-attention network for medical CT image segmentation

Sub-pixel multi-scale fusion network for medical image segmentation

MFHARFNet: Multi-branch feature hybrid and adaptive receptive field network for image segmentation

MSGSE-Net: Multi-scale guided squeeze-and-excitation network for subcortical brain structure segmentation

Multi-stage Context Refinement Network for Semantic Segmentation

MSMCNet: Differential context drives accurate localization and edge smoothing of lesions for medical image segmentation

Spectrally-Enforced Global Receptive Field for Contextual Medical Image Segmentation and Classification

MCA-Net: Multi-scale Context-aware Aggregation Network for Medical Image Segmentation.

CPFNet: Context Pyramid Fusion Network for Medical Image Segmentation.

Segmentation-based Context-Aware Enhancement Network for Medical Images

CRMEFNet: A coupled refinement, multiscale exploration and fusion network for medical image segmentation

MC-Net: Multiple Max-Pooling Integration Module and Cross Multi-Scale Deconvolution Network.

CASF-Net: Cross-attention and Cross-scale Fusion Network for Medical Image Segmentation