Abstract:Accurate segmentation of medical images is crucial for disease diagnosis and understanding disease changes. Deep learning methods, utilizing encoder-decoder structures, have demonstrated cutting-edge performance in various medical image segmentation tasks. However, the pooling operation in the encoding stage results in feature loss, which makes the network lack the ability to fuse multi-scale information at different levels, hinders its effective perception of multi-scale information, and leads to poor segmentation performance. Drawing inspiration from the U-shaped network, this study introduces a multi-branch feature hybrid attention and adaptive receptive field network (MFHARFNet) for medical image segmentation. Building upon the encoder-decoder framework, we initially devise a multi-branch feature hybrid attention module (MFHAM) to seamlessly integrate feature maps of varying scales, capturing both fine-grained features and coarse-grained semantics across the entire scale. Furthermore, we redesign the skip connection to amalgamate feature information from different branches in the encoder stage and efficiently transmit it to the decoder, providing the decoder with global context feature maps at different levels. Finally, the adaptive receptive field (ARF) module is introduced in the decoder feature reconstruction stage to adapt and focus on related fields, ensuring the model's adaptation to different segmentation target features, and achieving different weights for the output of different convolution kernels to improve segmentation performance. We comprehensively evaluate our method on medical image segmentation tasks, by using four public datasets across CT and MRI. Remarkably, MFHARFNet method consistently outperforms other state-of-the-art methods, exceeding UNet by 2.1%, 0.9%, 6.6% and 1.0% on Dice on ATLAS, LiTs, BraTs2019 and Spine and intervertebral disc datasets, respectively. In addition, MFHARFNet minimizes network parameters and computational complexity as much as possible. The source codes are in https://github.com/OneHundred99/MFHARFNet.

Feature Aggregation and Refinement Network for 2D Anatomical Landmark Detection

Real-Time Facial Landmark Detection by Attention-driven Lightweight Network

Anatomical Landmark Detection Using a Feature-Sharing Knowledge Distillation-Based Neural Network

HYATT-Net is Grand: A Hybrid Attention Network for Performant Anatomical Landmark Detection

Learn Fine-Grained Adaptive Loss for Multiple Anatomical Landmark Detection in Medical Images

CephalFormer: Incorporating Global Structure Constraint into Visual Features for General Cephalometric Landmark Detection

FDGR-Net: Feature Decouple and Gated Recalibration Network for Medical Image Landmark Detection

Feature Agglomeration Networks for Single Stage Face Detection

You Only Learn Once: Universal Anatomical Landmark Detection

Anatomical Landmarks Annotation on 2D Lateral Cephalograms with Channel Attention

A Cascade Regression Model For Anatomical Landmark Detection

FST-Net: Facial Soft Tissue Landmark Localization on 3dmd Scans Using Feature Fusion and Local Coordinate Regression

MFHARFNet: Multi-branch feature hybrid and adaptive receptive field network for image segmentation

Super-resolution landmark detection networks for medical images

Feature Aggregation and Topology Embedding on Convolution Neural Network for Airway Segmentation

CFANet: Context Feature Fusion and Attention Mechanism Based Network for Small Target Segmentation in Medical Images

DGFAU-Net: Global feature attention upsampling network for medical image segmentation

CFJLNet: Coarse and Fine Feature Joint Learning Network for Bone Age Assessment

FARP-Net: Local-Global Feature Aggregation and Relation-Aware Proposals for 3D Object Detection

FAR-Net: Fast Anchor Refining for Arbitrary-Oriented Object Detection

FARN: Fetal Anatomy Reasoning Network for Detection With Global Context Semantic and Local Topology Relationship