Abstract:Automatic and accurate medical image segmentation is a crucial step for clinical diagnosis and treatment planning of diseases. The advanced convolutional neural network (CNN) approaches based on the encoder–decoder structure have achieved state-of-the-art performances in many different medical image segmentation tasks. However, existing networks have insufficient capability of extracting the context information in each encoding stage, so they cannot effectively perceive multi-scale objects in images. In addition, the continuous down-sampling and convolution operations in the encoding stage lead to much loss of the detailed information, resulting in poor segmentation performance. In this paper, we propose a Multi-path Multi-scale Context Feature MixUp and Aggregation Network (named MpMsCFMA-Net) which fuses and aggregates multi-path features with multi-scale context information to address these issues. Based on the encoder–decoder structure, we first design the encoder to encode the semantic and detailed information of input images and introduce multi-scale context extraction module in each encoding stage. Furthermore, we design multiple features mixup module between the encoder and the decoder, aiming at providing different levels of global context information for the decoder by reconstructing skip-connection. Finally, we introduce the decoder with deeper features aggregation to better fuse multi-scale context information across layers. Experimental results on four public medical image datasets confirm that our proposed network achieves promising results and outperforms other state-of-the-art methods in most of evaluation metrics. The source code will be publicly available at https://github.com/tricksterANDthug/MpMsCFMA-Net .

Multi-path Fusion Network for Semantic Image Segmentation

Research of improving semantic image segmentation based on a feature fusion model

Dual-Path Feature Fusion Network for Semantic Segmentation of Remote Sensing Images

Multi-feature Fusion Network for Road Scene Semantic Segmentation.

Enhanced Multi-Scale Feature Adaptive Fusion Sparse Convolutional Network for Large-Scale Scenes Semantic Segmentation

Real-Time Semantic Segmentation via Multiply Spatial Fusion Network

Multiscale Fusion Convolutional Network in Real-time Semantic Segmentation

A multi-path adaptive fusion network for multimodal brain tumor segmentation

MCFNet: Multi-scale Covariance Feature Fusion Network for Real-time Semantic Segmentation

Semantic Image Segmentation with Improved Position Attention and Feature Fusion

MLFNet- Point Cloud Semantic Segmentation Convolution Network Based on Multi-Scale Feature Fusion

CIMFNet: Cross-layer Interaction and Multiscale Fusion Network for Semantic Segmentation of High-Resolution Remote Sensing Images

CMPF-UNet: a ConvNeXt multi-scale pyramid fusion U-shaped network for multi-category segmentation of remote sensing images

MFH‐Net: A Hybrid CNN‐Transformer Network Based Multi‐Scale Fusion for Medical Image Segmentation

Semantic Guidance Fusion Network for Cross-Modal Semantic Segmentation

MpMsCFMA-Net: Multi-path Multi-scale Context Feature Mixup and Aggregation Network for medical image segmentation

A Multi-Step Fusion Network for Semantic Segmentation of High-Resolution Aerial Images

FCPFNet: Feature Complementation Network with Pyramid Fusion for Semantic Segmentation

Semantic Segmentation with Multi-Path Refinement and Pyramid Pooling Dilated-Resnet.

Feature Fusion Network Based on Hybrid Attention for Semantic Segmentation

FusionU-Net: U-Net with Enhanced Skip Connection for Pathology Image Segmentation