Abstract:Objective. In recent years, methods based on U-shaped structure and skip connection have achieved remarkable results in many medical semantic segmentation tasks. However, the information integration capability of this structure is still limited due to the incompatibility of feature maps of encoding and decoding stages at corresponding levels and lack of extraction of valid information in the final stage of encoding. This structural defect is particularly obvious in segmentation tasks with non-obvious, small and blurred-edge targets. Our objective is to design a novel segmentation network to solve the above problems. Approach. The segmentation network named Global Context-Aware Network (GCANet) is mainly designed by inserting a Multi-feature Collaboration Adaptation (MCA) module, a Scale-Aware Mining (SAM) module and an Edge-enhanced Pixel Intensity Mapping (Edge-PIM) into the U-shaped structure. Firstly, the MCA module can integrate information from all encoding stages and then effectively acts on the decoding stages, solving the problem of information loss during downsampling and pooling. Secondly, the SAM module can further mine information from the encoded high-level features to enrich the information passed to the decoding stage. Thirdly, Edge-PIM can further refine the segmentation results by edge enhancement. Main results. We newly collect Magnetic Resonance Imaging of Colorectal Cancer Liver Metastases (MRI-CRLM) dataset in different imaging sequences with non-obvious, small and blurred-edge liver metastases. Our method performs well on the MRI-CRLM dataset and the publicly available ISIC-2018 dataset, outperforming state-of-the-art methods such as CPFNet on multiple metrics after boxplot analysis, indicating that it can perform well on a wide range of medical image segmentation tasks. Significance. The proposed method solves the problem mentioned above and improved segmentation accuracy for non-obvious, small and blurred-edge targets. Meanwhile, the proposed visualization method Edge-PIM can make the edge more prominent, which can assist medical radiologists in their research work well.

Pairwise Semantic Segmentation via Conjugate Fully Convolutional Network

Pairwise Learning for Medical Image Segmentation

MedFCT: A Frequency Domain Joint CNN-Transformer Network for Semi-supervised Medical Image Segmentation

Image Segmentation of Liver CT Based on Fully Convolutional Network.

A Novel Network Based on Densely Connected Fully Convolutional Networks for Segmentation of Lung Tumors on Multi-Modal MR Images

Automatic segmentation method using FCN with multi-scale dilated convolution for medical ultrasound image

TFCNs: A CNN-Transformer Hybrid Network for Medical Image Segmentation

Segmentation-based Context-Aware Enhancement Network for Medical Images

Fully Convolutional Neural Networks With Full-Scale-Features For Semantic Segmentation

Hybrid-scale Contextual Fusion Network for Medical Image Segmentation

An application of cascaded 3D fully convolutional networks for medical image segmentation

FCSU-Net: A novel full-scale Cross-dimension Self-attention U-Net with collaborative fusion of multi-scale feature for medical image segmentation

DCFNet: An Effective Dual-Branch Cross-Attention Fusion Network for Medical Image Segmentation

Multi-perspective feature compensation enhanced network for medical image segmentation

Medical Image Segmentation Based on Multi-Modal Convolutional Neural Network: Study on Image Fusion Schemes

SegCoFusion: an Integrative Multimodal Volumetric Segmentation Cooperating with Fusion Pipeline to Enhance Lesion Awareness.

CASF-Net: Cross-attention and Cross-scale Fusion Network for Medical Image Segmentation

A Novel Skip-Connection Strategy by Fusing Spatial and Channel Wise Features for Multi-Region Medical Image Segmentation

Collaborative multi-feature extraction and scale-aware semantic information mining for medical image segmentation

SSFCN-DCRF

Semi-automatic Skin Lesion Segmentation Via Fully Convolutional Networks