Abstract:Objective. In recent years, methods based on U-shaped structure and skip connection have achieved remarkable results in many medical semantic segmentation tasks. However, the information integration capability of this structure is still limited due to the incompatibility of feature maps of encoding and decoding stages at corresponding levels and lack of extraction of valid information in the final stage of encoding. This structural defect is particularly obvious in segmentation tasks with non-obvious, small and blurred-edge targets. Our objective is to design a novel segmentation network to solve the above problems. Approach. The segmentation network named Global Context-Aware Network (GCANet) is mainly designed by inserting a Multi-feature Collaboration Adaptation (MCA) module, a Scale-Aware Mining (SAM) module and an Edge-enhanced Pixel Intensity Mapping (Edge-PIM) into the U-shaped structure. Firstly, the MCA module can integrate information from all encoding stages and then effectively acts on the decoding stages, solving the problem of information loss during downsampling and pooling. Secondly, the SAM module can further mine information from the encoded high-level features to enrich the information passed to the decoding stage. Thirdly, Edge-PIM can further refine the segmentation results by edge enhancement. Main results. We newly collect Magnetic Resonance Imaging of Colorectal Cancer Liver Metastases (MRI-CRLM) dataset in different imaging sequences with non-obvious, small and blurred-edge liver metastases. Our method performs well on the MRI-CRLM dataset and the publicly available ISIC-2018 dataset, outperforming state-of-the-art methods such as CPFNet on multiple metrics after boxplot analysis, indicating that it can perform well on a wide range of medical image segmentation tasks. Significance. The proposed method solves the problem mentioned above and improved segmentation accuracy for non-obvious, small and blurred-edge targets. Meanwhile, the proposed visualization method Edge-PIM can make the edge more prominent, which can assist medical radiologists in their research work well.

Multi-Task Classification and Segmentation for Explicable Capsule Endoscopy Diagnostics

Feature Pyramid Network Based Spatial Attention and Cross‐Level Semantic Similarity for Diseases Segmentation From Capsule Endoscopy Images

Wireless Capsule Endoscopy Anomaly Classification Via Dynamic Multi-Task Learning

A Multi-task Neural Network for Image Recognition in Magnetically Controlled Capsule Endoscopy

Image Segmentation of Lesions in Wireless Capsule Endoscopy Based on Mask R-CNN

Convolutional‐capsule network for gastrointestinal endoscopy image classification

Multi-Scale Convolution-Transformer Fusion Network for Endoscopic Image Segmentation.

Towards Integrating Temporal Information in Capsule Endoscopy Image Analysis

Cascade-EC Network: Recognition of Gastrointestinal Multiple Lesions Based on EfficientNet and CA_stm_Retinanet

Capsule Endoscopy Image Classification with Deep Convolutional Neural Networks

Study on the Classification of Capsule Endoscopy Images

Multi-Scale Context-Guided Deep Network for Automated Lesion Segmentation With Endoscopy Images of Gastrointestinal Tract

Capsules for Biomedical Image Segmentation

Efficacy of a comprehensive binary classification model using a deep convolutional neural network for wireless capsule endoscopy

Video Capsule Endoscopy Classification using Focal Modulation Guided Convolutional Neural Network

MSNet: a novel network with comprehensive multi-scale feature integration for gastric cancer and colon polyp segmentation

Collaborative multi-feature extraction and scale-aware semantic information mining for medical image segmentation

CASCRNet: An Atrous Spatial Pyramid Pooling and Shared Channel Residual based Network for Capsule Endoscopy

Capsule Endoscopy Multi-classification via Gated Attention and Wavelet Transformations

Segmentation of Bleeding Regions in Wireless Capsule Endoscopy for Detection of Informative Frames

Attention Mechanism Guided SE + ResNet-H Model for Gastrointestinal Endoscopy Image Classification