Abstract:BACKGROUND AND OBJECTIVE: The artificial segmentation of early gastric cancer (EGC) lesions in gastroscopic images remains a challenging task due to reasons including the diversity of mucosal features, irregular edges of EGC lesions and nuances between EGC lesions and healthy background mucosa. Hence, this study proposed an automatic segmentation framework: co-spatial attention and channel attention based triple-branch ResUnet (CSA-CA-TB-ResUnet) to achieve accurate segmentation of EGC lesions for aiding clinical diagnosis and treatment.METHODS: The input gastroscopic image sequences of the triple-branch segmentation network CSA-CA-TB-ResUnet is firstly generated by the designed multi-branch input preprocessing (MBIP) module in order to fully utilize massive correlation information among multiple gastroscopic images of the same a lesion. Then, the proposed CSA-CA-TB-ResUnet performs the segmentation of EGC lesion, in which the co-spatial attention (CSA) mechanism is designed to activate the spatial location of EGC lesions by leveraging on the correlations among multiple gastroscopic images of the same EGC lesion, and the channel attention (CA) mechanism is introduced to extract subtle discriminative features of EGC lesions by capturing the interdependencies between channel features. Finally, two gastroscopic images datasets from different digestive endoscopic centers in the southwest and northeast regions of China respectively were collected to validate the performances of proposed segmentation method.RESULTS: The correlation information among gastroscopic images was confirmed to be able to improve the accuracy of EGC segmentation. On another unseen dataset, our EGC segmentation method achieves Jaccard similarity index (JSI) of 84.54% (95% confidence interval (CI), 83.49%-85.56%), threshold Jaccard index (TJI) of 81.73% (95% CI, 79.70%-83.61%), Dice similarity coefficient (DSC) of 91.08% (95% CI, 90.40%-91.76%) and pixel-wise accuracy (PA) of 91.18% (95% CI, 90.43%-91.87%), which is superior to other state-of-the-art methods. Even on the challenging small lesions, the segmentation results of our CSA-CA-TB-ResUnet-based method are consistently and significantly better than other state-of-the-art methods. We also compared the segmentation result of our model with the diagnostic accuracy with junior/senior expert. The comparison results indicated that our model performed better than the junior expert.CONCLUSIONS: This study proposed a novel CSA-CA-TB-ResUnet-based EGC segmentation method and it has a potential for real-time application in improving EGC clinical diagnosis and minimally invasive surgery.

Hierarchical conditional random field model for multi-object segmentation in gastric histopathology images

Gastric histopathology image segmentation using a hierarchical conditional random field

A hierarchical conditional random field-based attention mechanism approach for gastric histopathology image classification

Intelligent Gastric Histopathology Image Classification Using Hierarchical Conditional Random Field based Attention Mechanism.

Oriented Cascade Mask R-CNN for Biomedical Image Segmentation

Cervical Histopathology Image Classification Using Multilayer Hidden Conditional Random Fields and Weakly Supervised Learning

Accurate Gastric Cancer Segmentation in Digital Pathology Images Using Deformable Convolution and Multi-Scale Embedding Networks

Multi-scale boundary neural network for gastric tumor segmentation

A Comparison of Segmentation Methods in Gastric Histopathology Images

An Automatic Histopathological Image Segmentation Network Based on Global Context-Aware Module and Deep Feature Aggregation

Early gastric cancer segmentation in gastroscopic images using a co-spatial attention and channel attention based triple-branch ResUnet

U-Shaped Network with Multi-Scale Feature Extraction for Lesion Region Segmentation in Gastric Cancer Images

Accurate multiclassification and segmentation of gastric cancer based on a hybrid cascaded deep learning model with a vision transformer from endoscopic images

Hierarchical Conditional Random Fields Model for Semisupervised SAR Image Segmentation

LGFFN-GHI: A Local-Global Feature Fuse Network for Gastric Histopathological Image Classification

HCA-DAN: hierarchical class-aware domain adaptive network for gastric tumor segmentation in 3D CT images

[Recurrence prediction of gastric cancer based on multi-resolution feature fusion and context information]

HistoSegResT: A Weakly Supervised Learning Method for Histopathology Image Segmentation.

Feasibility of deep learning image-based segmentation algorithm in pathological section of gastric cancer

A hybrid network for automatic hepatocellular carcinoma segmentation in H&E-stained whole slide images

Brain Tumor Segmentation Using a Fully Convolutional Neural Network with Conditional Random Fields.