Abstract:BACKGROUND AND OBJECTIVE: The artificial segmentation of early gastric cancer (EGC) lesions in gastroscopic images remains a challenging task due to reasons including the diversity of mucosal features, irregular edges of EGC lesions and nuances between EGC lesions and healthy background mucosa. Hence, this study proposed an automatic segmentation framework: co-spatial attention and channel attention based triple-branch ResUnet (CSA-CA-TB-ResUnet) to achieve accurate segmentation of EGC lesions for aiding clinical diagnosis and treatment.METHODS: The input gastroscopic image sequences of the triple-branch segmentation network CSA-CA-TB-ResUnet is firstly generated by the designed multi-branch input preprocessing (MBIP) module in order to fully utilize massive correlation information among multiple gastroscopic images of the same a lesion. Then, the proposed CSA-CA-TB-ResUnet performs the segmentation of EGC lesion, in which the co-spatial attention (CSA) mechanism is designed to activate the spatial location of EGC lesions by leveraging on the correlations among multiple gastroscopic images of the same EGC lesion, and the channel attention (CA) mechanism is introduced to extract subtle discriminative features of EGC lesions by capturing the interdependencies between channel features. Finally, two gastroscopic images datasets from different digestive endoscopic centers in the southwest and northeast regions of China respectively were collected to validate the performances of proposed segmentation method.RESULTS: The correlation information among gastroscopic images was confirmed to be able to improve the accuracy of EGC segmentation. On another unseen dataset, our EGC segmentation method achieves Jaccard similarity index (JSI) of 84.54% (95% confidence interval (CI), 83.49%-85.56%), threshold Jaccard index (TJI) of 81.73% (95% CI, 79.70%-83.61%), Dice similarity coefficient (DSC) of 91.08% (95% CI, 90.40%-91.76%) and pixel-wise accuracy (PA) of 91.18% (95% CI, 90.43%-91.87%), which is superior to other state-of-the-art methods. Even on the challenging small lesions, the segmentation results of our CSA-CA-TB-ResUnet-based method are consistently and significantly better than other state-of-the-art methods. We also compared the segmentation result of our model with the diagnostic accuracy with junior/senior expert. The comparison results indicated that our model performed better than the junior expert.CONCLUSIONS: This study proposed a novel CSA-CA-TB-ResUnet-based EGC segmentation method and it has a potential for real-time application in improving EGC clinical diagnosis and minimally invasive surgery.

Hue-texture-embedded region-based model for magnifying endoscopy with narrow-band imaging image segmentation based on visual features

Lipid Segmentation Method Based on Magnification Endoscopy with Narrow-Band Imaging

Multispectral Endoscopic Imaging Studies on the Tissue Components of Gastrointestinal Mucosa

Diagnostic performance of magnifying narrow-band imaging for early gastric cancer: A meta-analysis

Diagnosis and segmentation effect of the ME-NBI-based deep learning model on gastric neoplasms in patients with suspected superficial lesions - a multicenter study

Magnifying Endoscopy with Narrow-Band Imaging for Early Gastric Cancer Diagnosis

Identifying early gastric cancer under magnifying narrow-band images with deep learning: a multicenter study

Convolutional neural network for the diagnosis of early gastric cancer based on magnifying narrow band imaging

Early gastric cancer segmentation in gastroscopic images using a co-spatial attention and channel attention based triple-branch ResUnet

Multi-label Recognition of Cancer-Related Lesions with Clinical Priors on White-Light Endoscopy

A deep learning-based system for identifying differentiation status and delineating the margins of early gastric cancer in magnifying narrow-band imaging endoscopy

Tu1696 The Diagnostic Utility of Me-NBI in Differentiating Malignant Gastric Mucosal Lesions Comparing With Wle and ME-WLI—a Prospective Multicentre Study

Diagnostic Ability of Magnifying Narrow-Band Imaging for the Extent of Early Gastric Cancer: A Systematic Review and Meta-Analysis

A deep learning method for delineating early gastric cancer resection margin under chromoendoscopy and white light endoscopy

AI-assisted Identification of Intrapapillary Capillary Loops in Magnification Endoscopy for Diagnosing Early-Stage Esophageal Squamous Cell Carcinoma: a Preliminary Study

Content‐based Gastric Image Retrieval Using Convolutional Neural Networks

Magnifying Endoscopy with Narrow-Banding Imaging：new Progress in Diagnosis of Early Stage Colorectal Cancers

Automatic Detection of Early Gastrointestinal Cancer Lesions Based on Optimal Feature Extraction from Gastroscopic Images

A deep learning-based model improves diagnosis of early gastric cancer under narrow band imaging endoscopy

Transfer Learning with Convolutional Neural Network for Early Gastric Cancer Classification on Magnifiying Narrow-Band Imaging Images

Application of deep learning in the real-time diagnosis of gastric lesion based on magnifying optical enhancement videos