Abstract:BACKGROUND AND OBJECTIVE: The artificial segmentation of early gastric cancer (EGC) lesions in gastroscopic images remains a challenging task due to reasons including the diversity of mucosal features, irregular edges of EGC lesions and nuances between EGC lesions and healthy background mucosa. Hence, this study proposed an automatic segmentation framework: co-spatial attention and channel attention based triple-branch ResUnet (CSA-CA-TB-ResUnet) to achieve accurate segmentation of EGC lesions for aiding clinical diagnosis and treatment.METHODS: The input gastroscopic image sequences of the triple-branch segmentation network CSA-CA-TB-ResUnet is firstly generated by the designed multi-branch input preprocessing (MBIP) module in order to fully utilize massive correlation information among multiple gastroscopic images of the same a lesion. Then, the proposed CSA-CA-TB-ResUnet performs the segmentation of EGC lesion, in which the co-spatial attention (CSA) mechanism is designed to activate the spatial location of EGC lesions by leveraging on the correlations among multiple gastroscopic images of the same EGC lesion, and the channel attention (CA) mechanism is introduced to extract subtle discriminative features of EGC lesions by capturing the interdependencies between channel features. Finally, two gastroscopic images datasets from different digestive endoscopic centers in the southwest and northeast regions of China respectively were collected to validate the performances of proposed segmentation method.RESULTS: The correlation information among gastroscopic images was confirmed to be able to improve the accuracy of EGC segmentation. On another unseen dataset, our EGC segmentation method achieves Jaccard similarity index (JSI) of 84.54% (95% confidence interval (CI), 83.49%-85.56%), threshold Jaccard index (TJI) of 81.73% (95% CI, 79.70%-83.61%), Dice similarity coefficient (DSC) of 91.08% (95% CI, 90.40%-91.76%) and pixel-wise accuracy (PA) of 91.18% (95% CI, 90.43%-91.87%), which is superior to other state-of-the-art methods. Even on the challenging small lesions, the segmentation results of our CSA-CA-TB-ResUnet-based method are consistently and significantly better than other state-of-the-art methods. We also compared the segmentation result of our model with the diagnostic accuracy with junior/senior expert. The comparison results indicated that our model performed better than the junior expert.CONCLUSIONS: This study proposed a novel CSA-CA-TB-ResUnet-based EGC segmentation method and it has a potential for real-time application in improving EGC clinical diagnosis and minimally invasive surgery.

Keratinocyte growth factor: effects on keratinocytes and mechanisms of action.

Real-Time Multi-Label Upper Gastrointestinal Anatomy Recognition from Gastroscope Videos

Multi-phase Liver Tumor Segmentation with Spatial Aggregation and Uncertain Region Inpainting

Multi-label Recognition of Cancer-Related Lesions with Clinical Priors on White-Light Endoscopy

Multi-task Learning for Segmentation and Classification of Tumors in 3D Automated Breast Ultrasound Images

Multi-Task Refined Boundary-Supervision U-Net (Mrbsu-Net) for Gastrointestinal Stromal Tumor Segmentation in Endoscopic Ultrasound (EUS) Images

A deep learning–based system to identify originating mural layer of upper gastrointestinal submucosal tumors under EUS

3D Multi-Attention Guided Multi-Task Learning Network for Automatic Gastric Tumor Segmentation and Lymph Node Classification.

Early gastric cancer segmentation in gastroscopic images using a co-spatial attention and channel attention based triple-branch ResUnet

Gastrointestinal Stromal Tumors Diagnosis on Multi-Center Endoscopic Ultrasound Images Using Multi-Scale Image Normalization and Transfer Learning

A Deep Learning-Based System to Identify Originating Mucosal Layer of Upper Gastrointestinal Submucosal Tumors on Endoscopic Ultrasound Images

TN-USMA Net: Triple Normalization-Based Gastrointestinal Stromal Tumors Classification on Multicenter EUS Images with Ultrasound-Specific Pretraining and Meta Attention.

PheoSeg: A 3D transfer learning framework for accurate abdominal CT pheochromocytoma segmentation and surgical grade prediction

Anything goes on the path to universal health coverage? No.

Unsupervised Multi-Task Learning for 3D Subtomogram Image Alignment, Clustering and Segmentation.

A Deep Multi-Task Learning Framework for Brain Tumor Segmentation

Segmentation Prompts Classification: A Nnunet-Based 3D Transfer Learning Framework with ROI Tokenization and Cross-Task Attention for Esophageal Cancer T-stage Diagnosis

Large-scale Gastric Cancer Screening and Localization Using Multi-task Deep Neural Network

Multi-task Learning of Histology and Molecular Markers for Classifying Diffuse Glioma

MSI-UNet: A Flexible UNet-Based Multi-Scale Interactive Framework for 3D Gastric Tumor Segmentation on CT Scans

CDI-NSTSEG: A clinical diagnosis-inspired effective and efficient framework for non-salient small tumor segmentation