Abstract:BACKGROUND AND OBJECTIVE: The artificial segmentation of early gastric cancer (EGC) lesions in gastroscopic images remains a challenging task due to reasons including the diversity of mucosal features, irregular edges of EGC lesions and nuances between EGC lesions and healthy background mucosa. Hence, this study proposed an automatic segmentation framework: co-spatial attention and channel attention based triple-branch ResUnet (CSA-CA-TB-ResUnet) to achieve accurate segmentation of EGC lesions for aiding clinical diagnosis and treatment.METHODS: The input gastroscopic image sequences of the triple-branch segmentation network CSA-CA-TB-ResUnet is firstly generated by the designed multi-branch input preprocessing (MBIP) module in order to fully utilize massive correlation information among multiple gastroscopic images of the same a lesion. Then, the proposed CSA-CA-TB-ResUnet performs the segmentation of EGC lesion, in which the co-spatial attention (CSA) mechanism is designed to activate the spatial location of EGC lesions by leveraging on the correlations among multiple gastroscopic images of the same EGC lesion, and the channel attention (CA) mechanism is introduced to extract subtle discriminative features of EGC lesions by capturing the interdependencies between channel features. Finally, two gastroscopic images datasets from different digestive endoscopic centers in the southwest and northeast regions of China respectively were collected to validate the performances of proposed segmentation method.RESULTS: The correlation information among gastroscopic images was confirmed to be able to improve the accuracy of EGC segmentation. On another unseen dataset, our EGC segmentation method achieves Jaccard similarity index (JSI) of 84.54% (95% confidence interval (CI), 83.49%-85.56%), threshold Jaccard index (TJI) of 81.73% (95% CI, 79.70%-83.61%), Dice similarity coefficient (DSC) of 91.08% (95% CI, 90.40%-91.76%) and pixel-wise accuracy (PA) of 91.18% (95% CI, 90.43%-91.87%), which is superior to other state-of-the-art methods. Even on the challenging small lesions, the segmentation results of our CSA-CA-TB-ResUnet-based method are consistently and significantly better than other state-of-the-art methods. We also compared the segmentation result of our model with the diagnostic accuracy with junior/senior expert. The comparison results indicated that our model performed better than the junior expert.CONCLUSIONS: This study proposed a novel CSA-CA-TB-ResUnet-based EGC segmentation method and it has a potential for real-time application in improving EGC clinical diagnosis and minimally invasive surgery.

Surgical Region of Interest Detection from Laparoscopic Images Using Boundary Fuzziness

Segmentation for CT Image Based on Improved Level-Set Approach

Interactive Liver Segmentation in CT Volumes Using Fully Convolutional Networks.

DeepRecS: From RECIST Diameters to Precise Liver Tumor Segmentation

Automated Assessment of Critical View of Safety in Laparoscopic Cholecystectomy

Strategies to Improve Real-World Applicability of Laparoscopic Anatomy Segmentation Models

CholecSeg8k: A Semantic Segmentation Dataset for Laparoscopic Cholecystectomy Based on Cholec80

LapSeg3D: Weakly Supervised Semantic Segmentation of Point Clouds Representing Laparoscopic Scenes

Fully automatic liver segmentation combining multi-dimensional graph cut with shape information in 3D CT images

Use of Deep Learning for Liver Segmentation During Laparoscopic Cholecystectomy

A Hierarchical Local Region-Based Sparse Shape Composition for Liver Segmentation in CT Scans.

Semi-automatic Liver Segmentation in CT Images Through Intensity Separation and Region Growing

Fast Medical Image Auto-segmentation for Bleeding Gastric Tissue Detection Based on Deep DuS-KFCM Clustering

3d Liver Segmentation Using Multiple Region Appearances And Graph Cuts

Enhancing Diagnostic Precision in Gastric Bleeding through Automated Lesion Segmentation: A Deep DuS-KFCM Approach

Early gastric cancer segmentation in gastroscopic images using a co-spatial attention and channel attention based triple-branch ResUnet

Intraoperative laparoscopic liver surface registration with preoperative CT using mixing features and overlapping region masks

Lesion-Decoupling-Based Segmentation with Large-Scale Colon and Esophageal Datasets for Early Cancer Diagnosis

Topology-preserving segmentation of abdominal muscle layers from ultrasound images

Fully Automatic Liver Segmentation in CT Images Using Modified Graph Cuts and Feature Detection.

Partial Labeled Gastric Tumor Segmentation via patch-based Reiterative Learning