Abstract:BACKGROUND AND OBJECTIVE: The artificial segmentation of early gastric cancer (EGC) lesions in gastroscopic images remains a challenging task due to reasons including the diversity of mucosal features, irregular edges of EGC lesions and nuances between EGC lesions and healthy background mucosa. Hence, this study proposed an automatic segmentation framework: co-spatial attention and channel attention based triple-branch ResUnet (CSA-CA-TB-ResUnet) to achieve accurate segmentation of EGC lesions for aiding clinical diagnosis and treatment.METHODS: The input gastroscopic image sequences of the triple-branch segmentation network CSA-CA-TB-ResUnet is firstly generated by the designed multi-branch input preprocessing (MBIP) module in order to fully utilize massive correlation information among multiple gastroscopic images of the same a lesion. Then, the proposed CSA-CA-TB-ResUnet performs the segmentation of EGC lesion, in which the co-spatial attention (CSA) mechanism is designed to activate the spatial location of EGC lesions by leveraging on the correlations among multiple gastroscopic images of the same EGC lesion, and the channel attention (CA) mechanism is introduced to extract subtle discriminative features of EGC lesions by capturing the interdependencies between channel features. Finally, two gastroscopic images datasets from different digestive endoscopic centers in the southwest and northeast regions of China respectively were collected to validate the performances of proposed segmentation method.RESULTS: The correlation information among gastroscopic images was confirmed to be able to improve the accuracy of EGC segmentation. On another unseen dataset, our EGC segmentation method achieves Jaccard similarity index (JSI) of 84.54% (95% confidence interval (CI), 83.49%-85.56%), threshold Jaccard index (TJI) of 81.73% (95% CI, 79.70%-83.61%), Dice similarity coefficient (DSC) of 91.08% (95% CI, 90.40%-91.76%) and pixel-wise accuracy (PA) of 91.18% (95% CI, 90.43%-91.87%), which is superior to other state-of-the-art methods. Even on the challenging small lesions, the segmentation results of our CSA-CA-TB-ResUnet-based method are consistently and significantly better than other state-of-the-art methods. We also compared the segmentation result of our model with the diagnostic accuracy with junior/senior expert. The comparison results indicated that our model performed better than the junior expert.CONCLUSIONS: This study proposed a novel CSA-CA-TB-ResUnet-based EGC segmentation method and it has a potential for real-time application in improving EGC clinical diagnosis and minimally invasive surgery.

A high-level feature channel attention UNet network for cholangiocarcinoma segmentation from microscopy hyperspectral images

Eres-UNet++: Liver CT image segmentation based on high-efficiency channel attention and Res-UNet++

Attention Unet++: A Nested Attention-Aware U-Net for Liver CT Image Segmentation

Channel-Unet: A Spatial Channel-Wise Convolutional Neural Network for Liver and Tumors Segmentation

U-Net combined with multi-scale attention mechanism for liver segmentation in CT images

Attention Augmented ConvNeXt UNet For Rectal Tumour Segmentation

Segmentation of pancreatic tumors based on multi‐scale convolution and channel attention mechanism in the encoder‐decoder scheme

A Multi-Scale Liver Tumor Segmentation Method Based on Residual and Hybrid Attention Enhanced Network with Contextual Integration

X-Net: Multi-branch UNet-like network for liver and tumor segmentation from 3D abdominal CT scans

Research on improved Unet in microscopic image segmentation of esophageal cancer

Early gastric cancer segmentation in gastroscopic images using a co-spatial attention and channel attention based triple-branch ResUnet

DASGC-Unet: An Attention Network for Accurate Segmentation of Liver CT Images

Adaptive Attention Convolutional Neural Network for Liver Tumor Segmentation

CrossU-Net: Dual-modality cross-attention U-Net for segmentation of precancerous lesions in gastric cancer

A Deep Attention Network Via High-Resolution Representation for Liver and Liver Tumor Segmentation

Application of U-Shaped Convolutional Neural Network Based on Attention Mechanism in Liver CT Image Segmentation

Lgma-net: liver and tumor segmentation methods based on local–global feature mergence and attention mechanisms

Densely Connected U-Net with Criss-Cross Attention for Automatic Liver Tumor Segmentation in CT Images

HES-UNet: A U-Net for Hepatic Echinococcosis Lesion Segmentation

Research on Liver Cancer Segmentation Method Based on PCNN Image Processing and SE-ResUnet

ResNet-50 Based Method for Cholangiocarcinoma Identification from Microscopic Hyperspectral Pathology Images