Abstract:Compared with other forms of cancer, gastric cancer has high mortality and incidence rates, making it a major cause of death worldwide. Accurate diagnosis is crucial in the treatment of stomach cancer. Researchers have used deep learning techniques facilitated by developments in artificial intelligence to classify and segment endoscopic images of stomach cancer. Most recent research examining endoscopic images of stomach cancer has used a binary classification system, which is insufficient for practical use. False-positives and computational costs become problematic when segmentation is applied to all the images of healthy patients obtained throughout the evaluation. Hence, the expected level of performance has not been attained in the real-time multiclassification and segmentation of stomach cancer. In this study, we present a deep learning-based technique for multiclassification of endoscopic images by combining modified GoogLeNet and vision transformer (ViT) models and identifying invasive areas based on Faster R-CNN. The classification of endoscopic images into three categories, namely, normal, early gastric cancer, and advanced gastric cancer, is accomplished by using a hybrid approach including modified GoogLeNet and vision transformer (ViT) models. Gastric cancer regions are then identified and segmented in the endoscopic images using the Faster R-CNN method. The Faster R-CNN algorithm is used with an endoscopic image as input, resulting in the generation of a bounding box and label image that accurately represents the gastric cancerous area. The proposed model achieved an accuracy, sensitivity and F1-score of 97.4%, 97.5% and 95.9%, respectively, for the classification of noncancerous, early gastric cancer and advanced gastric cancer. Furthermore, the performance of the segmentation method was also validated based on evaluation metrics and achieved 96.7%, 96.6% and 95.5% accuracy, sensitivity and F1-score, respectively, for the segmentation of noncancerous, early gastric cancer and advanced gastric cancer tissues. In conclusion, the method proposed in this study demonstrates enhanced global classification and detection performance compared to existing state-of-the-art algorithms. This finding underscores the significant potential of the proposed method in the domain of gastric endoscopic image classification and segmentation.

Automatic Classification of Gastric Lesions in Gastroscopic Images Using a Lightweight Deep Learning Model with Attention Mechanism and Cost-Sensitive Learning

Artificial intelligence based on deep learning for automatic detection of early gastric cancer

A deep learning-based model improves diagnosis of early gastric cancer under narrow band imaging endoscopy

Application of deep learning in the real-time diagnosis of gastric lesion based on magnifying optical enhancement videos

Diagnosis and segmentation effect of the ME-NBI-based deep learning model on gastric neoplasms in patients with suspected superficial lesions - a multicenter study

Identifying early gastric cancer under magnifying narrow-band images with deep learning: a multicenter study

Early gastric cancer detection and lesion segmentation based on deep learning and gastroscopic images

Evaluation of deep learning methods for early gastric cancer detection using gastroscopic images

Deep Learning for Classification and Localization of Early Gastric Cancer in Endoscopic Images.

Fine-tuning Pre-trained Convolutional Neural Networks for Gastric Precancerous Disease Classification on Magnification Narrow-band Imaging Images

Accurate multiclassification and segmentation of gastric cancer based on a hybrid cascaded deep learning model with a vision transformer from endoscopic images

Application of artificial intelligence using a convolutional neural network for diagnosis of early gastric cancer based on magnifying endoscopy with narrow‐band imaging

Convolutional neural network for the diagnosis of early gastric cancer based on magnifying narrow band imaging

A deep-learning based system using multi-modal data for diagnosing gastric neoplasms in real-time (with video)

Image Recognition and Diagnosis System of Early Gastric Cancer Based on Artificial Intelligence Algorithm

A Gastric Cancer Recognition Algorithm on Gastric Pathological Sections Based on Multistage Attention‐densenet

Early diagnosis of gastric cancer based on deep learning combined with the spectral-spatial classification method.

A deep learning-based system for identifying differentiation status and delineating the margins of early gastric cancer in magnifying narrow-band imaging endoscopy

Deep Learning Model for Diagnosing Early Gastric Cancer Using Preoperative Computed Tomography Images

Transfer Learning with Convolutional Neural Network for Early Gastric Cancer Classification on Magnifiying Narrow-Band Imaging Images

Automated Detection of Precancerous Lesion and Early Esophageal Squamous Cancer Using a Deep Learning Model: 317