Abstract:Compared with other forms of cancer, gastric cancer has high mortality and incidence rates, making it a major cause of death worldwide. Accurate diagnosis is crucial in the treatment of stomach cancer. Researchers have used deep learning techniques facilitated by developments in artificial intelligence to classify and segment endoscopic images of stomach cancer. Most recent research examining endoscopic images of stomach cancer has used a binary classification system, which is insufficient for practical use. False-positives and computational costs become problematic when segmentation is applied to all the images of healthy patients obtained throughout the evaluation. Hence, the expected level of performance has not been attained in the real-time multiclassification and segmentation of stomach cancer. In this study, we present a deep learning-based technique for multiclassification of endoscopic images by combining modified GoogLeNet and vision transformer (ViT) models and identifying invasive areas based on Faster R-CNN. The classification of endoscopic images into three categories, namely, normal, early gastric cancer, and advanced gastric cancer, is accomplished by using a hybrid approach including modified GoogLeNet and vision transformer (ViT) models. Gastric cancer regions are then identified and segmented in the endoscopic images using the Faster R-CNN method. The Faster R-CNN algorithm is used with an endoscopic image as input, resulting in the generation of a bounding box and label image that accurately represents the gastric cancerous area. The proposed model achieved an accuracy, sensitivity and F1-score of 97.4%, 97.5% and 95.9%, respectively, for the classification of noncancerous, early gastric cancer and advanced gastric cancer. Furthermore, the performance of the segmentation method was also validated based on evaluation metrics and achieved 96.7%, 96.6% and 95.5% accuracy, sensitivity and F1-score, respectively, for the segmentation of noncancerous, early gastric cancer and advanced gastric cancer tissues. In conclusion, the method proposed in this study demonstrates enhanced global classification and detection performance compared to existing state-of-the-art algorithms. This finding underscores the significant potential of the proposed method in the domain of gastric endoscopic image classification and segmentation.

An Early Gastric Cancer Detection Method Based on DETR Multi-scale Feature Fusion

TSO-DETR: A Network for Small Object Detection of Cervical Cells in TCT Smear

Multimodal Fusion with Cross-attention Transformer for HCC Early Recurrence Prediction from Multi-Phase CT and Clinical Data

Early gastric cancer detection and lesion segmentation based on deep learning and gastroscopic images

Application of Improved Mask R-CNN Algorithm Based on Gastroscopic Image in Detection of Early Gastric Cancer

Cervical Cancer Cell Detection Based on Multi-Scale Feature Fusion

Cluster-Induced Mask Transformers for Effective Opportunistic Gastric Cancer Screening on Non-contrast CT Scans

Content‐based Gastric Image Retrieval Using Convolutional Neural Networks

Gastric Polyp Detection Module Based on Improved Attentional Feature Fusion.

Accurate Gastric Cancer Segmentation in Digital Pathology Images Using Deformable Convolution and Multi-Scale Embedding Networks

Leveraging Multimodal Semantic Fusion for Gastric Cancer Screening via Hierarchical Attention Mechanism

A novel approach for early gastric cancer detection using a hybrid of alexnet, extreme learning machine, and adjusted gorilla troops optimization

Automatic disease detection in endoscopy with light weight transformer

Accurate multiclassification and segmentation of gastric cancer based on a hybrid cascaded deep learning model with a vision transformer from endoscopic images

Optimizing MobileNetV2 for improved accuracy in early gastric cancer detection based on dynamic pelican optimizer

Enhancing gastric cancer early detection: A multi-verse optimized feature selection model with crossover-information feedback

Automatic Gastric Polyp Detection by Using Convolutional Neural Networks

Automated Disease Detection in Gastroscopy Videos Using Convolutional Neural Networks

Large-scale Gastric Cancer Screening and Localization Using Multi-task Deep Neural Network

Development of a deep learning model for early gastric cancer diagnosis using preoperative computed tomography images

Histopathological Gastric Cancer Detection on GasHisSDB Dataset Using Deep Ensemble Learning