Abstract:Compared with other forms of cancer, gastric cancer has high mortality and incidence rates, making it a major cause of death worldwide. Accurate diagnosis is crucial in the treatment of stomach cancer. Researchers have used deep learning techniques facilitated by developments in artificial intelligence to classify and segment endoscopic images of stomach cancer. Most recent research examining endoscopic images of stomach cancer has used a binary classification system, which is insufficient for practical use. False-positives and computational costs become problematic when segmentation is applied to all the images of healthy patients obtained throughout the evaluation. Hence, the expected level of performance has not been attained in the real-time multiclassification and segmentation of stomach cancer. In this study, we present a deep learning-based technique for multiclassification of endoscopic images by combining modified GoogLeNet and vision transformer (ViT) models and identifying invasive areas based on Faster R-CNN. The classification of endoscopic images into three categories, namely, normal, early gastric cancer, and advanced gastric cancer, is accomplished by using a hybrid approach including modified GoogLeNet and vision transformer (ViT) models. Gastric cancer regions are then identified and segmented in the endoscopic images using the Faster R-CNN method. The Faster R-CNN algorithm is used with an endoscopic image as input, resulting in the generation of a bounding box and label image that accurately represents the gastric cancerous area. The proposed model achieved an accuracy, sensitivity and F1-score of 97.4%, 97.5% and 95.9%, respectively, for the classification of noncancerous, early gastric cancer and advanced gastric cancer. Furthermore, the performance of the segmentation method was also validated based on evaluation metrics and achieved 96.7%, 96.6% and 95.5% accuracy, sensitivity and F1-score, respectively, for the segmentation of noncancerous, early gastric cancer and advanced gastric cancer tissues. In conclusion, the method proposed in this study demonstrates enhanced global classification and detection performance compared to existing state-of-the-art algorithms. This finding underscores the significant potential of the proposed method in the domain of gastric endoscopic image classification and segmentation.

RFIA-Net: Rich CNN-transformer Network Based on Asymmetric Fusion Feature Aggregation to Classify Stage I Multimodality Oesophageal Cancer Images

Effective High-to-low-level Feature Aggregation Network for Endoscopic Image Classification

EsccNet: A Hybrid CNN and Transformers Model for the Classification of Whole Slide Images of Esophageal Squamous Cell Carcinoma

Three feature streams based on a convolutional neural network for early esophageal cancer identification

Enhancing Colorectal Cancer Diagnosis With Feature Fusion and Convolutional Neural Networks

Multi-Scale Convolution-Transformer Fusion Network for Endoscopic Image Segmentation.

AF-SENet: Classification of Cancer in Cervical Tissue Pathological Images Based on Fusing Deep Convolution Features

A One-Dimensional Convolutional Neural Network Based Deep Learning for High Accuracy Classification of Transformation Stages in Esophageal Squamous Cell Carcinoma Tissue Using Micro-Ftir.

Breast cancer X-ray image staging: based on efficient net with multi-scale fusion and cbam attention

Automatic Classification of Esophageal Lesions in Endoscopic Images Using a Convolutional Neural Network

An efficient medical image classification network based on multi-branch CNN, token grouping Transformer and mixer MLP

Masked Autoencoders with Handcrafted Feature Predictions: Transformer for Weakly Supervised Esophageal Cancer Classification.

AResNet-ViT: A Hybrid CNN-Transformer Network for Benign and Malignant Breast Nodule Classification in Ultrasound Images

Identification of Colon Cancer Using Multi-Scale Feature Fusion Convolutional Neural Network Based on Shearlet Transform

EMOST: A dual-branch hybrid network for medical image fusion via efficient model module and sparse transformer

Accurate multiclassification and segmentation of gastric cancer based on a hybrid cascaded deep learning model with a vision transformer from endoscopic images

Edge-Enhanced Dilated Residual Attention Network for Multimodal Medical Image Fusion

Hybrid CNN and Low-Complexity Transformer Network with Attention-Based Feature Fusion for Predicting Lung Cancer Tumor after Neoadjuvant Chemoimmunotherapy

Development of a multi-fusion convolutional neural network (MF-CNN) for enhanced gastrointestinal disease diagnosis in endoscopy image analysis

Richer fusion network for breast cancer classification based on multimodal data

MFMSNet: A Multi-frequency and Multi-scale Interactive CNN-Transformer Hybrid Network for breast ultrasound image segmentation