Abstract:Esophagogastroduodenoscopy (EGD) is a critical step in the diagnosis of upper gastrointestinal disorders. However, due to inexperience or high workload, there is a wide variation in EGD performance by endoscopists. Variations in performance may result in exams that do not completely cover all anatomical locations of the stomach, leading to a potential risk of missed diagnosis of gastric diseases. Numerous guidelines or expert consensus have been proposed to assess and optimize the quality of endoscopy. However, there is a lack of mature and robust methods to accurately apply to real clinical real-time video environments. In this paper, we innovatively define the problem of recognizing anatomical locations in videos as a multi-label recognition task. This can be more consistent with the model learning of image-to-label mapping relationships. We propose a combined structure of a deep learning model (GL-Net) that combines a graph convolutional network (GCN) with long short-term memory (LSTM) networks to both extract label features and correlate temporal dependencies for accurate real-time anatomical locations identification in gastroscopy videos. Our methodological evaluation dataset is based on complete videos of real clinical examinations. A total of 29,269 images from 49 videos were collected as a dataset for model training and validation. Another 1736 clinical videos were retrospectively analyzed and evaluated for the application of the proposed model. Our method achieves 97.1% mean accuracy (mAP), 95.5% mean per-class accuracy and 93.7% average overall accuracy in a multi-label classification task, and is able to process these videos in real-time at 29.9 FPS. In addition, based on our approach, we designed a system to monitor routine EGD videos in detail and perform statistical analysis of the operating habits of endoscopists, which can be a useful tool to improve the quality of clinical endoscopy.

A deep learning approach for gastroscopic manifestation recognition based on Kyoto Gastritis Score

Real-Time Multi-Label Upper Gastrointestinal Anatomy Recognition from Gastroscope Videos

Tu1075 DEEP CONVOLUTIONAL NEURAL NETWORKS FOR RECOGNITION OF ATROPHIC GASTRITIS AND INTESTINAL METAPLASIA BASED ON ENDOSCOPY IMAGES

Development and Validation of a Deep Learning-Based Approach to Predict the Mayo Endoscopic Score of Ulcerative Colitis

Application of deep learning in image recognition and diagnosis of gastric cancer

Application of Machine Learning in the Diagnosis of Early Gastric Cancer Using the Kyoto Classification Score and Clinical Features Collected from Medical Consultations

Identification of Upper Gastrointestinal Diseases during Screening Gastroscopy through Deep Convolutional Neural Network Algorithm

An artificial intelligence system for chronic atrophic gastritis diagnosis and risk stratification under white light endoscopy

Early gastric cancer detection and lesion segmentation based on deep learning and gastroscopic images

Diagnosing and grading gastric atrophy and intestinal metaplasia using semi-supervised deep learning on pathological images: development and validation study

Artificial intelligence for gastric cancer in endoscopy: From diagnostic reasoning to market

Deep learning for gastroscopic images: computer-aided techniques for clinicians

Application of artificial intelligence-driven endoscopic screening and diagnosis of gastric cancer

A deep learning-based model improves diagnosis of early gastric cancer under narrow band imaging endoscopy

Evaluation of deep learning methods for early gastric cancer detection using gastroscopic images

The Feasibility of Applying Artificial Intelligence to Gastrointestinal Endoscopy to Improve the Detection Rate of Early Gastric Cancer Screening

Application of Artificial Intelligence in Early Gastric Cancer Diagnosis

Diagnosing chronic atrophic gastritis by gastroscopy using artificial intelligence

Automated Disease Detection in Gastroscopy Videos Using Convolutional Neural Networks

Clinically applicable histopathological diagnosis system for gastric cancer detection using deep learning