Abstract:Endoscopy has been routinely used to diagnose stomach diseases including intestinal metaplasia (IM) and gastritis atrophy (GA). Such routine examination usually demands highly skilled radiologists to focus on a single patient with substantial time, causing the following two key challenges: 1) the dependency on the radiologist's experience leading to inconsistent diagnosis results across different radiologists; 2) limited examination efficiency due to the demanding time and energy consumption to the radiologist. This paper proposes to address these two issues in endoscopy using novel machine learning method in three-folds. Firstly, we build a novel and relatively big endoscopy dataset of 21,420 images from the widely used White Light Imaging (WLI) endoscopy and more recent Linked Color Imaging (LCI) endoscopy, which were annotated by experienced radiologists and validated with biopsy results, presenting a benchmark dataset. Secondly, we propose a novel machine learning model inspired by the human visual system, named as local attention grouping, to effectively extract key visual features, which is further improved by learning from multiple randomly selected regional images via ensemble learning. Such a method avoids the significant problem in the deep learning methods that decrease the resolution of original images to reduce the size of input samples, which would remove smaller lesions in endoscopy images. Finally, we propose a dual transfer learning strategy to train the model with co-distributed features between WLI and LCI images to further improve the performance. The experiment results, measured by accuracy, specificity, sensitivity, positive detection rate and negative detection rate, on IM are 99.18 %, 98.90 %, 99.45 %, 99.45 %, 98.91 %, respectively, and on GA are 97.12 %, 95.34 %, 98.90 %, 98.86 %, 95.50 %, respectively, achieving state of the art performance that outperforms current mainstream deep learning models.

Advancing Automatic Gastritis Diagnosis: an Interpretable Multilabel Deep Learning Framework for the Simultaneous Assessment of Multiple Indicators

Real-Time Multi-Label Upper Gastrointestinal Anatomy Recognition from Gastroscope Videos

[A novel attention fusion network-based multiple instance learning framework to automate diagnosis of chronic gastritis with multiple indicators].

Tu1075 DEEP CONVOLUTIONAL NEURAL NETWORKS FOR RECOGNITION OF ATROPHIC GASTRITIS AND INTESTINAL METAPLASIA BASED ON ENDOSCOPY IMAGES

A Deep Learning Network Based on Multi-Scale and Attention for the Diagnosis of Chronic Atrophic Gastritis

GCLDNet: Gastric Cancer Lesion Detection Network Combining Level Feature Aggregation and Attention Feature Fusion

Automatic Classification of Gastric Lesions in Gastroscopic Images Using a Lightweight Deep Learning Model with Attention Mechanism and Cost-Sensitive Learning

Histopathological Diagnosis System for Gastritis Using Deep Learning Algorithm.

A Computer-Assisted Diagnosis System for the Detection of Chronic Gastritis in Endoscopic Images Using A Novel Convolution and Relative Self-Attention Parallel Network

Expert-level classification of gastritis by endoscopy using deep learning: a multicenter diagnostic trial

Diagnosing chronic atrophic gastritis by gastroscopy using artificial intelligence

Accurate Diagnosis and Prognosis Prediction of Gastric Cancer Using Deep Learning on Digital Pathological Images: A Retrospective Multicentre Study

A Benchmark Dataset of Endoscopic Images and Novel Deep Learning Method to Detect Intestinal Metaplasia and Gastritis Atrophy.

Deep Learning for Automatic Diagnosis of Gastric Dysplasia Using Whole-Slide Histopathology Images in Endoscopic Specimens

Artificial intelligence based on deep learning for automatic detection of early gastric cancer

Development of a deep learning-based model to diagnose mixed-type gastric cancer accurately

An Interpretable Deep Learning Model for Identifying the Morphological Characteristics of Dmmr/msi-H Gastric Cancer

A deep learning method to assist with chronic atrophic gastritis diagnosis using white light images

Diagnosing and grading gastric atrophy and intestinal metaplasia using semi-supervised deep learning on pathological images: development and validation study

A deep-learning based system using multi-modal data for diagnosing gastric neoplasms in real-time (with video)

Multi-scale Multi-instance Multi-feature Joint Learning Broad Network (M3JLBN) for Gastric Intestinal Metaplasia Subtype Classification