Abstract:BACKGROUND & AIMS: Capsule endoscopy has revolutionized investigation of the small bowel. However, this technique produces a video that is 8-10 hours long, so analysis is time consuming for gastroenterologists. Deep convolutional neural networks (CNNs) can recognize specific images among a large variety. We aimed to develop a CNN-based algorithm to assist in the evaluation of small bowel capsule endoscopy (SB-CE) images. METHODS: We collected 113,426,569 images from 6970 patients who had SB-CE at 77 medical centers from July 2016 through July 2018. A CNN-based auxiliary reading model was trained to differentiate abnormal from normal images using 158,235 SB-CE images from 1970 patients. Images were categorized as normal, inflammation, ulcer, polyps, lymphangiectasia, bleeding, vascular disease, protruding lesion, lymphatic follicular hyperplasia, diverticulum, parasite, and other. The model was further validated in 5000 patients (no patient was overlap with the 1970 patients in the training set); the same patients were evaluated by conventional analysis and CNN-based auxiliary analysis by 20 gastroenterologists. If there was agreement in image categorization between the conventional analysis and CNN model, no further evaluation was performed. If there was disagreement between the conventional analysis and CNN model, the gastroenterologists re-evaluated the image to confirm or reject the CNN categorization. RESULTS: In the SB-CE images from the validation set, 4206 abnormalities in 3280 patients were identified after final consensus evaluation. The CNN-based auxiliary model identified abnormalities with 99.88% sensitivity in the per-patient analysis (95% CI, 99.67-99.96) and 99.90% sensitivity in the per-lesion analysis (95% CI, 99.74-99.97). Conventional reading by the gastroenterologists identified abnormalities with 74.57% sensitivity (95% CI, 73.05-76.03) in the per-patient analysis and 76.89% in the per-lesion analysis (95% CI, 75.58-78.15). The mean reading time per patient was 96.6 +/- 22.53 minutes by conventional reading and 5.9 +/- 2.23 minutes by CNN-based auxiliary reading (P < .001). CONCLUSIONS: We validated the ability of a CNN-based algorithm to identify abnormalities in SB-CE images. The CNN-based auxiliary model identified abnormalities with higher levels of sensitivity and significantly shorter reading times than conventional analysis by gastroenterologists. This algorithm provides an important tool to help gastroenterologists analyze SB-CE images more efficiently and more accurately.

Automated detection of ulcers and erosions in capsule endoscopy images using a convolutional neural network

Artificial Intelligence and colon capsule endoscopy: Automatic detection of ulcers and erosions using a convolutional neural network

Artificial intelligence and capsule endoscopy: automatic detection of vascular lesions using a convolutional neural network

Deep learning and colon capsule endoscopy: automatic detection of blood and colonic mucosal lesions using a convolutional neural network

Deep-Learning and Device-Assisted Enteroscopy: Automatic Panendoscopic Detection of Ulcers and Erosions

Artificial intelligence and colon capsule endoscopy: automatic detection of blood in colon capsule endoscopy using a convolutional neural network

Artificial intelligence using a convolutional neural network for automatic detection of small‐bowel angioectasia in capsule endoscopy images

Gastroenterologist-Level Identification of Small-Bowel Diseases and Normal Variants by Capsule Endoscopy Using a Deep-Learning Model

Automated Detection of Small Bowel Lesions Based on Capsule Endoscopy Using Deep Learning Algorithm

Artificial intelligence to improve polyp detection and screening time in colon capsule endoscopy

Efficacy of a comprehensive binary classification model using a deep convolutional neural network for wireless capsule endoscopy

Improved classification and localization approach to small bowel capsule endoscopy using convolutional neural network

A Systematic Evaluation and Optimization of Automatic Detection of Ulcers in Wireless Capsule Endoscopy on a Large Dataset Using Deep Convolutional Neural Networks.

P469 Deep learning and minimally invasive endoscopy – panendoscopic detection of pleomorphic lesions

P268 Artificial Intelligence and Panendoscopy – Automatic Detection of Pleomorphic Lesions in Multibrand Device-Assisted Enteroscopy

Artificial Intelligence and Panendoscopy—Automatic Detection of Clinically Relevant Lesions in Multibrand Device-Assisted Enteroscopy

Assessment of Crohn’s Disease Lesions in Wireless Capsule Endoscopy Images

Deep learning and minimally invasive inflammatory activity assessment: a proof-of-concept study for development and score correlation of a panendoscopy convolutional network

Computer-aided detection of small intestinal ulcer and erosion in wireless capsule endoscopy images.

Deep Convolutional Neural Network for Ulcer Recognition in Wireless Capsule Endoscopy: Experimental Feasibility and Optimization

Use of artificial intelligence for detection of gastric lesions by magnetically controlled capsule endoscopy