Abstract:<section class="article-section__content"><h3 class="article-section__sub-title section1"> Background</h3><p>Although great advances in artificial intelligence for interpreting small bowel capsule endoscopy (SBCE) images have been made in recent years, its practical use is still limited. The aim of this study was to develop a more practical convolutional neural network (CNN) algorithm for the automatic detection of various small bowel lesions.</p></section><section class="article-section__content"><h3 class="article-section__sub-title section1"> Methods</h3><p>A total of 7,556 images were collected for the training dataset from 526 SBCE videos. Abnormal images were classified into two categories: hemorrhagic lesions (red spot/angioectasia/active bleeding) and ulcerative lesions (erosion/ulcer/stricture). A CNN algorithm based on VGGNet was trained in two different ways: the combined model (hemorrhagic and ulcerative lesions trained separately) and the binary model (all abnormal images trained without discrimination). The detected lesions were visualized using a gradient class activation map (Grad‐CAM). The two models were validated using 5,760 independent images taken at two other academic hospitals.</p></section><section class="article-section__content"><h3 class="article-section__sub-title section1"> Results</h3><p>Both the combined and binary models acquired high accuracy for lesion detection, and the difference between the two models was not significant (96.83% vs. 96.62%, p=0.122). However, the combined model showed higher sensitivity (97.61% vs. 95.07%, p<0.001) and higher accuracy for individual lesions from the hemorrhagic and ulcerative categories than the binary model. The combined model also revealed more accurate localization of the culprit area on images evaluated by the Grad‐CAM.</p></section><section class="article-section__content"><h3 class="article-section__sub-title section1"> Conclusions</h3><p>Diagnostic sensitivity and classification of small bowel lesions using a convolutional neural network are improved by the independent training for hemorrhagic and ulcerative lesions. Grad‐CAM is highly effective in localizing the lesions.</p></section>

Convolutional‐capsule network for gastrointestinal endoscopy image classification

Residual Convolutional Neural Networks With Global And Local Pathways For Classification Of Focal Liver Lesions

Capsule Endoscopy Image Classification with Deep Convolutional Neural Networks

CasCRNN-GL-Net: Cascaded Convolutional and Recurrent Neural Networks with Global and Local Pathways for Classification of Focal Liver Lesions in Multi-Phase CT Images

Classification of Endoscopy and Video Capsule Images using CNN-Transformer Model

Improved classification and localization approach to small bowel capsule endoscopy using convolutional neural network

Automated Identification of Human Gastrointestinal Tract Abnormalities Based on Deep Convolutional Neural Network with Endoscopic Images

Anatomical sites identification in both ordinary and capsule gastroduodenoscopy via deep learning

Gastrointestinal Endoscopic Image Classification using Transfer Learning

Video Capsule Endoscopy Classification using Focal Modulation Guided Convolutional Neural Network

Gastrointestinal Disease Classification in Endoscopic Images Using Attention-Guided Convolutional Neural Networks

Tu1075 DEEP CONVOLUTIONAL NEURAL NETWORKS FOR RECOGNITION OF ATROPHIC GASTRITIS AND INTESTINAL METAPLASIA BASED ON ENDOSCOPY IMAGES

Effective High-to-low-level Feature Aggregation Network for Endoscopic Image Classification

Deep convolutional neural networks with ensemble learning and transfer learning for automated detection of gastrointestinal diseases

Capsule Endoscopy Multi-classification via Gated Attention and Wavelet Transformations

Hierarchical Deep Convolutional Neural Networks for Multi-category Diagnosis of Gastrointestinal Disorders on Histopathological Images

Multi-Task Classification and Segmentation for Explicable Capsule Endoscopy Diagnostics

A Systematic Evaluation and Optimization of Automatic Detection of Ulcers in Wireless Capsule Endoscopy on a Large Dataset Using Deep Convolutional Neural Networks.

Advanced CNN models in gastric cancer diagnosis: enhancing endoscopic image analysis with deep transfer learning

CG‐Net: A novel CNN framework for gastrointestinal tract diseases classification

Precise localization within the GI tract by combining classification of CNNs and time-series analysis of HMMs