Abstract:Background The early diagnosis of various gastrointestinal diseases can lead to effective treatment and reduce the risk of many life-threatening conditions. Unfortunately, various small gastrointestinal lesions are undetectable during early-stage examination by medical experts. In previous studies, various deep learning–based computer-aided diagnosis tools have been used to make a significant contribution to the effective diagnosis and treatment of gastrointestinal diseases. However, most of these methods were designed to detect a limited number of gastrointestinal diseases, such as polyps, tumors, or cancers, in a specific part of the human gastrointestinal tract. Objective This study aimed to develop a comprehensive computer-aided diagnosis tool to assist medical experts in diagnosing various types of gastrointestinal diseases. Methods Our proposed framework comprises a deep learning–based classification network followed by a retrieval method. In the first step, the classification network predicts the disease type for the current medical condition. Then, the retrieval part of the framework shows the relevant cases (endoscopic images) from the previous database. These past cases help the medical expert validate the current computer prediction subjectively, which ultimately results in better diagnosis and treatment. Results All the experiments were performed using 2 endoscopic data sets with a total of 52,471 frames and 37 different classes. The optimal performances obtained by our proposed method in accuracy, F1 score, mean average precision, and mean average recall were 96.19%, 96.99%, 98.18%, and 95.86%, respectively. The overall performance of our proposed diagnostic framework substantially outperformed state-of-the-art methods. Conclusions This study provides a comprehensive computer-aided diagnosis framework for identifying various types of gastrointestinal diseases. The results show the superiority of our proposed method over various other recent methods and illustrate its potential for clinical diagnosis and treatment. Our proposed network can be applicable to other classification domains in medical imaging, such as computed tomography scans, magnetic resonance imaging, and ultrasound sequences.

Transfer Learning in Endoscopic Imaging: A Machine Vision Approach to GIT Disease Identification

Automated gastrointestinal abnormalities detection from endoscopic images

Deep learning-based prediction model for diagnosing gastrointestinal diseases using endoscopy images

Gastrointestinal Endoscopic Image Classification using Transfer Learning

Efficient-gastro: optimized EfficientNet model for the detection of gastrointestinal disorders using transfer learning and wireless capsule endoscopy images

Enhancing image-based diagnosis of gastrointestinal tract diseases through deep learning with EfficientNet and advanced data augmentation techniques

Gastrointestinal Disease Classification in Endoscopic Images Using Attention-Guided Convolutional Neural Networks

Deep convolutional neural networks with ensemble learning and transfer learning for automated detection of gastrointestinal diseases

Gastrointestinal Tract Disease Classification from Wireless Endoscopy Images Using Pretrained Deep Learning Model

Learning Through Guidance: Knowledge Distillation for Endoscopic Image Classification

A Translational Pathway of Deep Learning Methods in GastroIntestinal Endoscopy.

Advanced CNN models in gastric cancer diagnosis: enhancing endoscopic image analysis with deep transfer learning

DCDS-Net: Deep Transfer Network Based on Depth-Wise Separable Convolution with Residual Connection for Diagnosing Gastrointestinal Diseases

Deep neural models for automated multi-task diagnostic scan management—quality enhancement, view classification and report generation

Automated Diagnosis of Various Gastrointestinal Lesions Using a Deep Learning–Based Classification and Retrieval Framework With a Large Endoscopic Database: Model Development and Validation

Preparation of image databases for artificial intelligence algorithm development in gastrointestinal endoscopy

Automatic disease detection in endoscopy with light weight transformer

Automated Identification of Human Gastrointestinal Tract Abnormalities Based on Deep Convolutional Neural Network with Endoscopic Images

Hybrid and Deep Learning Approach for Early Diagnosis of Lower Gastrointestinal Diseases

Employing deep learning and transfer learning for accurate brain tumor detection

Deep Transfer Learning Approaches to Predict Glaucoma, Cataract, Choroidal Neovascularization, Diabetic Macular Edema, DRUSEN and Healthy Eyes: An Experimental Review