Abstract:Background The early diagnosis of various gastrointestinal diseases can lead to effective treatment and reduce the risk of many life-threatening conditions. Unfortunately, various small gastrointestinal lesions are undetectable during early-stage examination by medical experts. In previous studies, various deep learning–based computer-aided diagnosis tools have been used to make a significant contribution to the effective diagnosis and treatment of gastrointestinal diseases. However, most of these methods were designed to detect a limited number of gastrointestinal diseases, such as polyps, tumors, or cancers, in a specific part of the human gastrointestinal tract. Objective This study aimed to develop a comprehensive computer-aided diagnosis tool to assist medical experts in diagnosing various types of gastrointestinal diseases. Methods Our proposed framework comprises a deep learning–based classification network followed by a retrieval method. In the first step, the classification network predicts the disease type for the current medical condition. Then, the retrieval part of the framework shows the relevant cases (endoscopic images) from the previous database. These past cases help the medical expert validate the current computer prediction subjectively, which ultimately results in better diagnosis and treatment. Results All the experiments were performed using 2 endoscopic data sets with a total of 52,471 frames and 37 different classes. The optimal performances obtained by our proposed method in accuracy, F1 score, mean average precision, and mean average recall were 96.19%, 96.99%, 98.18%, and 95.86%, respectively. The overall performance of our proposed diagnostic framework substantially outperformed state-of-the-art methods. Conclusions This study provides a comprehensive computer-aided diagnosis framework for identifying various types of gastrointestinal diseases. The results show the superiority of our proposed method over various other recent methods and illustrate its potential for clinical diagnosis and treatment. Our proposed network can be applicable to other classification domains in medical imaging, such as computed tomography scans, magnetic resonance imaging, and ultrasound sequences.

A review of deep learning methods for gastrointestinal diseases classification applied in computer-aided diagnosis system

Review on the Applications of Deep Learning in the Analysis of Gastrointestinal Endoscopy Images

Deep learning for gastroscopic images: computer-aided techniques for clinicians

An efficient computational framework for gastrointestinal disorder prediction using attention-based transfer learning

Gastrointestinal Disease Classification in Endoscopic Images Using Attention-Guided Convolutional Neural Networks

Identification of Upper Gastrointestinal Diseases during Screening Gastroscopy through Deep Convolutional Neural Network Algorithm

A review of medical image detection for cancers in digestive system based on artificial intelligence

Deep Learning and Gastric Cancer: Systematic Review of AI-Assisted Endoscopy

Application of deep learning in image recognition and diagnosis of gastric cancer

Deep Learning Approaches to Colorectal Cancer Diagnosis: A Review

Review of Intelligent Diagnosis Methods for Imaging Gland Cancer Based on Machine Learning

Identification of Upper GI Diseases During Screening Gastroscopy Using a Deep Convolutional Neural Network Algorithm.

Role of artificial intelligence in multidisciplinary imaging diagnosis of gastrointestinal diseases

Research of Deep Learning on Gastric Cancer Diagnosis

Deep learning for gastric location classification: An analysis of location boundaries and improvements through attention and contrastive learning

Automated Diagnosis of Various Gastrointestinal Lesions Using a Deep Learning–Based Classification and Retrieval Framework With a Large Endoscopic Database: Model Development and Validation

A comprehensive survey of intestine histopathological image analysis using machine vision approaches

Deep learning for pancreatic diseases based on endoscopic ultrasound: A systematic review

Detection of multiple lesions of gastrointestinal tract for endoscopy using artificial intelligence model: a pilot study

Deep Learning-Based Anatomical Site Classification for Upper Gastrointestinal Endoscopy

Review of Deep Learning Performance in Wireless Capsule Endoscopy Images for GI Disease Classification