Abstract:Capsule endoscopy (CE) is non-invasive and painless during gastrointestinal examination. However, capsule endoscopy can increase the workload of image reviewing for clinicians, making it prone to missed and misdiagnosed diagnoses. Current researches primarily concentrated on binary classifiers, multiple classifiers targeting fewer than four abnormality types and detectors within a specific segment of the digestive tract, and segmenters for a single type of anomaly. Due to intra-class variations, the task of creating a unified scheme for detecting multiple gastrointestinal diseases is particularly challenging. A cascade neural network designed in this study, Cascade-EC, can automatically identify and localize four types of gastrointestinal lesions in CE images: angiectasis, bleeding, erosion, and polyp. Cascade-EC consists of EfficientNet for image classification and CA_stm_Retinanet for lesion detection and location. As the first layer of Cascade-EC, the EfficientNet network classifies CE images. CA_stm_Retinanet, as the second layer, performs the target detection and location task on the classified image. CA_stm_Retinanet adopts the general architecture of Retinanet. Its feature extraction module is the CA_stm_Backbone from the stack of CA_stm Block. CA_stm Block adopts the split-transform-merge strategy and introduces the coordinate attention. The dataset in this study is from Shanghai East Hospital, collected by PillCam SB3 and AnKon capsule endoscopes, which contains a total of 7936 images of 317 patients from the years 2017 to 2021. In the testing set, the average precision of Cascade-EC in the multi-lesions classification task was 94.55%, the average recall was 90.60%, and the average F1 score was 92.26%. The mean mAP@ 0.5 of Cascade-EC for detecting the four types of diseases is 85.88%. The experimental results show that compared with a single target detection network, Cascade-EC has better performance and can effectively assist clinicians to classify and detect multiple lesions in CE images.

CLELNet: A continual learning network for esophageal lesion analysis on endoscopic images.

ELNet:Automatic classification and segmentation for esophageal lesions using convolutional neural network

Esophageal Squamous Cell Carcinoma Recognition Based on Lightweight Residual Networks with an Attention Mechanism

Evolutionary Neural Architecture Search for Automatic Esophageal Lesion Identification and Segmentation

Tu2005 DEVELOPMENT AND VALIDATION OF A DEEP LEARNING ALGORITHM FOR DETECTION AND RECOGNITION OF PRECANCEROUS LESION IN ESOPHAGUS

CEUSegNet: A Cross-Modality Lesion Segmentation Network for Contrast-Enhanced Ultrasound

CLECG: A Novel Contrastive Learning Framework for Electrocardiogram Arrhythmia Classification

Automatic Classification of Esophageal Lesions in Endoscopic Images Using a Convolutional Neural Network

GCLDNet: Gastric Cancer Lesion Detection Network Combining Level Feature Aggregation and Attention Feature Fusion

Cascade-EC Network: Recognition of Gastrointestinal Multiple Lesions Based on EfficientNet and CA_stm_Retinanet

Eso-Net: A Novel 2.5D Segmentation Network with the Multi-Structure Response Filter for the Cancerous Esophagus

Computer Aided Annotation of Early Esophageal Cancer in Gastroscopic Images based on Deeplabv3+ Network

Computer-aided detection of small intestinal ulcer and erosion in wireless capsule endoscopy images.

Multi-Scale Context-Guided Deep Network for Automated Lesion Segmentation With Endoscopy Images of Gastrointestinal Tract

CEUS-Net: Lesion Segmentation in Dynamic Contrast-Enhanced Ultrasound with Feature-Reweighted Attention Mechanism.

Automatic classification of esophageal disease in gastroscopic images using an efficient channel attention deep dense convolutional neural network

ClusterNet: A Clustering Distributed Prior Embedded Detection Network for Early-Stage Esophageal Squamous Cell Carcinoma Diagnosis.

Improving the Classification Performance of Esophageal Disease on Small Dataset by Semi-supervised Efficient Contrastive Learning

Efficient Esophageal Lesion Detection Using Polarization Regularized Network Slimming.

A deep learning method for delineating early gastric cancer resection margin under chromoendoscopy and white light endoscopy

A Saliency-Aware Hybrid Dense Network for Bleeding Detection in Wireless Capsule Endoscopy Images