Abstract:Background: Wireless capsule endoscopy (WCE) is a patient-friendly and non-invasive technology that scans the whole of the gastrointestinal tract, including difficult-to-access regions like the small bowel. Major drawback of this technology is that the visual inspection of a large number of video frames produced during each examination makes the physician diagnosis process tedious and prone to error. Several computer-aided diagnosis (CAD) systems, such as deep network models, have been developed for the automatic recognition of abnormalities in WCE frames. Nevertheless, most of these studies have only focused on spatial information within individual WCE frames, missing the crucial temporal data within consecutive frames. Methods: In this article, an automatic multiclass classification system based on a three-dimensional deep convolutional neural network (3D-CNN) is proposed, which utilizes the spatiotemporal information to facilitate the WCE diagnosis process. The 3D-CNN model fed with a series of sequential WCE frames in contrast to the two-dimensional (2D) model, which exploits frames as independent ones. Moreover, the proposed 3D deep model is compared with some pre-trained networks. The proposed models are trained and evaluated with 29 subject WCE videos (14,691 frames before augmentation). The performance advantages of 3D-CNN over 2D-CNN and pre-trained networks are verified in terms of sensitivity, specificity, and accuracy. Results: 3D-CNN outperforms the 2D technique in all evaluation metrics (sensitivity: 98.92 vs. 98.05, specificity: 99.50 vs. 86.94, accuracy: 99.20 vs. 92.60). In conclusion, a novel 3D-CNN model for lesion detection in WCE frames is proposed in this study. Conclusion: The results indicate the performance of 3D-CNN over 2D-CNN and some well-known pre-trained classifier networks. The proposed 3D-CNN model uses the rich temporal information in adjacent frames as well as spatial data to develop an accurate and efficient model.

Lesion Classification of Wireless Capsule Endoscopy Images.

Capsule Endoscopy Image Classification with Deep Convolutional Neural Networks

An Efficient Dual-Pooling Channel Attention Module for Weakly-Supervised Liver Lesion Classification on CT Images

Wireless Capsule Endoscopy Image Classification Based on Vector Sparse Coding

EFAG-CNN: Effectively Fused Attention Guided Convolutional Neural Network for WCE Image Classification

Residual Convolutional Neural Networks With Global And Local Pathways For Classification Of Focal Liver Lesions

Locality-Constrained Dictionary Learning Classification Method of WCE Images

Learn From Zoom: Decoupled Supervised Contrastive Learning For WCE Image Classification

Wireless capsule endoscopy multiclass classification using three-dimensional deep convolutional neural network model

Lesion2Vec: Deep Metric Learning for Few-Shot Multiple Lesions Recognition in Wireless Capsule Endoscopy Video

Modified residual attention network for abnormalities segmentation and detection in WCE images

Image Segmentation of Lesions in Wireless Capsule Endoscopy Based on Mask R-CNN

LLCaps: Learning to Illuminate Low-Light Capsule Endoscopy with Curved Wavelet Attention and Reverse Diffusion

Segmentation of Bleeding Regions in Wireless Capsule Endoscopy for Detection of Informative Frames

High-Resolution Histopathological Image Classification Model Based on Fused Heterogeneous Networks with Self-Supervised Feature Representation

Gastrointestinal Polyps and Tumors Detection Based on Multi-scale Feature-fusion with WCE Sequences

Detection of lymphangiectasia disease from wireless capsule endoscopy images with adaptive threshold

Segmentation of Bleeding Regions in Wireless Capsule Endoscopy Images an Approach for inside Capsule Video Summarization

A Cascade Attention Network for Liver Lesion Classification in Weakly-Labeled Multi-phase CT Images.

Abnormalities detection from wireless capsule endoscopy images based on embedding learning with triplet loss

Attention Mechanism Guided SE + ResNet-H Model for Gastrointestinal Endoscopy Image Classification