Abstract:Gastrointestinal (GI) diseases are prevalent medical conditions that require accurate and timely diagnosis for effective treatment. To address this, we developed the Multi-Fusion Convolutional Neural Network (MF-CNN), a deep learning framework that strategically integrates and adapts elements from six deep learning models, enhancing feature extraction and classification of GI diseases from endoscopic images. The MF-CNN architecture leverages truncated and partially frozen layers from existing models, augmented with novel components such as Auxiliary Fusing Layers (AuxFL), Fusion Residual Block (FuRB), and Alpha Dropouts (αDO) to improve precision and robustness. This design facilitates the precise identification of conditions such as ulcerative colitis, polyps, esophagitis, and healthy colons. Our methodology involved preprocessing endoscopic images sourced from open databases, including KVASIR and ETIS-Larib Polyp DB, using adaptive histogram equalization (AHE) to enhance their quality. The MF-CNN framework supports detailed feature mapping for improved interpretability of the model’s internal workings. An ablation study was conducted to validate the contribution of each component, demonstrating that the integration of AuxFL, αDO, and FuRB played a crucial part in reducing overfitting and efficiency saturation and enhancing overall model performance. The MF-CNN demonstrated outstanding performance in terms of efficacy, achieving an accuracy rate of 99.25%. It also excelled in other key performance metrics with a precision of 99.27%, a recall of 99.25%, and an F1-score of 99.25%. These metrics confirmed the model’s proficiency in accurate classification and its capability to minimize false positives and negatives across all tested GI disease categories. Furthermore, the AUC values were exceptional, averaging 1.00 for both test and validation sets, indicating perfect discriminative ability. The findings of the P-R curve analysis and confusion matrix further confirmed the robust classification performance of the MF-CNN. This research introduces a technique for medical imaging that can potentially transform diagnostics in gastrointestinal healthcare facilities worldwide.

AFA-RN: An Abnormal Feature Attention Relation Network for Multi-class Disease Classification in gastrointestinal endoscopic images

A Model-Agnostic Framework for Universal Anomaly Detection of Multi-organ and Multi-modal Images

Adaptive Aggregation with Self-Attention Network for Gastrointestinal Image Classification

EFAG-CNN: Effectively Fused Attention Guided Convolutional Neural Network for WCE Image Classification

Automatic classification of esophageal disease in gastroscopic images using an efficient channel attention deep dense convolutional neural network

Gastrointestinal Disease Classification in Endoscopic Images Using Attention-Guided Convolutional Neural Networks

A Cascade Attention Network for Liver Lesion Classification in Weakly-Labeled Multi-phase CT Images.

Deep Convolutional Neural Networks for WCE Abnormality Detection: CNN Architecture, Region Proposal and Transfer Learning.

Integrating Deep Feature Extraction and Hybrid ResNet-DenseNet Model for Multi-Class Abnormality Detection in Endoscopic Images

LFANet: Lightweight feature attention network for abnormal cell segmentation in cervical cytology images

Adasan: Adaptive Cosine Similarity Self-Attention Network For Gastrointestinal Endoscopy Image Classification

A Deep Learning Network Based on Multi-Scale and Attention for the Diagnosis of Chronic Atrophic Gastritis

M2LC-Net: A Multi-Modal Multi-Disease Long-Tailed Classification Network for Real Clinical Scenes

MLMSA: Multi-Level and Multi-Scale Attention for Lesion Detection in Endoscopy

FaFCNN: A General Disease Classification Framework Based on Feature Fusion Neural Networks

Development of a multi-fusion convolutional neural network (MF-CNN) for enhanced gastrointestinal disease diagnosis in endoscopy image analysis

Fine-Grained Gastrointestinal Endoscopy Image Categorization

RFIA-Net: Rich CNN-transformer Network Based on Asymmetric Fusion Feature Aggregation to Classify Stage I Multimodality Oesophageal Cancer Images

Weakly-Supervised Balanced Attention Network for Gastric Pathology Image Localization and Classification.

Class Attention to Regions of Lesion for Imbalanced Medical Image Recognition

Non-Local Attention and Densely-Connected Convolutional Neural Networks for Malignancy Suspiciousness Classification of Gastric Ulcer