Abstract:Background: Celiac disease has emerged as a significant global public health concern, exhibiting an estimated worldwide prevalence of approximately 1%. However, existing research pertaining to domestic occurrences of celiac disease is confined mainly to case reports and limited case analyses. Furthermore, there is a substantial population of undiagnosed patients in the Xinjiang region. Purpose: This study endeavors to develop a novel and focused deep learning model. The primary objective is to facilitate celiac disease diagnosis through the utilization of a dataset comprising endoscopic images obtained from patients with celiac disease in Xinjiang. Methods: We propose a novel CNN-Transformer hybrid architecture for deep learning, tailored to the diagnosis of celiac disease using endoscopic images. Within this architecture, a multi-scale spatial adaptive selective kernel convolution feature attention module demonstrates remarkable efficacy in diagnosing celiac disease. We dynamically capture salient features within the local channel feature map that correspond to distinct manifestations of endoscopic image lesions in the celiac disease-affected areas such as the duodenal bulb, duodenal descending segment, and terminal ileum. This process serves to extract and fortify the spatial information specific to different lesions. This strategic approach facilitates not only the extraction of diverse lesion characteristics but also the attentive consideration of their spatial distribution. Additionally, we integrate the global representation of the feature map obtained from the Transformer with the locally extracted information via convolutional layers. This integration achieves a harmonious synergy that optimizes the diagnostic prowess of the model. Results: Overall, the accuracy, specificity, F1-Score, and precision in the experimental results were 98.38%, 99.04%, 98.66% and 99.38%, respectively. Conclusion: This study introduces a deep learning network equipped with both global feature response and local feature extraction capabilities. This innovative architecture holds significant promise for the accurate diagnosis of celiac disease by leveraging endoscopic images captured from diverse anatomical sites.

Enhancing Automatic Gastrointestinal Endoscopy Image Classification via Advanced Model and Adversarial Training Strategy.

Classification of Endoscopy and Video Capsule Images using CNN-Transformer Model

Domain-Adaptive Pre-training of Self-Supervised Foundation Models for Medical Image Classification in Gastrointestinal Endoscopy

Gastric Endoscopy Image Classification Based on MobileSiT-SimAM

AI support for colonoscopy quality control using CNN and transformer architectures

High-Speed and Accurate Diagnosis of Gastrointestinal Disease: Learning on Endoscopy Images Using Lightweight Transformer with Local Feature Attention.

Enhancing image-based diagnosis of gastrointestinal tract diseases through deep learning with EfficientNet and advanced data augmentation techniques

Will Transformers change gastrointestinal endoscopic image analysis? A comparative analysis between CNNs and Transformers, in terms of performance, robustness and generalization

Development of a multi-fusion convolutional neural network (MF-CNN) for enhanced gastrointestinal disease diagnosis in endoscopy image analysis

Attention Mechanism Guided SE + ResNet-H Model for Gastrointestinal Endoscopy Image Classification

An efficient medical image classification network based on multi-branch CNN, token grouping Transformer and mixer MLP

MC-GAT: multi-layer collaborative generative adversarial transformer for cholangiocarcinoma classification from hyperspectral pathological images

Capsule Endoscopy Multi-classification via Gated Attention and Wavelet Transformations

SMiT: Symmetric Mask Transformer for Disease Severity Detection.

Gastrointestinal Disease Classification in Endoscopic Images Using Attention-Guided Convolutional Neural Networks

Effective High-to-low-level Feature Aggregation Network for Endoscopic Image Classification

Celiac disease diagnosis from endoscopic images based on multi-scale adaptive hybrid architecture model

Using Multi-Task Learning to Improve Diagnostic Performance of Convolutional Neural Networks

Multi-Task Classification and Segmentation for Explicable Capsule Endoscopy Diagnostics

Gastrointestinal Stromal Tumors Diagnosis on Multi-Center Endoscopic Ultrasound Images Using Multi-Scale Image Normalization and Transfer Learning

A Deep Learning Application of Capsule Endoscopic Gastric Structure Recognition Based on a Transformer Model