Abstract:Endoscopy plays a major role in identifying any underlying abnormalities within the gastrointestinal (GI) tract. There are multiple GI tract diseases that are life-threatening, such as precancerous lesions and other intestinal cancers. In the usual process, a diagnosis is made by a medical expert which can be prone to human errors and the accuracy of the test is also entirely dependent on the expert's level of experience. Deep learning, specifically Convolution Neural Networks (CNNs) which are designed to perform automatic feature learning without any prior feature engineering, has recently reported great benefits for GI endoscopy image analysis. Previous research has developed models that focus only on improving performance, as such, the majority of introduced models contain complex deep network architectures with a large number of parameters that require longer training times. However, there is a lack of focus on developing lightweight models which can run in low-resource environments, which are typically encountered in medical clinics. We investigate three KD-based learning frameworks, response-based, feature-based, and relation-based mechanisms, and introduce a novel multi-head attention-based feature fusion mechanism to support relation-based learning. Compared to the existing relation-based methods that follow simplistic aggregation techniques of multi-teacher response/feature-based knowledge, we adopt the multi-head attention technique to provide flexibility towards localising and transferring important details from each teacher to better guide the student. We perform extensive evaluations on two widely used public datasets, KVASIR-V2 and Hyper-KVASIR, and our experimental results signify the merits of our proposed relation-based framework in achieving an improved lightweight model (only 51.8k trainable parameters) that can run in a resource-limited environment.

Order-Guided Disentangled Representation Learning for Ulcerative Colitis Classification with Limited Labels

Ordinal Multiple-instance Learning for Ulcerative Colitis Severity Estimation with Selective Aggregated Transformer

Ulcerative Colitis Mayo Endoscopic Scoring Classification with Active Learning and Generative Data Augmentation

A hybrid approach of vision transformers and CNNs for detection of ulcerative colitis

Automatic estimation of ulcerative colitis severity from endoscopy videos using ordinal multi-instance learning

Deep Bayesian Active Learning-to-Rank with Relative Annotation for Estimation of Ulcerative Colitis Severity

Interpretable histopathology-based prediction of disease relevant features in Inflammatory Bowel Disease biopsies using weakly-supervised deep learning

Detecting ulcerative colitis from colon samples using efficient feature selection and machine learning

Development and Validation of a Deep Learning-Based Approach to Predict the Mayo Endoscopic Score of Ulcerative Colitis

Distinguishing between Crohn's disease and ulcerative colitis using deep learning models with interpretability

Diagnosis and Severity Assessment of Ulcerative Colitis using Self Supervised Learning

Patch-level instance-group discrimination with pretext-invariant learning for colitis scoring

Deep learning model using stool pictures for predicting endoscopic mucosal inflammation in patients with ulcerative colitis

Few-shot learning for the classification of intestinal tuberculosis and Crohn's disease on endoscopic images: A novel learn-to-learn framework

Semi-Supervised Segmentation Framework for Gastrointestinal Lesion Diagnosis in Endoscopic Images

Artificial intelligence enabled automated diagnosis and grading of ulcerative colitis endoscopy images

Supervised Contrastive Learning for Gastrointestinal Lesions Classification in Endoscopic Images

UC-NfNet: Deep learning-enabled assessment of ulcerative colitis from colonoscopy images

Improving the Computer-Aided Estimation of Ulcerative Colitis Severity According to Mayo Endoscopic Score by Using Regression-Based Deep Learning

Learning Through Guidance: Knowledge Distillation for Endoscopic Image Classification