Abstract:Deep learning-based computer-aided diagnosis techniques have demonstrated encouraging performance in endoscopic lesion identification and detection, and have reduced the rate of missed and false detections of disease during endoscopy. However, the interpretability of the model-based results has not been adequately addressed by existing methods. This phenomenon is directly manifested by a significant bias in the representation of feature localization. Good recognition models experience severe feature localization errors, particularly for lesions with subtle morphological features, and such unsatisfactory performance hinders the clinical deployment of models. To effectively alleviate this problem, we proposed a solution to optimize the localization bias in feature representations of cancer-related recognition models that is difficult to accurately label and identify in clinical practice. Optimization was performed in the training phase of the model through the proposed data augmentation method and auxiliary loss function based on clinical priors. The data augmentation method, called partial jigsaw, can “break” the spatial structure of lesion-independent image blocks and enrich the data feature space to decouple the interference of background features on the space and focus on fine-grained lesion features. The annotation-based auxiliary loss function used class activation maps for sample distribution correction and led the model to present localization representation converging on the gold standard annotation of visualization maps. The results show that with the improvement of our method, the precision of model recognition reached an average of 92.79%, an F1-score of 92.61%, and accuracy of 95.56% based on a dataset constructed from 23 hospitals. In addition, we quantified the evaluation representation of visualization feature maps. The improved model yielded significant offset correction results for visualized feature maps compared with the baseline model. The average visualization-weighted positive coverage improved from 51.85% to 83.76%. The proposed approach did not change the deployment capability and inference speed of the original model and can be incorporated into any state-of-the-art neural network. It also shows the potential to provide more accurate localization inference results and assist in clinical examinations during endoscopies.

Enhancing deep learning classification performance of tongue lesions in imbalanced data: mosaic-based soft labeling with curriculum learning

Multi-label Recognition of Cancer-Related Lesions with Clinical Priors on White-Light Endoscopy

Diagnosing oral and maxillofacial diseases using deep learning

Classification of imbalanced oral cancer image data from high-risk population

Computer-assisted medical image classification for early diagnosis of oral cancer employing deep learning algorithm

ANN-ANT-LION-MLP Ensemble Transfer Learning Based Classifier for Detection and Classification of Oral Disease Severity

An Intelligent Tongue Diagnosis System via Deep Learning on the Android Platform

Data Augmentation Using Image-to-image Translation for Tongue Coating Thickness Classification with Imbalanced Data

Automated Detection of Oral Pre-Cancerous Tongue Lesions Using Deep Learning for Early Diagnosis of Oral Cavity Cancer

Detection of Abnormal Changes on the Dorsal Tongue Surface Using Deep Learning

Intelligent deep learning supports biomedical image detection and classification of oral cancer

YOLO-MR: Meta-Learning-Based Lesion Detection Algorithm for Resolving Data Imbalance

Automatic oral cancer detection and classification using modified local texture descriptor and machine learning algorithms

Weakly Supervised Deep Learning for Tooth-Marked Tongue Recognition

Medical Knowledge-Guided Deep Learning for Imbalanced Medical Image Classification

Siamese Networks with Soft Labels for Unsupervised Lesion Detection and Patch Pretraining on Screening Mammograms

Molecular Classification of Breast Cancer Using Weakly Supervised Learning

Artificial intelligence in tongue diagnosis: Using deep convolutional neural network for recognizing unhealthy tongue with tooth-mark

Oral mucosal lesions triage via YOLOv7 models

Intelligent Deep Learning Enabled Oral Squamous Cell Carcinoma Detection and Classification Using Biomedical Images

Deep Learning Multi-label Tongue Image Analysis and Its Application in a Population Undergoing Routine Medical Checkup