Abstract:Deep learning-based computer-aided diagnosis techniques have demonstrated encouraging performance in endoscopic lesion identification and detection, and have reduced the rate of missed and false detections of disease during endoscopy. However, the interpretability of the model-based results has not been adequately addressed by existing methods. This phenomenon is directly manifested by a significant bias in the representation of feature localization. Good recognition models experience severe feature localization errors, particularly for lesions with subtle morphological features, and such unsatisfactory performance hinders the clinical deployment of models. To effectively alleviate this problem, we proposed a solution to optimize the localization bias in feature representations of cancer-related recognition models that is difficult to accurately label and identify in clinical practice. Optimization was performed in the training phase of the model through the proposed data augmentation method and auxiliary loss function based on clinical priors. The data augmentation method, called partial jigsaw, can “break” the spatial structure of lesion-independent image blocks and enrich the data feature space to decouple the interference of background features on the space and focus on fine-grained lesion features. The annotation-based auxiliary loss function used class activation maps for sample distribution correction and led the model to present localization representation converging on the gold standard annotation of visualization maps. The results show that with the improvement of our method, the precision of model recognition reached an average of 92.79%, an F1-score of 92.61%, and accuracy of 95.56% based on a dataset constructed from 23 hospitals. In addition, we quantified the evaluation representation of visualization feature maps. The improved model yielded significant offset correction results for visualized feature maps compared with the baseline model. The average visualization-weighted positive coverage improved from 51.85% to 83.76%. The proposed approach did not change the deployment capability and inference speed of the original model and can be incorporated into any state-of-the-art neural network. It also shows the potential to provide more accurate localization inference results and assist in clinical examinations during endoscopies.

The effect of incorporating domain knowledge with deep learning in identifying benign and malignant gastric whitish lesions: A retrospective study

A deep-learning based system using multi-modal data for diagnosing gastric neoplasms in real-time (with video)

Explainable artificial intelligence incorporated with domain knowledge diagnosing early gastric neoplasms under white light endoscopy

Assessment of deep learning assistance for the pathological diagnosis of gastric cancer

Expert-level classification of gastritis by endoscopy using deep learning: a multicenter diagnostic trial

Real-time artificial intelligence for detecting focal lesions and diagnosing neoplasms of the stomach by white-light endoscopy (with videos)

Application of deep learning in the real-time diagnosis of gastric lesion based on magnifying optical enhancement videos

Tu1075 DEEP CONVOLUTIONAL NEURAL NETWORKS FOR RECOGNITION OF ATROPHIC GASTRITIS AND INTESTINAL METAPLASIA BASED ON ENDOSCOPY IMAGES

Deep Learning and Gastric Cancer: Systematic Review of AI-Assisted Endoscopy

Multi-label Recognition of Cancer-Related Lesions with Clinical Priors on White-Light Endoscopy

A deep learning-based model improves diagnosis of early gastric cancer under narrow band imaging endoscopy

Diagnosing and grading gastric atrophy and intestinal metaplasia using semi-supervised deep learning on pathological images: development and validation study

Interpretable tumor differentiation grade and microsatellite instability recognition in gastric cancer using deep learning

Development of a deep learning-based model to diagnose mixed-type gastric cancer accurately

Diagnosis and segmentation effect of the ME-NBI-based deep learning model on gastric neoplasms in patients with suspected superficial lesions - a multicenter study

Development of a deep learning model for early gastric cancer diagnosis using preoperative computed tomography images

Enhanced multi-class pathology lesion detection in gastric neoplasms using deep learning-based approach and validation

Identification of Upper Gastrointestinal Diseases during Screening Gastroscopy through Deep Convolutional Neural Network Algorithm

Predicting Gastric Cancer Outcome from Resected Lymph Node Histopathology Images Using Deep Learning.

Application of machine learning in the diagnosis of gastric cancer based on noninvasive characteristics

An Interpretable Deep Learning Model for Identifying the Morphological Characteristics of Dmmr/msi-H Gastric Cancer