Abstract:Deep learning-based computer-aided diagnosis techniques have demonstrated encouraging performance in endoscopic lesion identification and detection, and have reduced the rate of missed and false detections of disease during endoscopy. However, the interpretability of the model-based results has not been adequately addressed by existing methods. This phenomenon is directly manifested by a significant bias in the representation of feature localization. Good recognition models experience severe feature localization errors, particularly for lesions with subtle morphological features, and such unsatisfactory performance hinders the clinical deployment of models. To effectively alleviate this problem, we proposed a solution to optimize the localization bias in feature representations of cancer-related recognition models that is difficult to accurately label and identify in clinical practice. Optimization was performed in the training phase of the model through the proposed data augmentation method and auxiliary loss function based on clinical priors. The data augmentation method, called partial jigsaw, can “break” the spatial structure of lesion-independent image blocks and enrich the data feature space to decouple the interference of background features on the space and focus on fine-grained lesion features. The annotation-based auxiliary loss function used class activation maps for sample distribution correction and led the model to present localization representation converging on the gold standard annotation of visualization maps. The results show that with the improvement of our method, the precision of model recognition reached an average of 92.79%, an F1-score of 92.61%, and accuracy of 95.56% based on a dataset constructed from 23 hospitals. In addition, we quantified the evaluation representation of visualization feature maps. The improved model yielded significant offset correction results for visualized feature maps compared with the baseline model. The average visualization-weighted positive coverage improved from 51.85% to 83.76%. The proposed approach did not change the deployment capability and inference speed of the original model and can be incorporated into any state-of-the-art neural network. It also shows the potential to provide more accurate localization inference results and assist in clinical examinations during endoscopies.

Accurate recognition of colorectal cancer with semi-supervised deep learning on pathological images

Colorectal Cancer Detection Based on Deep Learning

Deep learning driven colorectal lesion detection in gastrointestinal endoscopic and pathological imaging

Semi-supervised lung adenocarcinoma histopathology image classification based on multi-teacher knowledge distillation

Deep Learning for Colorectal Cancer Detection in Contrast-Enhanced Ct Without Bowel Preparation: A Retrospective, Multicentre Study

Multi-label Recognition of Cancer-Related Lesions with Clinical Priors on White-Light Endoscopy

Histopathology Classification and Localization of Colorectal Cancer Using Global Labels by Weakly Supervised Deep Learning.

Detection of Colorectal Cancer by Deep Learning: An Extensive Review

Diagnosis and Survival Prediction of Colorectal Cancer Using Deep Learning from the Histopathological HE Images

A promising deep learning-assistive algorithm for histopathological screening of colorectal cancer

Teacher-Student chain for efficient semi-supervised histology image classification

Semi-supervised recognition for artificial intelligence assisted pathology image diagnosis

Deep learning for multi-class semantic segmentation enables colorectal cancer detection and classification in digital pathology images

Representative Region Based Active Learning for Histological Classification of Colorectal Cancer

Towards label-efficient automatic diagnosis and analysis: a comprehensive survey of advanced deep learning-based weakly-supervised, semi-supervised and self-supervised techniques in histopathological image analysis

Deep learning model with pathological knowledge for detection of colorectal neuroendocrine tumor

Accurate prediction of colorectal cancer diagnosis using machine learning based on immunohistochemistry pathological images

Accurate Diagnosis of Colorectal Cancer Based on Histopathology Images Using Artificial Intelligence.

Detection and Recognition of Ultrasound Breast Nodules Based on Semi-supervised deep learning

Prediction of Microsatellite Instability of Colorectal Cancer Using Multi-Scale Pathological Images Based on Deep Learning

A semi-supervised learning approach with consistency regularization for tumor histopathological images analysis