Abstract:Deep learning-based computer-aided diagnosis techniques have demonstrated encouraging performance in endoscopic lesion identification and detection, and have reduced the rate of missed and false detections of disease during endoscopy. However, the interpretability of the model-based results has not been adequately addressed by existing methods. This phenomenon is directly manifested by a significant bias in the representation of feature localization. Good recognition models experience severe feature localization errors, particularly for lesions with subtle morphological features, and such unsatisfactory performance hinders the clinical deployment of models. To effectively alleviate this problem, we proposed a solution to optimize the localization bias in feature representations of cancer-related recognition models that is difficult to accurately label and identify in clinical practice. Optimization was performed in the training phase of the model through the proposed data augmentation method and auxiliary loss function based on clinical priors. The data augmentation method, called partial jigsaw, can “break” the spatial structure of lesion-independent image blocks and enrich the data feature space to decouple the interference of background features on the space and focus on fine-grained lesion features. The annotation-based auxiliary loss function used class activation maps for sample distribution correction and led the model to present localization representation converging on the gold standard annotation of visualization maps. The results show that with the improvement of our method, the precision of model recognition reached an average of 92.79%, an F1-score of 92.61%, and accuracy of 95.56% based on a dataset constructed from 23 hospitals. In addition, we quantified the evaluation representation of visualization feature maps. The improved model yielded significant offset correction results for visualized feature maps compared with the baseline model. The average visualization-weighted positive coverage improved from 51.85% to 83.76%. The proposed approach did not change the deployment capability and inference speed of the original model and can be incorporated into any state-of-the-art neural network. It also shows the potential to provide more accurate localization inference results and assist in clinical examinations during endoscopies.

Marrying Global-Local Spatial Context for Image Patches in Computer-Aided Assessment.

Generating Hypergraph-Based High-Order Representations of Whole-Slide Histopathological Images for Survival Prediction

Space and Level Cooperation Framework for Pathological Cancer Grading

Local-to-Global Spatial Learning for Whole-Slide Image Representation and Classification

Interpretable Classification of Pathology Whole-Slide Images Using Attention Based Context-Aware Graph Convolutional Neural Network

RetCCL: Clustering-guided contrastive learning for whole-slide image retrieval

Whole Slide Images are 2D Point Clouds: Context-Aware Survival Prediction using Patch-based Graph Convolutional Networks

Multi-label Recognition of Cancer-Related Lesions with Clinical Priors on White-Light Endoscopy

Data-efficient and weakly supervised computational pathology on whole-slide images

Robust whole slide image analysis for cervical cancer screening using deep learning

Gigapixel Whole-Slide Images Classification using Locally Supervised Learning

SAC-Net: Enhancing Spatiotemporal Aggregation in Cervical Histological Image Classification via Label-Efficient Weakly Supervised Learning

Overcoming the limitations of patch-based learning to detect cancer in whole slide images

Context-Aware Self-Supervised Learning of Whole Slide Images

CAF-AHGCN: context-aware attention fusion adaptive hypergraph convolutional network for human-interpretable prediction of gigapixel whole-slide image

Histopathology Classification and Localization of Colorectal Cancer Using Global Labels by Weakly Supervised Deep Learning.

Dual-path network with synergistic grouping loss and evidence driven risk stratification for whole slide cervical image analysis

Capturing global spatial context for accurate cell classification in skin cancer histology

An Efficient Cervical Whole Slide Image Analysis Framework Based on Multi-scale Semantic and Location Deep Features

SCMIL: Sparse Context-aware Multiple Instance Learning for Predicting Cancer Survival Probability Distribution in Whole Slide Images

PathTR: Context-Aware Memory Transformer for Tumor Localization in Gigapixel Pathology Images.