Abstract:Deep learning-based computer-aided diagnosis techniques have demonstrated encouraging performance in endoscopic lesion identification and detection, and have reduced the rate of missed and false detections of disease during endoscopy. However, the interpretability of the model-based results has not been adequately addressed by existing methods. This phenomenon is directly manifested by a significant bias in the representation of feature localization. Good recognition models experience severe feature localization errors, particularly for lesions with subtle morphological features, and such unsatisfactory performance hinders the clinical deployment of models. To effectively alleviate this problem, we proposed a solution to optimize the localization bias in feature representations of cancer-related recognition models that is difficult to accurately label and identify in clinical practice. Optimization was performed in the training phase of the model through the proposed data augmentation method and auxiliary loss function based on clinical priors. The data augmentation method, called partial jigsaw, can “break” the spatial structure of lesion-independent image blocks and enrich the data feature space to decouple the interference of background features on the space and focus on fine-grained lesion features. The annotation-based auxiliary loss function used class activation maps for sample distribution correction and led the model to present localization representation converging on the gold standard annotation of visualization maps. The results show that with the improvement of our method, the precision of model recognition reached an average of 92.79%, an F1-score of 92.61%, and accuracy of 95.56% based on a dataset constructed from 23 hospitals. In addition, we quantified the evaluation representation of visualization feature maps. The improved model yielded significant offset correction results for visualized feature maps compared with the baseline model. The average visualization-weighted positive coverage improved from 51.85% to 83.76%. The proposed approach did not change the deployment capability and inference speed of the original model and can be incorporated into any state-of-the-art neural network. It also shows the potential to provide more accurate localization inference results and assist in clinical examinations during endoscopies.

Fast cancer metastasis location based on dual magnification hard example mining network in whole-slide images

ScanNet: A Fast and Dense Scanning Framework for Metastatic Breast Cancer Detection from Whole-Slide Images

PFA-ScanNet: Pyramidal Feature Aggregation with Synergistic Learning for Breast Cancer Metastasis Analysis

Deep Learning Based Multi-Organ Segmentation And Metastases Segmentation In Whole Mouse Body And The Cryo-Imaging Cancer Imaging And Therapy Analysis Platform (Citap)

Detecting Cancer Metastases on Gigapixel Pathology Images

HI-Net: A novel histopathologic image segmentation model for metastatic breast cancer via lightweight dataset construction

Cancer Metastasis Detection With Neural Conditional Random Field

Few-Shot Breast Cancer Metastases Classification via Unsupervised Cell Ranking

Multi-label Recognition of Cancer-Related Lesions with Clinical Priors on White-Light Endoscopy

EffiDiag: an Efficient Framework for Breast Cancer Diagnosis in Multi-Gigapixel Whole Slide Images

Multiscale Detection of Cancerous Tissue in High Resolution Slide Scans

Whole-slide-imaging Cancer Metastases Detection and Localization with Limited Tumorous Data

Fast Tumor Detector in Whole-Slide Image With Dynamic Programing Based Monte Carlo Sampling

Identifying Metastases in Sentinel Lymph Nodes with Deep Convolutional Neural Networks

Super-resolution and segmentation deep learning for breast cancer histopathology image analysis

Robust Tumor Detection from Coarse Annotations via Multi-Magnification Ensembles

Overcoming the limitations of patch-based learning to detect cancer in whole slide images

Boosted EfficientNet: Detection of Lymph Node Metastases in Breast Cancer Using Convolutional Neural Network

Deep Multi-Magnification Networks for multi-class breast cancer image segmentation

Deep Learning Provides Rapid Screen for Breast Cancer Metastasis with Sentinel Lymph Nodes

Multi-task Adaptive Resolution Network for Lymph Node Metastasis Diagnosis from Whole Slide Images of Colorectal Cancer