Abstract:Deep learning-based computer-aided diagnosis techniques have demonstrated encouraging performance in endoscopic lesion identification and detection, and have reduced the rate of missed and false detections of disease during endoscopy. However, the interpretability of the model-based results has not been adequately addressed by existing methods. This phenomenon is directly manifested by a significant bias in the representation of feature localization. Good recognition models experience severe feature localization errors, particularly for lesions with subtle morphological features, and such unsatisfactory performance hinders the clinical deployment of models. To effectively alleviate this problem, we proposed a solution to optimize the localization bias in feature representations of cancer-related recognition models that is difficult to accurately label and identify in clinical practice. Optimization was performed in the training phase of the model through the proposed data augmentation method and auxiliary loss function based on clinical priors. The data augmentation method, called partial jigsaw, can “break” the spatial structure of lesion-independent image blocks and enrich the data feature space to decouple the interference of background features on the space and focus on fine-grained lesion features. The annotation-based auxiliary loss function used class activation maps for sample distribution correction and led the model to present localization representation converging on the gold standard annotation of visualization maps. The results show that with the improvement of our method, the precision of model recognition reached an average of 92.79%, an F1-score of 92.61%, and accuracy of 95.56% based on a dataset constructed from 23 hospitals. In addition, we quantified the evaluation representation of visualization feature maps. The improved model yielded significant offset correction results for visualized feature maps compared with the baseline model. The average visualization-weighted positive coverage improved from 51.85% to 83.76%. The proposed approach did not change the deployment capability and inference speed of the original model and can be incorporated into any state-of-the-art neural network. It also shows the potential to provide more accurate localization inference results and assist in clinical examinations during endoscopies.

CARL: Cross-Aligned Representation Learning for Multi-view Lung Cancer Histology Classification

Multi-view Representation Learning for Histologic Subtype Classification of Lung Cancer.

Combining Convolutional and Recurrent Neural Networks for Classification of Focal Liver Lesions in Multi-phase CT Images.

MVHRL: Multi-view Hierarchical Representation Learning for Subtype Classification of Non-small Cell Lung Cancer

CasCRNN-GL-Net: Cascaded Convolutional and Recurrent Neural Networks with Global and Local Pathways for Classification of Focal Liver Lesions in Multi-Phase CT Images

Residual Convolutional Neural Networks With Global And Local Pathways For Classification Of Focal Liver Lesions

A Multi-View Feature Decomposition Deep Learning Method for Lung Cancer Histology Classification

Tensor-Based Subspace Learning for Classification of Focal Liver Lesions in Multi-phase CT Images

Seeking multi-view commonality and peculiarity: A novel decoupling method for lung cancer subtype classification

Multi-task Learning-Based Histologic Subtype Classification of Non-Small Cell Lung Cancer.

CC-DCNet: Dynamic Convolutional Neural Network with Contrastive Constraints for Identifying Lung Cancer Subtypes on Multi-modality Images

Multi-label Recognition of Cancer-Related Lesions with Clinical Priors on White-Light Endoscopy

A Multi-Task Convolutional Neural Network for Lesion Region Segmentation and Classification of Non-Small Cell Lung Carcinoma

One-step algorithm for fast-track localization and multi-category classification of histological subtypes in lung cancer

An Explainable Classification Method Based on Complex Scaling in Histopathology Images for Lung and Colon Cancer

Histological Subtype Classification of Non-Small Cell Lung Cancer with Radiomics and 3D Convolutional Neural Networks

Lung cancer subtype classification using histopathological images based on weakly supervised multi-instance learning

Multi-View Attention Learning for Residual Disease Prediction of Ovarian Cancer

Fine-Grained Lung Cancer Classification from PET and CT Images Based on Multidimensional Attention Mechanism

Diagnosis of Coronavirus Disease 2019 (COVID-19) With Structured Latent Multi-View Representation Learning

Multi-view attribute learning and context relationship encoding enhanced segmentation of lung tumors from CT images