Abstract:Deep learning-based computer-aided diagnosis techniques have demonstrated encouraging performance in endoscopic lesion identification and detection, and have reduced the rate of missed and false detections of disease during endoscopy. However, the interpretability of the model-based results has not been adequately addressed by existing methods. This phenomenon is directly manifested by a significant bias in the representation of feature localization. Good recognition models experience severe feature localization errors, particularly for lesions with subtle morphological features, and such unsatisfactory performance hinders the clinical deployment of models. To effectively alleviate this problem, we proposed a solution to optimize the localization bias in feature representations of cancer-related recognition models that is difficult to accurately label and identify in clinical practice. Optimization was performed in the training phase of the model through the proposed data augmentation method and auxiliary loss function based on clinical priors. The data augmentation method, called partial jigsaw, can “break” the spatial structure of lesion-independent image blocks and enrich the data feature space to decouple the interference of background features on the space and focus on fine-grained lesion features. The annotation-based auxiliary loss function used class activation maps for sample distribution correction and led the model to present localization representation converging on the gold standard annotation of visualization maps. The results show that with the improvement of our method, the precision of model recognition reached an average of 92.79%, an F1-score of 92.61%, and accuracy of 95.56% based on a dataset constructed from 23 hospitals. In addition, we quantified the evaluation representation of visualization feature maps. The improved model yielded significant offset correction results for visualized feature maps compared with the baseline model. The average visualization-weighted positive coverage improved from 51.85% to 83.76%. The proposed approach did not change the deployment capability and inference speed of the original model and can be incorporated into any state-of-the-art neural network. It also shows the potential to provide more accurate localization inference results and assist in clinical examinations during endoscopies.

Adaptive Deep Learning for Head and Neck Cancer Detection Using Hyperspectral Imaging

Deep Learning Based Classification for Head and Neck Cancer Detection with Hyperspectral Imaging in an Animal Model

Spectral-Spatial Recurrent-Convolutional Networks for In-Vivo Hyperspectral Tumor Type Classification

Deep Margin Cosine Autoencoder-Based Medical Hyperspectral Image Classification for Tumor Diagnosis

Multi-label Recognition of Cancer-Related Lesions with Clinical Priors on White-Light Endoscopy

Pretreatment Identification of Head and Neck Cancer Nodal Metastasis and Extranodal Extension Using Deep Learning Neural Networks

Author Response for "deep Learning‐based Hyperspectral Technique Identifies Metastatic Lymph Nodes in Oral Squamous Cell Carcinoma—a Pilot Study"

Superpixel-based Spectral Classification for the Detection of Head and Neck Cancer with Hyperspectral Imaging

Combining hyperspectral imaging techniques with deep learning to aid in early pathological diagnosis of melanoma

Intra-operative Brain Tumor Detection with Deep Learning-Optimized Hyperspectral Imaging

Spatio-spectral deep learning methods for in-vivo hyperspectral laryngeal cancer detection

Hyperspectral Imaging: a New Method for Diagnosing Benign and Malignant Lung Cancer

In Vivo Cancer Detection in Animal Model Using Hyperspectral Image Classification with Wavelet Feature Extraction.

Pixel-level Tumor Margin Assessment of Surgical Specimen with Hyperspectral Imaging and Deep Learning Classification.

A Hybrid Deep Learning Model for Breast Cancer Detection and Classification

Hybrid Deep Transfer Network and Rotational Sample Subspace Ensemble Learning for Early Cancer Detection

Deep learning classification of deep ultraviolet fluorescence images toward intra-operative margin assessment in breast cancer

Edge detection algorithm of cancer image based on deep learning

Deep Learning Based Intelligent Tumor Analytics Framework for Quantitative Grading and Analyzing Cancer Metastasis: Case of Lymph Node Breast Cancer

Deep Learning-Based Correction and Unmixing of Hyperspectral Images for Brain Tumor Surgery

Optimizing and Visualizing Deep Learning for Benign/Malignant Classification in Breast Tumors