Abstract:Deep learning-based computer-aided diagnosis techniques have demonstrated encouraging performance in endoscopic lesion identification and detection, and have reduced the rate of missed and false detections of disease during endoscopy. However, the interpretability of the model-based results has not been adequately addressed by existing methods. This phenomenon is directly manifested by a significant bias in the representation of feature localization. Good recognition models experience severe feature localization errors, particularly for lesions with subtle morphological features, and such unsatisfactory performance hinders the clinical deployment of models. To effectively alleviate this problem, we proposed a solution to optimize the localization bias in feature representations of cancer-related recognition models that is difficult to accurately label and identify in clinical practice. Optimization was performed in the training phase of the model through the proposed data augmentation method and auxiliary loss function based on clinical priors. The data augmentation method, called partial jigsaw, can “break” the spatial structure of lesion-independent image blocks and enrich the data feature space to decouple the interference of background features on the space and focus on fine-grained lesion features. The annotation-based auxiliary loss function used class activation maps for sample distribution correction and led the model to present localization representation converging on the gold standard annotation of visualization maps. The results show that with the improvement of our method, the precision of model recognition reached an average of 92.79%, an F1-score of 92.61%, and accuracy of 95.56% based on a dataset constructed from 23 hospitals. In addition, we quantified the evaluation representation of visualization feature maps. The improved model yielded significant offset correction results for visualized feature maps compared with the baseline model. The average visualization-weighted positive coverage improved from 51.85% to 83.76%. The proposed approach did not change the deployment capability and inference speed of the original model and can be incorporated into any state-of-the-art neural network. It also shows the potential to provide more accurate localization inference results and assist in clinical examinations during endoscopies.

Enhancing AI Diagnostics: Autonomous Lesion Masking via Semi-Supervised Deep Learning

Unsupervised Domain Adaptation with Adversarial Learning for Liver Tumors Detection in Multi-phase CT Images

Multi-label Recognition of Cancer-Related Lesions with Clinical Priors on White-Light Endoscopy

Unsupervised Domain Adaptation Using Adversarial Learning and Maximum Square Loss for Liver Tumors Detection in Multi-phase CT Images.

Self Supervised Lesion Recognition For Breast Ultrasound Diagnosis

Weakly Supervised Lesion Detection and Diagnosis for Breast Cancers with Partially Annotated Ultrasound Images

MSCDA: Multi-level Semantic-guided Contrast Improves Unsupervised Domain Adaptation for Breast MRI Segmentation in Small Datasets

Simultaneous segmentation and classification of breast lesions from ultrasound images using Mask R-CNN

Collaborative Unsupervised Domain Adaptation for Medical Image Diagnosis

Breast Lesion Detection for Ultrasound Images Using MaskFormer

The Clinical Application of Artificial Intelligence Assisted Contrast-Enhanced Ultrasound on BI-RADS Category 4 Breast Lesions.

AMLP:Adaptive Masking Lesion Patches for Self-supervised Medical Image Segmentation

Deep Learning-based Breast Tumor Detection and Segmentation in 3D Ultrasound Image

Deep Learning-based Unsupervised Domain Adaptation via a Unified Model for Prostate Lesion Detection Using Multisite Biparametric MRI Datasets

Deep learning combined with attention mechanisms to assist radiologists in enhancing breast cancer diagnosis: a study on photoacoustic imaging

Breast ultrasound region of interest detection and lesion localisation

Spatial Attention Lesion Detection On Automated Breast Ultrasound

Data privacy protection domain adaptation by roughing and finishing stage

A Novel Deep Learning System for Breast Lesion Risk Stratification in Ultrasound Images

Deep Learning Model Improves Radiologists' Performance in Detection and Classification of Breast Lesions

Detection and Recognition of Ultrasound Breast Nodules Based on Semi-supervised deep learning