Abstract:Deep learning-based computer-aided diagnosis techniques have demonstrated encouraging performance in endoscopic lesion identification and detection, and have reduced the rate of missed and false detections of disease during endoscopy. However, the interpretability of the model-based results has not been adequately addressed by existing methods. This phenomenon is directly manifested by a significant bias in the representation of feature localization. Good recognition models experience severe feature localization errors, particularly for lesions with subtle morphological features, and such unsatisfactory performance hinders the clinical deployment of models. To effectively alleviate this problem, we proposed a solution to optimize the localization bias in feature representations of cancer-related recognition models that is difficult to accurately label and identify in clinical practice. Optimization was performed in the training phase of the model through the proposed data augmentation method and auxiliary loss function based on clinical priors. The data augmentation method, called partial jigsaw, can “break” the spatial structure of lesion-independent image blocks and enrich the data feature space to decouple the interference of background features on the space and focus on fine-grained lesion features. The annotation-based auxiliary loss function used class activation maps for sample distribution correction and led the model to present localization representation converging on the gold standard annotation of visualization maps. The results show that with the improvement of our method, the precision of model recognition reached an average of 92.79%, an F1-score of 92.61%, and accuracy of 95.56% based on a dataset constructed from 23 hospitals. In addition, we quantified the evaluation representation of visualization feature maps. The improved model yielded significant offset correction results for visualized feature maps compared with the baseline model. The average visualization-weighted positive coverage improved from 51.85% to 83.76%. The proposed approach did not change the deployment capability and inference speed of the original model and can be incorporated into any state-of-the-art neural network. It also shows the potential to provide more accurate localization inference results and assist in clinical examinations during endoscopies.

Customized T-time inner sampling network with uncertainty-aware data augmentation strategy for multi-annotated lesion segmentation

Lung Nodule Segmentation and Uncertain Region Prediction with an Uncertainty-Aware Attention Mechanism

Data augmentation based on multiple oversampling fusion for medical image segmentation

Many Birds, One Stone: Medical Image Segmentation with Multiple Partially Labeled Datasets

Learning Robust Medical Image Segmentation from Multi-source Annotations

ALA-Net: Adaptive Lesion-Aware Attention Network for 3D Colorectal Tumor Segmentation

Multi-label Recognition of Cancer-Related Lesions with Clinical Priors on White-Light Endoscopy

Diversified and Personalized Multi-rater Medical Image Segmentation

Multi-phase Liver Tumor Segmentation with Spatial Aggregation and Uncertain Region Inpainting

Reliable Mutual Distillation for Medical Image Segmentation under Imperfect Annotations

AHU-MultiNet: Adaptive loss balancing based on homoscedastic uncertainty in multi-task medical image segmentation network

Active Learning in Brain Tumor Segmentation with Uncertainty Sampling and Annotation Redundancy Restriction

Exploring and Exploiting Multi-Modality Uncertainty for Tumor Segmentation on PET/CT

ADNet++: A few-shot learning framework for multi-class medical image volume segmentation with uncertainty-guided feature refinement

SAM-Driven Weakly Supervised Nodule Segmentation with Uncertainty-Aware Cross Teaching

Multi-Modal Tumor Segmentation with Deformable Aggregation and Uncertain Region Inpainting

Uncertainty-aware Cascade Network for Ultrasound Image Segmentation with Ambiguous Boundary

Adaptive Feature Aggregation Based Multi-Task Learning for Uncertainty-Guided Semi-Supervised Medical Image Segmentation

Uncertainty-guided cross learning via CNN and transformer for semi-supervised honeycomb lung lesion segmentation

Uncertainty teacher with dense focal loss for semi-supervised medical image segmentation