Abstract:Deep learning-based computer-aided diagnosis techniques have demonstrated encouraging performance in endoscopic lesion identification and detection, and have reduced the rate of missed and false detections of disease during endoscopy. However, the interpretability of the model-based results has not been adequately addressed by existing methods. This phenomenon is directly manifested by a significant bias in the representation of feature localization. Good recognition models experience severe feature localization errors, particularly for lesions with subtle morphological features, and such unsatisfactory performance hinders the clinical deployment of models. To effectively alleviate this problem, we proposed a solution to optimize the localization bias in feature representations of cancer-related recognition models that is difficult to accurately label and identify in clinical practice. Optimization was performed in the training phase of the model through the proposed data augmentation method and auxiliary loss function based on clinical priors. The data augmentation method, called partial jigsaw, can “break” the spatial structure of lesion-independent image blocks and enrich the data feature space to decouple the interference of background features on the space and focus on fine-grained lesion features. The annotation-based auxiliary loss function used class activation maps for sample distribution correction and led the model to present localization representation converging on the gold standard annotation of visualization maps. The results show that with the improvement of our method, the precision of model recognition reached an average of 92.79%, an F1-score of 92.61%, and accuracy of 95.56% based on a dataset constructed from 23 hospitals. In addition, we quantified the evaluation representation of visualization feature maps. The improved model yielded significant offset correction results for visualized feature maps compared with the baseline model. The average visualization-weighted positive coverage improved from 51.85% to 83.76%. The proposed approach did not change the deployment capability and inference speed of the original model and can be incorporated into any state-of-the-art neural network. It also shows the potential to provide more accurate localization inference results and assist in clinical examinations during endoscopies.

Semi-supervised segmentation of hyperspectral pathological imagery based on shape priors and contrastive learning

Multi-label Recognition of Cancer-Related Lesions with Clinical Priors on White-Light Endoscopy

Semi-supervised Segmentation of Liver Using Adversarial Learning with Deep Atlas Prior.

A high-level feature channel attention UNet network for cholangiocarcinoma segmentation from microscopy hyperspectral images

Semi-supervised breast cancer pathology image segmentation based on fine-grained classification guidance

A semi-supervised segmentation method for microscopic hyperspectral pathological images based on multi-consistency learning

Weakly supervised semantic segmentation of histological tissue via attention accumulation and pixel-level contrast learning

Diagnosis of Cholangiocarcinoma from Microscopic Hyperspectral Pathological Dataset by Deep Convolution Neural Networks.

Semi-supervised contrast learning-based segmentation of choroidal vessel in optical coherence tomography images

Semi-supervised lung adenocarcinoma histopathology image classification based on multi-teacher knowledge distillation

An Efficient Semi-Supervised Framework with Multi-Task and Curriculum Learning for Medical Image Segmentation

Human-machine Interactive Tissue Prototype Learning for Label-efficient Histopathology Image Segmentation

A Holistic Weakly Supervised Approach for Liver Tumor Segmentation with Clinical Knowledge-Informed Label Smoothing

Semisupervised 3D segmentation of pancreatic tumors in positron emission tomography/computed tomography images using a mutual information minimization and cross-fusion strategy

Affinity-Graph-Guided Contractive Learning for Pretext-Free Medical Image Segmentation with Minimal Annotation

Predicting cancer outcomes from whole slide images via hybrid supervision learning

An Effective Semi-supervised Approach for Liver CT Image Segmentation

Semi-Supervised Segmentation of Abdominal Organs and Liver Tumor: Uncertainty Rectified Curriculum Labeling Meets X-Fuse

Pancreatic cancer pathology image segmentation with channel and spatial long-range dependencies

Semi-supervised Semantic Segmentation of Cataract Surgical Images based on DeepLab v3+

CVCL: Context-aware Voxel-wise Contrastive Learning for label-efficient multi-organ segmentation