Abstract:Semi-supervised learning has garnered significant interest as a method to alleviate the burden of data annotation. Recently, semi-supervised medical image segmentation has garnered significant interest that can alleviate the burden of densely annotated data. Substantial advancements have been achieved by integrating consistency-regularization and pseudo-labeling techniques. The quality of the pseudo-labels is crucial in this regard. Unreliable pseudo-labeling can result in the introduction of noise, leading the model to converge to suboptimal solutions. To address this issue, we propose learning from reliable pseudo-labels. In this paper, we tackle two critical questions in learning from reliable pseudo-labels: which pseudo-labels are reliable and how reliable are they? Specifically, we conduct a comparative analysis of two subnetworks to address both challenges. Initially, we compare the prediction confidence of the two subnetworks. A higher confidence score indicates a more reliable pseudo-label. Subsequently, we utilize intra-class similarity to assess the reliability of the pseudo-labels to address the second challenge. The greater the intra-class similarity of the predicted classes, the more reliable the pseudo-label. The subnetwork selectively incorporates knowledge imparted by the other subnetwork model, contingent on the reliability of the pseudo labels. By reducing the introduction of noise from unreliable pseudo-labels, we are able to improve the performance of segmentation. To demonstrate the superiority of our approach, we conducted an extensive set of experiments on three datasets: Left Atrium, Pancreas-CT and Brats-2019. The experimental results demonstrate that our approach achieves state-of-the-art performance. Code is available at: https://github.com/Jiawei0o0/mutual-learning-with-reliable-pseudo-labels .

Uncertainty-aware pseudo-label and consistency for semi-supervised medical image segmentation

Mutually aided uncertainty incorporated Dual Consistency Regularization with Pseudo Label for Semi-Supervised Medical Image Segmentation

Semi-Supervised Convolutional Vision Transformer with Bi-Level Uncertainty Estimation for Medical Image Segmentation

Unified Feature Consistency of Under-Performing Pixels and Valid Regions for Semi-Supervised Medical Image Segmentation

Uncertainty-Guided Mutual Consistency Learning for Semi-Supervised Medical Image Segmentation

Double-Uncertainty Weighted Method for Semi-supervised Learning

Uncertainty teacher with dense focal loss for semi-supervised medical image segmentation

Semi-supervised medical image segmentation via uncertainty rectified pyramid consistency

Semi-supervised medical image segmentation via a tripled-uncertainty guided mean teacher model with contrastive learning

Dual-Decoder Consistency via Pseudo-Labels Guided Data Augmentation for Semi-Supervised Medical Image Segmentation

Decoupled Consistency for Semi-supervised Medical Image Segmentation

Mutual learning with reliable pseudo label for semi-supervised medical image segmentation

Pseudo Label-Guided Data Fusion and Output Consistency for Semi-Supervised Medical Image Segmentation

Tripled-Uncertainty Guided Mean Teacher Model for Semi-supervised Medical Image Segmentation

Dual uncertainty-guided multi-model pseudo-label learning for semi-supervised medical image segmentation

Multi-task contrastive learning for semi-supervised medical image segmentation with multi-scale uncertainty estimation

Uncertainty-aware and Dynamically-Mixed Pseudo-Labels for Semi-Supervised Defect Segmentation

Semi-supervised Defect Segmentation with Uncertainty-aware Pseudo-labels from Multi-branch Network.

Co-training with High-Confidence Pseudo Labels for Semi-supervised Medical Image Segmentation

Uncertainty-Guided Voxel-Level Supervised Contrastive Learning for Semi-Supervised Medical Image Segmentation

Dual Uncertainty-Guided Mixing Consistency for Semi-Supervised 3D Medical Image Segmentation