Abstract:Background and objective: Training convolutional neural networks based on large amount of labeled data has made great progress in the field of image segmentation. However, in medical image segmentation tasks, annotating the data is expensive and time-consuming because pixel-level annotation requires experts in the relevant field. Currently, the combination of consistent regularization and pseudo labeling-based semi-supervised methods has shown good performance in image segmentation. However, in the training process, a portion of low-confidence pseudo labels are generated by the model. And the semi-supervised segmentation method still has the problem of distribution bias between labeled and unlabeled data. The objective of this study is to address the challenges of semi-supervised learning and improve the segmentation accuracy of semi-supervised models on medical images. Methods: To address these issues, we propose an Uncertainty-based Region Clipping Algorithm for semi-supervised medical image segmentation, which consists of two main modules. A module is introduced to compute the uncertainty of two sub-networks predictions with diversity using Monte Carlo Dropout, allowing the model to gradually learn from more reliable targets. To retain model diversity, we use different loss functions for different branches and use Non-Maximum Suppression in one of the branches. The other module is proposed to generate new samples by masking the low-confidence pixels in the original image based on uncertainty information. New samples are fed into the model to facilitate the model to generate pseudo labels with high confidence and enlarge the training data distribution. Results: Comprehensive experiments on the combination of two benchmarks ACDC and BraTS2019 show that our proposed model outperforms state-of-the-art methods in terms of Dice, HD95 and ASD. The results reach an average Dice score of 87.86 % and a HD95 score of 4.214 mm on ACDC dataset. For the brain tumor segmentation, the results reach an average Dice score of 84.79 % and a HD score of 10.13 mm. Conclusions: Our proposed method improves the accuracy of semi-supervised medical image segmentation. Extensive experiments on two public medical image datasets including 2D and 3D modalities demonstrate the superiority of our model. The code is available at: https://github.com/QuintinDong/URCA.

Enhancing the Utilization of Uncertain Pixels in Semi-Supervised Semantic Segmentation

Improving Semantic Image Segmentation with a Probabilistic Superpixel-Based Dense Conditional Random Field.

Semisupervised Semantic Segmentation by Improving Prediction Confidence

Semi-Supervised Mesh Segmentation and Labeling

Semi-supervised image semantic segmentation method with semantic regions patching and uncertainty-guided loss

Unified Feature Consistency of Under-Performing Pixels and Valid Regions for Semi-Supervised Medical Image Segmentation

Semi-Supervised Semantic Segmentation Using Unreliable Pseudo-Labels

Using Unreliable Pseudo-Labels for Label-Efficient Semantic Segmentation

Semi-supervised Semantic Segmentation with Complementary Reconfirmation Mechanism.

Effective Semi-Supervised Medical Image Segmentation with Probabilistic Representations and Prototype Learning

Weakly Supervised Semantic Segmentation with Boundary Exploration

Uncertainty-Participation Context Consistency Learning for Semi-supervised Semantic Segmentation

Cross-Pixel Dependency with Boundary-Feature Transformation for Weakly Supervised Semantic Segmentation

Weakly Supervised Semantic Segmentation via Box-Driven Masking and Filling Rate Shifting

Unsupervised segmentation via semantic-apparent feature fusion

Semi-supervised Defect Segmentation with Uncertainty-aware Pseudo-labels from Multi-branch Network.

Weakly-Supervised Semantic Segmentation with Regional Location Cutting and Dynamic Credible Regions Correction

Class Probability Space Regularization for Semi-Supervised Semantic Segmentation

Pixel Exclusion: Uncertainty-aware Boundary Discovery for Active Cross-Domain Semantic Segmentation

URCA: Uncertainty-based region clipping algorithm for semi-supervised medical image segmentation