Abstract:To perform semantic image segmentation using deep learning models, a significant quantity of data and meticulous manual annotation is necessary (Mani in: Research anthology on improving medical imaging techniques for analysis and intervention. IGI Global, pp. 107–125, 2023), and the process consumes a lot of resources, including time and money. To resolve such issues, we introduce a unique label propagation method (Qin et al. in IEEE/CAA J Autom Sinica 10(5):1192–1208, 2023) that utilizes cycle consistency across time to propagate labels over longer time horizons with higher accuracy. Additionally, we acknowledge that dense pixel annotation is a noisy process (Das et al. in: Proceedings of the IEEE/CVF winter conference on applications of computer vision, pp. 5978–5987, 2023), whether performed manually or automatically. To address this, we present a principled approach that accounts for label uncertainty when training with labels from multiple noisy labeling processes. We introduce two new approaches; Warp-Refine Propagation and Uncertainty-Aware Training, for improving label propagation and handling noisy labels, respectively, and support the process with quantitative and qualitative evaluations and theoretical justification. Our contributions are validated on the Cityscapes and ApolloScape datasets, where we achieve encouraging results. In later endeavors, the aim should be to expand such approaches to include other noisy augmentation processes like image-based rendering methods (Laraqui et al. in Int J Comput Aid Eng Technol 18(5):141–151, 2023), thanks to the noisy label learning approach.

Semi-supervised Semantic Segmentation Algorithm for Video Frame Corruption.

Video Semantic Segmentation With Distortion-Aware Feature Correction

Weakly Supervised Multiclass Video Segmentation

Semi-Supervised Semantic Segmentation Using Unreliable Pseudo-Labels

Semi-supervised Defect Segmentation with Uncertainty-aware Pseudo-labels from Multi-branch Network.

A Componentwise Approach to Weakly Supervised Semantic Segmentation Using Dual-Feedback Network

Adaptive Affinity Loss and Erroneous Pseudo-Label Refinement for Weakly Supervised Semantic Segmentation

Semi-supervised image semantic segmentation method with semantic regions patching and uncertainty-guided loss

Semisupervised Semantic Segmentation by Improving Prediction Confidence

Semi-supervised Video Semantic Segmentation Using Unreliable Pseudo Labels for PVUW2024

Weakly Supervised Semantic Segmentation for Social Images

Progressive Feature Self-reinforcement for Weakly Supervised Semantic Segmentation

Weakly Supervised Semantic Segmentation Using Web-Crawled Videos

Enhanced Pseudo-Label Generation with Self-supervised Training for Weakly-supervised Semantic Segmentation

Sparse Reconstruction for Weakly Supervised Semantic Segmentation.

Enhancing Semi-Supervised Semantic Segmentation of Remote Sensing Images via Feature Perturbation-Based Consistency Regularization Methods

HPL-ESS: Hybrid Pseudo-Labeling for Unsupervised Event-based Semantic Segmentation

Semantic Segmentation of Weakly Annotated Remote Sensing Images Based on Feature Adversary and Uncertainty Perception

Efficient and accurate semi-supervised semantic segmentation for industrial surface defects

Learning Pseudo Labels for Semi-and-weakly Supervised Semantic Segmentation

Enhancing Semi Supervised Semantic Segmentation Through Cycle-Consistent Label Propagation in Video