Abstract:As a widely used semi-supervised learning strategy, self-training generates pseudo-labels to alleviate the labor-intensive and time-consuming annotation problems in crowd counting while boosting the model performance with limited labeled data and massive unlabeled data. However, the noise in the pseudo-labels of the density maps greatly hinders the performance of semi-supervised crowd counting. Although auxiliary tasks, e.g., binary segmentation, are utilized to help improve the feature representation learning ability, they are isolated from the main task, i.e., density map regression and the multi-task relationships are totally ignored. To address the above issues, we develop a multi-task credible pseudo-label learning (MTCP) framework for crowd counting, consisting of three multi-task branches, i.e., density regression as the main task, and binary segmentation and confidence prediction as the auxiliary tasks. Multi-task learning is conducted on the labeled data by sharing the same feature extractor for all three tasks and taking multi-task relations into account. To reduce epistemic uncertainty, the labeled data are further expanded, by trimming the labeled data according to the predicted confidence map for low-confidence regions, which can be regarded as an effective data augmentation strategy. For unlabeled data, compared with the existing works that only use the pseudo-labels of binary segmentation, we generate credible pseudo-labels of density maps directly, which can reduce the noise in pseudo-labels and therefore decrease aleatoric uncertainty. Extensive comparisons on four crowd-counting datasets demonstrate the superiority of our proposed model over the competing methods. The code is available at: https://github.com/ljq2000/MTCP.

Semi-Supervised Crowd Counting Via Multi-Task Pseudo-Label Self-Correction Strategy

Multi-Task Credible Pseudo-Label Learning for Semi-Supervised Crowd Counting.

Semi-Supervised Crowd Counting Via Self-Training on Surrogate Tasks

A Semi-supervised crowd counting method based on patch crowds statistics

Semi-Supervised Crowd Counting With Spatial Temporal Consistency and Pseudo-Label Filter

Hybrid Perturbation Strategy for Semi-Supervised Crowd Counting

Semi-Supervised Crowd Counting from Unlabeled Data

Reducing Spatial Labeling Redundancy for Semi-supervised Crowd Counting

Semi-Supervised Crowd Counting with Contextual Modeling: Facilitating Holistic Understanding of Crowd Scenes

Towards using count-level weak supervision for crowd counting

Semi-supervised Crowd Counting Via Density Agency

Self-Supervised Learning With Data-Efficient Supervised Fine-Tuning for Crowd Counting

Semi-Supervised Crowd Counting via Multiple Representation Learning

Return of Small-Scale Crowd Counting via Fast and Accurate Semi-Supervised Least Squares Model

Active Crowd Counting with Limited Supervision

Semi-supervised Counting via Pixel-by-pixel Density Distribution Modelling

A Self-Training Approach for Point-Supervised Object Detection and Counting in Crowds

Spatial Uncertainty-Aware Semi-Supervised Crowd Counting

Crowd Counting with Sparse Annotation

Multiscale Crowd Counting and Localization By Multitask Point Supervision

Boosting Semi-supervised Crowd Counting with Scale-based Active Learning