Abstract:As a widely used semi-supervised learning strategy, self-training generates pseudo-labels to alleviate the labor-intensive and time-consuming annotation problems in crowd counting while boosting the model performance with limited labeled data and massive unlabeled data. However, the noise in the pseudo-labels of the density maps greatly hinders the performance of semi-supervised crowd counting. Although auxiliary tasks, e.g., binary segmentation, are utilized to help improve the feature representation learning ability, they are isolated from the main task, i.e., density map regression and the multi-task relationships are totally ignored. To address the above issues, we develop a multi-task credible pseudo-label learning (MTCP) framework for crowd counting, consisting of three multi-task branches, i.e., density regression as the main task, and binary segmentation and confidence prediction as the auxiliary tasks. Multi-task learning is conducted on the labeled data by sharing the same feature extractor for all three tasks and taking multi-task relations into account. To reduce epistemic uncertainty, the labeled data are further expanded, by trimming the labeled data according to the predicted confidence map for low-confidence regions, which can be regarded as an effective data augmentation strategy. For unlabeled data, compared with the existing works that only use the pseudo-labels of binary segmentation, we generate credible pseudo-labels of density maps directly, which can reduce the noise in pseudo-labels and therefore decrease aleatoric uncertainty. Extensive comparisons on four crowd-counting datasets demonstrate the superiority of our proposed model over the competing methods. The code is available at: https://github.com/ljq2000/MTCP.

Perspective-assisted Prototype-Based Learning for Semi-Supervised Crowd Counting

Semi-Supervised Crowd Counting with Contextual Modeling: Facilitating Holistic Understanding of Crowd Scenes

Learning a Perspective-Embedded Deconvolution Network for Crowd Counting.

Revisiting Perspective Information For Efficient Crowd Counting

PANet: Perspective-Aware Network with Dynamic Receptive Fields and Self-Distilling Supervision for Crowd Counting

Perspective-Guided Convolution Networks for Crowd Counting

Perspective-Aware CNN For Crowd Counting.

Multi-Task Credible Pseudo-Label Learning for Semi-Supervised Crowd Counting.

Semi-Supervised Crowd Counting via Multiple Representation Learning

Counting Crowds with Perspective Distortion Correction via Adaptive Learning

Perspective-guided Point Supervision Network for Crowd Counting

Semi-Supervised Crowd Counting Via Self-Training on Surrogate Tasks

Crowd Counting Via Learning Perspective for Multi-Scale Multi-View Web Images

Crowd Counting via Perspective-Guided Fractional-Dilation Convolution

Semi-Supervised Crowd Counting Via Multi-Task Pseudo-Label Self-Correction Strategy

Distance-Aware Network for Physical-World Object Distribution Estimation and Counting

Hybrid Perturbation Strategy for Semi-Supervised Crowd Counting

Leveraging Self-Supervision for Cross-Domain Crowd Counting

Semi-supervised Crowd Counting Via Density Agency

Semi-Supervised Crowd Counting from Unlabeled Data

Crowd Counting With Limited Labeling Through Submodular Frame Selection