Abstract:One of appealing approaches to counting dense objects, such as crowd, is density map estimation. Density maps, however, present ambiguous appearance cues in congested scenes, rendering infeasibility in identifying individuals and difficulties in diagnosing errors. Inspired by an observation that counting can be interpreted as a two-stage process, i.e., identifying possible object regions and counting exact object numbers, we introduce a probabilistic intermediate representation termed the probability map that depicts the probability of each pixel being an object. This representation allows us to decouple counting into probability map regression (PMR) and count map regression (CMR). We therefore propose a novel decoupled two-stage counting (D2C) framework that sequentially regresses the probability map and learns a counter conditioned on the probability map. Given the probability map and the count map, a peak point detection algorithm is derived to localize each object with a point under the guidance of local counts. An advantage of D2C is that the counter can be learned reliably with additional synthesized probability maps. This addresses important data deficiency and sample imbalanced problems in counting. Our framework also enables easy diagnoses and analyses of error patterns. For instance, we find that, the counter per se is sufficiently accurate, while the bottleneck appears to be PMR. We further instantiate a network D2CNet in our framework and report state-of-the-art counting and localization performance across 6 crowd counting benchmarks. Since the probability map is a representation independent of visual appearance, D2CNet also exhibits remarkable cross-dataset transferability. Code and pretrained models are made available at: https://git.io/d2cnet

Semi-supervised Counting via Pixel-by-pixel Density Distribution Modelling

Relevant Region Prediction for Crowd Counting

Semantic-refined Spatial Pyramid Network for Crowd Counting

Multi-branch Progressive Embedding Network for Crowd Counting

Semi-Supervised Crowd Counting via Multiple Representation Learning

A Semi-supervised crowd counting method based on patch crowds statistics

Semi-Supervised Crowd Counting from Unlabeled Data

Return of Small-Scale Crowd Counting via Fast and Accurate Semi-Supervised Least Squares Model

Semi-Supervised Crowd Counting with Contextual Modeling: Facilitating Holistic Understanding of Crowd Scenes

Decoupled Two-Stage Crowd Counting and Beyond

Learning to Count via Unbalanced Optimal Transport

Towards using count-level weak supervision for crowd counting

Self-Supervised Learning With Data-Efficient Supervised Fine-Tuning for Crowd Counting

Spatial Uncertainty-Aware Semi-Supervised Crowd Counting

Uniformity in Heterogeneity: Diving Deep into Count Interval Partition for Crowd Counting

Hybrid Perturbation Strategy for Semi-Supervised Crowd Counting

Density-Aware Multi-Task Learning for Crowd Counting

Reducing Spatial Labeling Redundancy for Semi-supervised Crowd Counting

Scale-Aware Network with Regional and Semantic Attentions for Crowd Counting under Cluttered Background

A Survey on Deep Learning-based Single Image Crowd Counting: Network Design, Loss Function and Supervisory Signal

Redesigning Multi-Scale Neural Network for Crowd Counting