Abstract:One of appealing approaches to counting dense objects, such as crowd, is density map estimation. Density maps, however, present ambiguous appearance cues in congested scenes, rendering infeasibility in identifying individuals and difficulties in diagnosing errors. Inspired by an observation that counting can be interpreted as a two-stage process, i.e., identifying possible object regions and counting exact object numbers, we introduce a probabilistic intermediate representation termed the probability map that depicts the probability of each pixel being an object. This representation allows us to decouple counting into probability map regression (PMR) and count map regression (CMR). We therefore propose a novel decoupled two-stage counting (D2C) framework that sequentially regresses the probability map and learns a counter conditioned on the probability map. Given the probability map and the count map, a peak point detection algorithm is derived to localize each object with a point under the guidance of local counts. An advantage of D2C is that the counter can be learned reliably with additional synthesized probability maps. This addresses important data deficiency and sample imbalanced problems in counting. Our framework also enables easy diagnoses and analyses of error patterns. For instance, we find that, the counter per se is sufficiently accurate, while the bottleneck appears to be PMR. We further instantiate a network D2CNet in our framework and report state-of-the-art counting and localization performance across 6 crowd counting benchmarks. Since the probability map is a representation independent of visual appearance, D2CNet also exhibits remarkable cross-dataset transferability. Code and pretrained models are made available at: https://git.io/d2cnet

Counting Pedestrains in Video SequencesBased on Non-Maxima Suppression Clustering

Counting moving people in crowds using motion statistics of feature-points

Relevant Region Prediction for Crowd Counting

A Double-Region Learning Algorithm for Counting the Number of Pedestrians in Subway Surveillance Videos

An Approach for Crowd Density and Crowd Size Estimation

Multi-branch Progressive Embedding Network for Crowd Counting

Predicting Pedestrian Counts in Crowded Scenes With Rich and High-Dimensional Features

Semisupervised Pedestrian Counting With Temporal and Spatial Consistencies

Crowd counting method based on the self-attention residual network

Foreground Segmentation-Based Density Grading Networks for Crowd Counting

Pedestrian Detection in Crowded Crowd Scene Based on Deep Learning

Dynamic Region Division for Adaptive Learning Pedestrian Counting

Motional foreground attention-based video crowd counting

Motion-guided Non-local Spatial-Temporal Network for Video Crowd Counting

Robust crowd counting using detection flow

Counting People by Estimating People Flows

Context feature fusion and enhanced non-maximum suppression for pedestrian detection in crowded scenes

Decoupled Two-Stage Crowd Counting and Beyond

Counting people from above: Airborne video based crowd analysis

Crowd Counting With Limited Labeling Through Submodular Frame Selection

Automatic Identification of Human Subgroups in Time-Dependent Pedestrian Flow Networks