Abstract:In this paper, we address the large scale variation problem in crowd counting by taking full advantage of the multi-scale feature representations in a multi-level network. We implement such an idea by keeping the counting error of a patch as small as possible with a proper feature level selection strategy, since a specific feature level tends to perform better for a certain range of scales. However, without scale annotations, it is sub-optimal and error-prone to manually assign the predictions for heads of different scales to specific feature levels. Therefore, we propose a Scale-Adaptive Selection Network (SASNet), which automatically learns the internal correspondence between the scales and the feature levels. Instead of directly using the predictions from the most appropriate feature level as the final estimation, our SASNet also considers the predictions from other feature levels via weighted average, which helps to mitigate the gap between discrete feature levels and continuous scale variation. Since the heads in a local patch share roughly a same scale, we conduct the adaptive selection strategy in a patch-wise style. However, pixels within a patch contribute different counting errors due to the various difficulty degrees of learning. Thus, we further propose a Pyramid Region Awareness Loss (PRA Loss) to recursively select the most hard sub-regions within a patch until reaching the pixel level. With awareness of whether the parent patch is over-estimated or under-estimated, the fine-grained optimization with the PRA Loss for these region-aware hard pixels helps to alleviate the inconsistency problem between training target and evaluation metric. The state-of-the-art results on four datasets demonstrate the superiority of our approach. The code will be available at: https://github.com/TencentYoutuResearch/CrowdCounting-SASNet.

C^3 Framework: An Open-source PyTorch Code for Crowd Counting

Scale Pyramid Network For Crowd Counting

Multi-branch Progressive Embedding Network for Crowd Counting

The Effectiveness of a Simplified Model Structure for Crowd Counting

Uniformity in Heterogeneity: Diving Deep into Count Interval Partition for Crowd Counting

Rethinking Counting and Localization in Crowds: A Purely Point-Based Framework

LEVERAGE MULTI-SCALE DILATED CONVOLUTIONAL NEURAL NETWORK WITH GLOBAL ATTENTION FEATURE FUSION FOR CROWD COUNTING

Reaction Time as a Function of Onset and Offset Stimulation of the Fovea and Periphery

CrowdKit: A Generic Programming Framework for Mobile Crowdsensing Applications

CACrowdGAN: Cascaded Attentional Generative Adversarial Network for Crowd Counting

To Choose or to Fuse? Scale Selection for Crowd Counting

Adaptive Context Learning Network for Crowd Counting.

Deep Rank-Consistent Pyramid Model for Enhanced Crowd Counting

CCTrans: Simplifying and Improving Crowd Counting with Transformer

Foreground Mask Guided Network For Crowd Counting

S$^2$FPR: Crowd Counting via Self-Supervised Coarse to Fine Feature Pyramid Ranking

Enhancing and Dissecting Crowd Counting By Synthetic Data

Crowd Counting with Density Adaption Networks

In Defense of Single-column Networks for Crowd Counting

Dense Crowd Counting Based on Adaptive Scene Division

Decoupled Two-Stage Crowd Counting and Beyond