Abstract:Perspective distortions and crowd variations make crowd counting a challenging task in computer vision. To tackle it, many previous works have used multi-scale architecture in deep neural networks (DNNs). Multi-scale branches can be either directly merged (e.g. by concatenation) or merged through the guidance of proxies (e.g. attentions) in the DNNs. Despite their prevalence, these combination methods are not sophisticated enough to deal with the per-pixel performance discrepancy over multi-scale density maps. In this work, we redesign the multi-scale neural network by introducing a hierarchical mixture of density experts, which hierarchically merges multi-scale density maps for crowd counting. Within the hierarchical structure, an expert competition and collaboration scheme is presented to encourage contributions from all scales; pixel-wise soft gating nets are introduced to provide pixel-wise soft weights for scale combinations in different hierarchies. The network is optimized using both the crowd density map and the local counting map, where the latter is obtained by local integration on the former. Optimizing both can be problematic because of their potential conflicts. We introduce a new relative local counting loss based on relative count differences among hard-predicted local regions in an image, which proves to be complementary to the conventional absolute error loss on the density map. Experiments show that our method achieves the state-of-the-art performance on five public datasets, i.e. ShanghaiTech, UCF_CC_50, JHU-CROWD++, NWPU-Crowd and Trancos.

Density-Aware Multi-Task Learning for Crowd Counting

Relevant Region Prediction for Crowd Counting

Multi-branch Progressive Embedding Network for Crowd Counting

Semantic-refined Spatial Pyramid Network for Crowd Counting

Learning Multi-Level Density Maps for Crowd Counting.

Concise Convolutional Neural Network for Crowd Counting

LEVERAGE MULTI-SCALE DILATED CONVOLUTIONAL NEURAL NETWORK WITH GLOBAL ATTENTION FEATURE FUSION FOR CROWD COUNTING

Density-aware and background-aware network for crowd counting via multi-task learning

Attention Scaling For Crowd Counting

Attend to Count: Crowd Counting with Adaptive Capacity Multi-Scale CNNs.

Crowd Counting Method Based on Convolutional Neural Network with Global Density Feature

Crowd Counting Based on Multiresolution Density Map and Parallel Dilated Convolution

Single-Image Crowd Counting Via Multi-Column Convolutional Neural Network

Congested Crowd Counting via Adaptive Multi-Scale Context Learning

Crowd density estimation based on multi scale features fusion network with reverse attention mechanism

Redesigning Multi-Scale Neural Network for Crowd Counting

A survey of crowd counting and density estimation based on convolutional neural network

Multi-scale features fused network with multi-level supervised path for crowd counting

Counting Varying Density Crowds Through Density Guided Adaptive Selection CNN and Transformer Estimation

Cascade-guided multi-scale attention network for crowd counting

Crowd Counting by Multi-Scale Dilated Convolution Networks