Abstract:Crowd counting is a concerned yet challenging task in computer vision. The difficulty is particularly pronounced by scale variations in crowd images. Most state-of-art approaches tackle the multi-scale problem by adopting multicolumn CNN architectures where different columns are designed with different filter sizes to adapt to variable pedestrian/object sizes. However, the structure is bloated and inefficient, and it is infeasible to adopt multiple deep columns due to the huge resource cost. We instead propose a Scale Pyramid Network (SPN) which adopts a shared single deep column structure and extracts multi-scale information in high layers by Scale Pyramid Module. In Scale Pyramid Module, we specifically employ different rates of dilated convolutions in parallel instead of traditional convolutions with different sizes. Compared to other methods of coping with scale issues, our single column structure with Scale Pyramid Module can get more accurate estimation with simpler structure and less complexity of training. And our Scale Pyramid Module can be easily applied to a deep network. Experimental results on four datasets show that our method achieves state-of-the-art performance. On Shanghai-Tech Part A dataset which is challenging for its highly congested scenes and scale variation, we achieve 9.5% lower MAE and 13.5% lower MSE than the previous state-of-the-art method. We also extend our model on TRANCOS vehicle counting dataset and significantly achieve 5.9% lower GAME(0), 10% lower GAME(1), 24.5% lower GAME(2), 38.7% lower GAME(3) than the previous state-of-the-art method. The experimental results prove the robustness of our model for crowd counting, especially with scale variations.

Approaches on crowd counting and density estimation: a review

Relevant Region Prediction for Crowd Counting

Scale Pyramid Network For Crowd Counting

Deep Learning Approaches for Crowd Density Estimation: A Review

An Approach for Crowd Density and Crowd Size Estimation

A Survey on Deep Learning-based Single Image Crowd Counting: Network Design, Loss Function and Supervisory Signal

Multi-branch Progressive Embedding Network for Crowd Counting

Semantic-refined Spatial Pyramid Network for Crowd Counting

A survey of crowd counting and density estimation based on convolutional neural network

Revisiting Crowd Counting: State-of-the-art, Trends, and Future Perspectives

Convolutional Neural Networks and Heuristic Methods for Crowd Counting: A Systematic Review

Review Of Computer Vision Based Object Counting Methods

Concise Convolutional Neural Network for Crowd Counting

Improving Deep Crowd Density Estimation Via Pre-classification of Density.

Enhancing and Dissecting Crowd Counting By Synthetic Data

Density-Aware Multi-Task Learning for Crowd Counting

A comprehensive analysis for crowd counting methodologies and algorithms in Internet of Things

DRENet: Giving Full Scope to Detection and Regression-Based Estimation for Video Crowd Counting

Crowd Counting with Density Adaption Networks

Return of Small-Scale Crowd Counting via Fast and Accurate Semi-Supervised Least Squares Model

A Review of Deep Learning Techniques for Crowd Behavior Analysis