Abstract:In this paper, we introduce the idea of blockwise classification to count objects. The current mainstream method for counting objects is to regress the density map or to regress the redundant count map via a deep convolutional neural network (CNN). However, these methods suffer from two critical issues: inaccurately generated regression targets and serious sample imbalances. First, the ground truth density map is generated by convolving the dot map using a Gaussian kernel. Because an inappropriate kernel can cover the background or uncover objects, this approach introduces a form of noise, and therefore results in ambiguities when training the networks. Second, inhomogeneously distributed objects often exist in images, which gives rise to a data collection bias. This leads to a long-tailed distribution of region counts, which is a typical characteristic that occurs with imbalanced samples; therefore, underestimations in high-density regions and overestimations in low-density regions are common. In this paper, we address these two issues within one framework—blockwise count level classification. The intuition behind this idea is that while it may not be possible to provide an exact count of pixels or patches, it is possible to provide a count of a region that falls within a certain interval with high confidence. Our method classifies the count levels of each block produced by nonlinearly quantizing the continuous counts, thus transforming the imbalance of sample patch counts into a class imbalance of count levels. Consequently, an information-entropy-inspired loss can be applied to alleviate this issue. Through ablative studies, we analyze the impact of imbalanced data, Gaussian kernel sizes, quantization errors, and the effectiveness of each module in our method. Without bells and whistles, our method outperforms or performs competitively with other state-of-the-art approaches on seven object-counting benchmarks, including four crowd--ounting datasets from ShanghaiTech, WorldExpo'10, UCF-QNRF and UCF_CC_50, one vehicle-counting dataset (TRANCOS), one maize-tassel-counting dataset (MTC), and one challenging sonar fish-counting dataset that we constructed. The results suggest that our framework provides a strong and improved baseline for object counting.

Dilated-Scale-Aware Category-Attention ConvNet for Multi-Class Object Counting

Dilated-Scale-Aware Attention ConvNet For Multi-Class Object Counting

Scale Pyramid Network For Crowd Counting

Beyond Counting: Point Supervised Attention Guided Neural Network for Crowded Object Locating

LEVERAGE MULTI-SCALE DILATED CONVOLUTIONAL NEURAL NETWORK WITH GLOBAL ATTENTION FEATURE FUSION FOR CROWD COUNTING

Crowd Counting by Multi-Scale Dilated Convolution Networks

A Unified Object Counting Network with Object Occupation Prior

Scale-Aware Network with Regional and Semantic Attentions for Crowd Counting under Cluttered Background

DOPNet: Dense Object Prediction Network for Multiclass Object Counting and Localization in Remote Sensing Images

Counting Objects by Blockwise Classification

Attend to Count: Crowd Counting with Adaptive Capacity Multi-Scale CNNs.

OmniCount: Multi-label Object Counting with Semantic-Geometric Priors

Towards Locally Consistent Object Counting with Constrained Multi-stage Convolutional Neural Networks

From Open Set to Closed Set: Supervised Spatial Divide-and-Conquer for Object Counting

Long-range attention classification for substation point cloud

CODA: Counting Objects via Scale-aware Adversarial Density Adaption

A multi-scale fusion and dual attention network for crowd counting

A Crowded Object Counting System with Self-Attention Mechanism

A Self-Training Approach for Point-Supervised Object Detection and Counting in Crowds

Counting from Sky: A Large-scale Dataset for Remote Sensing Object Counting and A Benchmark Method