Abstract:In this paper, we introduce the idea of blockwise classification to count objects. The current mainstream method for counting objects is to regress the density map or to regress the redundant count map via a deep convolutional neural network (CNN). However, these methods suffer from two critical issues: inaccurately generated regression targets and serious sample imbalances. First, the ground truth density map is generated by convolving the dot map using a Gaussian kernel. Because an inappropriate kernel can cover the background or uncover objects, this approach introduces a form of noise, and therefore results in ambiguities when training the networks. Second, inhomogeneously distributed objects often exist in images, which gives rise to a data collection bias. This leads to a long-tailed distribution of region counts, which is a typical characteristic that occurs with imbalanced samples; therefore, underestimations in high-density regions and overestimations in low-density regions are common. In this paper, we address these two issues within one framework—blockwise count level classification. The intuition behind this idea is that while it may not be possible to provide an exact count of pixels or patches, it is possible to provide a count of a region that falls within a certain interval with high confidence. Our method classifies the count levels of each block produced by nonlinearly quantizing the continuous counts, thus transforming the imbalance of sample patch counts into a class imbalance of count levels. Consequently, an information-entropy-inspired loss can be applied to alleviate this issue. Through ablative studies, we analyze the impact of imbalanced data, Gaussian kernel sizes, quantization errors, and the effectiveness of each module in our method. Without bells and whistles, our method outperforms or performs competitively with other state-of-the-art approaches on seven object-counting benchmarks, including four crowd--ounting datasets from ShanghaiTech, WorldExpo'10, UCF-QNRF and UCF_CC_50, one vehicle-counting dataset (TRANCOS), one maize-tassel-counting dataset (MTC), and one challenging sonar fish-counting dataset that we constructed. The results suggest that our framework provides a strong and improved baseline for object counting.

Review Of Computer Vision Based Object Counting Methods

Approaches on crowd counting and density estimation: a review

Object Detection for Vision-Aided Inventory Counting

Deep-Learning-based Counting Methods, Datasets, and Applications in Agriculture -- A Review

Revisiting Crowd Counting: State-of-the-art, Trends, and Future Perspectives

Vehicle Counting System using Deep Learning and Multi-Object Tracking Methods

A comprehensive analysis for crowd counting methodologies and algorithms in Internet of Things

Convolutional Neural Networks and Heuristic Methods for Crowd Counting: A Systematic Review

Counting Objects by Blockwise Classification

A Survey on Deep Learning-based Single Image Crowd Counting: Network Design, Loss Function and Supervisory Signal

Study and Application of Automatic Count System Based on Computer Vision Detect Technology

Object Detection and Tracking Algorithms for Vehicle Counting: A Comparative Analysis

Counting from Sky: A Large-scale Dataset for Remote Sensing Object Counting and A Benchmark Method

Research on Pedestrian Detection and Head Counting Algorithm Based on Computer Vision

Learning Models in Crowd Analysis: A Review

Automated Vehicle Counting from Pre-Recorded Video Using You Only Look Once (YOLO) Object Detection Model

A survey of crowd counting and density estimation based on convolutional neural network

From Open Set to Closed Set: Supervised Spatial Divide-and-Conquer for Object Counting

Review of Object Detection Techniques

A comprehensive review of image analysis methods for microorganism counting: from classical image processing to deep learning approaches

Computer Vision Approaches for Automated Bee Counting Application