Abstract:A major bottleneck of pedestrian detection lies on the sharp performance deterioration in the presence of small-size pedestrians that are relatively far from the camera. Motivated by the observation that pedestrians of disparate spatial scales exhibit distinct visual appearances, we propose in this paper an active pedestrian detector that explicitly operates over multiple-layer neuronal representations of the input still image. More specifically, convolutional neural nets such as ResNet and faster R-CNNs are exploited to provide a rich and discriminative hierarchy of feature representations as well as initial pedestrian proposals. Here each pedestrian observation of distinct size could be best characterized in terms of the ResNet feature representation at a certain layer of the hierarchy; Meanwhile, initial pedestrian proposals are attained by faster R-CNNs techniques, i.e. region proposal network and follow-up region of interesting pooling layer employed right after the specific ResNet convolutional layer of interest, to produce joint predictions on the bounding-box proposals' locations and categories (i.e. pedestrian or not). This is engaged as input to our active detector where for each initial pedestrian proposal, a sequence of coordinate transformation actions is carried out to determine its proper x-y 2D location and layer of feature representation, or eventually terminated as being background. Empirically our approach is demonstrated to produce overall lower detection errors on widely-used benchmarks, and it works particularly well with far-scale pedestrians. For example, compared with 60.51% log-average miss rate of the state-of-the-art MS-CNN for far-scale pedestrians (those below 80 pixels in bounding-box height) of the Caltech benchmark, the miss rate of our approach is 41.85%, with a notable reduction of 18.68%.

Multi‐scale Pedestrian Detection with Global–local Attention and Multi‐scale Receptive Field Context

Multi-Scale Structure Perception and Global Context-Aware Method for Small-Scale Pedestrian Detection

See Extensively While Focusing on the Core Area for Pedestrian Detection.

Multi-scale Pedestrian Detection Based on Receptive Field Matching

Multi-Scale Infrared Pedestrian Detection Based on Deep Attention Mechanism

Pedestrian Detection with Multi-scale Context-Embedded Feature Learning

Locality guided cross-modal feature aggregation and pixel-level fusion for multispectral pedestrian detection

Small-scale Pedestrian Detection Based on Multi-Level Feature Fusion

Pedestrian Detection Via Bi-directional Multi-scale Analysis.

Multi-Grained Deep Feature Learning for Pedestrian Detection

Scale-Aware Hierarchical Detection Network for Pedestrian Detection

Delving Deep into Multiscale Pedestrian Detection Via Single Scale Feature Maps

Multi-scale cross-layer fusion and center position network for pedestrian detection

Scale-aware Fast R-CNN for Pedestrian Detection

Improving Multispectral Pedestrian Detection with Scale‐aware Permutation Attention and Adjacent Feature Aggregation

Semantically Enhanced Multi-scale Feature Pyramid Fusion for Pedestrian Detection.

Too Far to See? Not Really! --- Pedestrian Detection with Scale-aware Localization Policy

PRF-Ped: Multi-scale Pedestrian Detector with Prior-based Receptive Field.

Learning a Dynamic High-Resolution Network for Multi-Scale Pedestrian Detection

Scale-aware hierarchical loss: A multipath RPN for multi-scale pedestrian detection

Multi-scale Pedestrian Detection in Infrared Images with Salient Background-awareness