Abstract:A major bottleneck of pedestrian detection lies on the sharp performance deterioration in the presence of small-size pedestrians that are relatively far from the camera. Motivated by the observation that pedestrians of disparate spatial scales exhibit distinct visual appearances, we propose in this paper an active pedestrian detector that explicitly operates over multiple-layer neuronal representations of the input still image. More specifically, convolutional neural nets such as ResNet and faster R-CNNs are exploited to provide a rich and discriminative hierarchy of feature representations as well as initial pedestrian proposals. Here each pedestrian observation of distinct size could be best characterized in terms of the ResNet feature representation at a certain layer of the hierarchy; Meanwhile, initial pedestrian proposals are attained by faster R-CNNs techniques, i.e. region proposal network and follow-up region of interesting pooling layer employed right after the specific ResNet convolutional layer of interest, to produce joint predictions on the bounding-box proposals' locations and categories (i.e. pedestrian or not). This is engaged as input to our active detector where for each initial pedestrian proposal, a sequence of coordinate transformation actions is carried out to determine its proper x-y 2D location and layer of feature representation, or eventually terminated as being background. Empirically our approach is demonstrated to produce overall lower detection errors on widely-used benchmarks, and it works particularly well with far-scale pedestrians. For example, compared with 60.51% log-average miss rate of the state-of-the-art MS-CNN for far-scale pedestrians (those below 80 pixels in bounding-box height) of the Caltech benchmark, the miss rate of our approach is 41.85%, with a notable reduction of 18.68%.

Supplementary material: Strengthening the Effectiveness of Pedestrian Detection with Spatially Pooled Features

Strengthening the Effectiveness of Pedestrian Detection with Spatially Pooled Features

Supplementary material: Efficient pedestrian detection by directly optimizing the partial area under the ROC curve

See Extensively While Focusing on the Core Area for Pedestrian Detection.

Pedestrian Detection Method Based on Improved YOLOv5s for Densely Occluded Scenarios

Towards Accurate Dense Pedestrian Detection Via Occlusion-Prediction Aware Label Assignment and Hierarchical-Nms.

Pedestrian Detection with Spatially Pooled Features and Structured Ensemble Learning

Efficient Pedestrian Detection by Directly Optimizing the Partial Area under the Roc Curve

Locality guided cross-modal feature aggregation and pixel-level fusion for multispectral pedestrian detection

Effective Pedestrian Detection Using Center-symmetric Local Binary/Trinary Patterns

Discriminative Latent Semantic Feature Learning for Pedestrian Detection

Fast Pedestrian Detection Using a Cascade of Boosted Covariance Features.

AutoPedestrian: An Automatic Data Augmentation and Loss Function Search Scheme for Pedestrian Detection

Improving Multispectral Pedestrian Detection with Scale‐aware Permutation Attention and Adjacent Feature Aggregation

Selecting Learnable Training Samples is All DETRs Need in Crowded Pedestrian Detection

Mean Height Aided Post-Processing for Pedestrian Detection

An overview of fast pedestrian detection: feature selection and cascade framework of boosted features

Exploiting the Potential of Overlapping Cropping for Real-World Pedestrian and Vehicle Detection with Gigapixel-Level Images

Too Far to See? Not Really! --- Pedestrian Detection with Scale-aware Localization Policy

Context feature fusion and enhanced non-maximum suppression for pedestrian detection in crowded scenes

Real-time Pedestrian Detection Using a Boosted Multi-layer Classifier