Abstract:Pedestrian detection is notoriously considered a challenging task due to the frequent occlusion between humans. Unlike generic object detection, pedestrian detection involves a single category but dense instances, making it crucial to achieve accurate and robust object localization. By analogizing instance-level localization to a variational autoencoder and regarding the dense proposals as the latent variables, we establish a unique perspective of formulating pedestrian detection as a variational inference problem. From this vantage, we propose the Variational Pedestrian Detector (VPD), which uses a probabilistic model to estimate the true posterior of inferred proposals and applies a reparameterization trick to approximate the expected detection likelihood. In order to adapt the variational inference problem to the case of pedestrian detection, we propose a series of customized designs to cope with the issue of occlusion and spatial vibration. Specifically, we propose the Normal Gaussian and its variant of the Mixture model to parameterize the posterior in complicated scenarios. The inferred posterior is regularized by a conditional prior related to the ground-truth distribution, thus directly coupling the latent variables to specific target objects. Based on the posterior distribution, maximum detection likelihood estimation is applied to optimize the pedestrian detector, where a lightweight statistic decoder is designed to cast the detection likelihood into a parameterized form and enhance the confidence score estimation. With this variational inference process, VPD endows each proposal with the discriminative ability from its adjacent distractor due to the disentangling nature of the latent variable in variational inference, achieving accurate and robust detection in crowded scenes. Experiments conducted on CrowdHuman, CityPersons, and MS COCO demonstrate that our method is not only plug-and-play for numerous popular single-stage methods and two-stage methods but also can achieve a remarkable performance gain in highly occluded scenarios. The code for this project can be found at https://github.com/hhy-ee/VPD.

Toward Accurate and Robust Pedestrian Detection via Variational Inference

Variational Pedestrian Detection

Towards Accurate Dense Pedestrian Detection Via Occlusion-Prediction Aware Label Assignment and Hierarchical-Nms.

Pedestrian Detection Method Based on Improved YOLOv5s for Densely Occluded Scenarios

Adaptive Pedestrian Detection by Predicting Classifier

Pedestrian Detection by Learning a Mixture Mask Model and Its Implementation

AutoPedestrian: An Automatic Data Augmentation and Loss Function Search Scheme for Pedestrian Detection

Towards real-time accurate dense pedestrian detection via large-kernel perception module and multi-level feature fusion

A Part-Aware Multi-Scale Fully Convolutional Network for Pedestrian Detection

VRGNet: A Robust Visible Region-Guided Network for Occluded Pedestrian Detection.

Learning Hierarchical Graph for Occluded Pedestrian Detection

Coupled Network for Robust Pedestrian Detection With Gated Multi-Layer Feature Extraction and Deformable Occlusion Handling

Research on Multi-Modal Pedestrian Detection and Tracking Algorithm Based on Deep Learning

A Pedestrian-Detection Method Based on Heterogeneous Features and Ensemble of Multi-View–Pose Parts

DDAD: Detachable Crowd Density Estimation Assisted Pedestrian Detection

Count- and Similarity-Aware R-CNN for Pedestrian Detection

Visible Part Prediction and Temporal Calibration for Pedestrian Detection

YOLOv8-based Dense Pedestrian Detection Algorithm

YOLOv7-PD: Incorporating DE-ELAN and NWD-CIoU for Advanced Pedestrian Detection Method

Too Far to See? Not Really! --- Pedestrian Detection with Scale-aware Localization Policy

Attention-Guided Sample-Based Feature Enhancement Network for Crowded Pedestrian Detection Using Vision Sensors