Abstract:Pedestrian detection is notoriously considered a challenging task due to the frequent occlusion between humans. Unlike generic object detection, pedestrian detection involves a single category but dense instances, making it crucial to achieve accurate and robust object localization. By analogizing instance-level localization to a variational autoencoder and regarding the dense proposals as the latent variables, we establish a unique perspective of formulating pedestrian detection as a variational inference problem. From this vantage, we propose the Variational Pedestrian Detector (VPD), which uses a probabilistic model to estimate the true posterior of inferred proposals and applies a reparameterization trick to approximate the expected detection likelihood. In order to adapt the variational inference problem to the case of pedestrian detection, we propose a series of customized designs to cope with the issue of occlusion and spatial vibration. Specifically, we propose the Normal Gaussian and its variant of the Mixture model to parameterize the posterior in complicated scenarios. The inferred posterior is regularized by a conditional prior related to the ground-truth distribution, thus directly coupling the latent variables to specific target objects. Based on the posterior distribution, maximum detection likelihood estimation is applied to optimize the pedestrian detector, where a lightweight statistic decoder is designed to cast the detection likelihood into a parameterized form and enhance the confidence score estimation. With this variational inference process, VPD endows each proposal with the discriminative ability from its adjacent distractor due to the disentangling nature of the latent variable in variational inference, achieving accurate and robust detection in crowded scenes. Experiments conducted on CrowdHuman, CityPersons, and MS COCO demonstrate that our method is not only plug-and-play for numerous popular single-stage methods and two-stage methods but also can achieve a remarkable performance gain in highly occluded scenarios. The code for this project can be found at https://github.com/hhy-ee/VPD.

A Two‐Branch Pedestrian Detection Method for Small and Blurred Target

Pedestrian Detection Method Based on Improved YOLOv5s for Densely Occluded Scenarios

A Novel Approach to Design the Fast Pedestrian Detection for Video Surveillance System

Pedestrian Detection Based on Center, Temperature, Scale and Ratio Prediction in Thermal Imagery

Pedestrian detection based on modified dynamic background using gaussian mixture models and hog-svm detection

Taking a Look at Small-Scale Pedestrians and Occluded Pedestrians

Pedestrian Detection in Complex Scene Using Full Binary Tree Classifiers Based on Locally Assembled Binary Haar-Like Features

Too Far to See? Not Really! --- Pedestrian Detection with Scale-aware Localization Policy

Contour Information-Guided Multi-Scale Feature Detection Method for Visible-Infrared Pedestrian Detection

Clustering based detection of small target pedestrians for smart cities

Multi-Scale Infrared Pedestrian Detection Based on Deep Attention Mechanism

Pedestrian Detection Based on Sparse Coding and Transfer Learning

Asymmetric multi-stage CNNs for small-scale pedestrian detection

Pedestrian Detection Based on Hybrid Features

Toward Accurate and Robust Pedestrian Detection via Variational Inference

Multi-Scale Structure Perception and Global Context-Aware Method for Small-Scale Pedestrian Detection

Multi-Grained Deep Feature Learning for Pedestrian Detection

YOLO-ABD: A Multi-Scale Detection Model for Pedestrian Anomaly Behavior Detection

A Two-Stage Approach for Bag Detection in Pedestrian Images.

YOLOv8-CB: Dense Pedestrian Detection Algorithm Based on In-Vehicle Camera

Application of Improved YOLOv7 Algorithm in Pedestrian Detection