Abstract:Pedestrian detection is notoriously considered a challenging task due to the frequent occlusion between humans. Unlike generic object detection, pedestrian detection involves a single category but dense instances, making it crucial to achieve accurate and robust object localization. By analogizing instance-level localization to a variational autoencoder and regarding the dense proposals as the latent variables, we establish a unique perspective of formulating pedestrian detection as a variational inference problem. From this vantage, we propose the Variational Pedestrian Detector (VPD), which uses a probabilistic model to estimate the true posterior of inferred proposals and applies a reparameterization trick to approximate the expected detection likelihood. In order to adapt the variational inference problem to the case of pedestrian detection, we propose a series of customized designs to cope with the issue of occlusion and spatial vibration. Specifically, we propose the Normal Gaussian and its variant of the Mixture model to parameterize the posterior in complicated scenarios. The inferred posterior is regularized by a conditional prior related to the ground-truth distribution, thus directly coupling the latent variables to specific target objects. Based on the posterior distribution, maximum detection likelihood estimation is applied to optimize the pedestrian detector, where a lightweight statistic decoder is designed to cast the detection likelihood into a parameterized form and enhance the confidence score estimation. With this variational inference process, VPD endows each proposal with the discriminative ability from its adjacent distractor due to the disentangling nature of the latent variable in variational inference, achieving accurate and robust detection in crowded scenes. Experiments conducted on CrowdHuman, CityPersons, and MS COCO demonstrate that our method is not only plug-and-play for numerous popular single-stage methods and two-stage methods but also can achieve a remarkable performance gain in highly occluded scenarios. The code for this project can be found at https://github.com/hhy-ee/VPD.

Semi-supervised domain adaptation for pedestrian detection in video surveillance based on maximum independence assumption

Unsupervised Domain Adaptation for Multispectral Pedestrian Detection

Joint Feature-Level And Pixel-Level Domain Adaption For Object Detection In The Wild

A Novel Approach to Design the Fast Pedestrian Detection for Video Surveillance System

Domain Adaptation of Deformable Part-Based Models

Cognitive Pedestrian Detector: Adapting Detector to Specific Scene by Transferring Attributes.

Mixture Domain Adaptation to Improve Semantic Segmentation in Real-World Surveillance

Learning Domain-Invariant Subspace using Domain Features and Independence Maximization

An infrared pedestrian detection method based on segmentation and domain adaptation learning

MVUDA: Unsupervised Domain Adaptation for Multi-view Pedestrian Detection

Pedestrian Detection: Domain Generalization, CNNs, Transformers and Beyond

Rethinking Cross-Domain Pedestrian Detection: A Background-Focused Distribution Alignment Framework for Instance-Free One-Stage Detectors

Unsupervised Domain Adaptation for Disguised-gait-based Person Identification on Micro-Doppler Signatures

MCDCD: Multi-Source Unsupervised Domain Adaptation for Abnormal Human Gait Detection

Source-Free Unsupervised Cross-Domain Pedestrian Detection via Pseudo Label Mining and Screening

Unsupervised Domain Adaptive Object Detection using Forward-Backward Cyclic Adaptation

Toward Accurate and Robust Pedestrian Detection via Variational Inference

Multi-view Visual Surveillance and Phantom Removal for Effective Pedestrian Detection.

Spatial Alignment for Unsupervised Domain Adaptive Single-Stage Object Detection

Occluded Pedestrian Detection via Distribution-Based Mutual-Supervised Feature Learning

Online Domain Adaptation for Multi-Object Tracking