Abstract:With the prosperity of the video surveillance, multiple cameras have been applied to accurately locate pedestrians in a specific area. However, previous methods rely on the human-labeled annotations in every video frame and camera view, leading to heavier burden than necessary camera calibration and synchronization. Therefore, we propose in this paper an Unsupervised Multi-view Pedestrian Detection approach (UMPD) to eliminate the need of annotations to learn a multi-view pedestrian detector via 2D-3D mapping. 1) Firstly, Semantic-aware Iterative Segmentation (SIS) is proposed to extract unsupervised representations of multi-view images, which are converted into 2D pedestrian masks as pseudo labels, via our proposed iterative PCA and zero-shot semantic classes from vision-language models. 2) Secondly, we propose Geometry-aware Volume-based Detector (GVD) to end-to-end encode multi-view 2D images into a 3D volume to predict voxel-wise density and color via 2D-to-3D geometric projection, trained by 3D-to-2D rendering losses with SIS pseudo labels. 3) Thirdly, for better detection results, i.e., the 3D density projected on Birds-Eye-View from GVD, we propose Vertical-aware BEV Regularization (VBR) to constraint them to be vertical like the natural pedestrian poses. Extensive experiments on popular multi-view pedestrian detection benchmarks Wildtrack, Terrace, and MultiviewX, show that our proposed UMPD approach, as the first fully-unsupervised method to our best knowledge, performs competitively to the previous state-of-the-art supervised techniques. Code will be available.

Structure maps based pedestrian detection

A Novel Approach to Design the Fast Pedestrian Detection for Video Surveillance System

A Novel Method For Real-Time Object Detection And Multiple Persons Tracking

Online Multipedestrian Tracking Based on Fused Detections of Millimeter Wave Radar and Vision

Stereo Vision Based SLAM in Outdoor Environments

Shape-based Pedestrian/Bicyclist Detection via Onboard Stereo Vision

Pedestrian detection based on modified dynamic background using gaussian mixture models and hog-svm detection

Unsupervised Multi-view Pedestrian Detection

Scene-Specific Pedestrian Detection Based on Parallel Vision

Pedestrian Detection in Complex Scene Using Full Binary Tree Classifiers Based on Locally Assembled Binary Haar-Like Features

Multi-Scale Structure Perception and Global Context-Aware Method for Small-Scale Pedestrian Detection

Pedestrian Detection Via Part-Based Topology Model

Pedestrian Detection Based on an Assembly of Sub-image Detectors

Pedestrian Detection Using a Mixture Mask Model

Vision Based Multi-pedestrian Tracking Using Adaptive Detection and Clustering.

Multi-view Pedestrian Detection Using Statistical Colour Matching

A Pedestrian-Detection Method Based on Heterogeneous Features and Ensemble of Multi-View–Pose Parts

Pedestrian detection in video of outdoor condition

Detection and Tracking of Multiple Pedestrians by Using Laser Range Scanners

Shape-based Pedestrian Detection in Infrared Images

Pedestrian Detection with Multi-View Convolution Fusion Algorithm