Abstract:Recent development in computing power has resulted in performance improvements on holistic(none-occluded) person Re-Identification (ReID) tasks. Nevertheless, the precision of the recent research will diminish when a pedestrian is obstructed by obstacles. Within the realm of 2D space, the loss of information from obstructed objects continues to pose significant challenges in the context of person ReID. Person is a 3D non-grid object, and thus semantic representation learning in only 2D space limits the understanding of occluded person. In the present work, we propose a network based on 3D multi-view learning, allowing it to acquire geometric and shape details of an occluded pedestrian from 3D space. Simultaneously, it capitalizes on advancements in 2D-based networks to extract semantic representations from 3D multi-views. Specifically, the surface random selection strategy is proposed to convert images of 2D RGB into 3D multi-views. Using this strategy, we build four extensive 3D multi-view data collections for person ReID. After that, Pedestrian 3D Shape Understanding for Person Re-Identification via Multi-View Learning(MV-3DSReID), is proposed for identifying the person by learning person geometry and structure representation from the groups of multi-view images. In comparison to alternative data formats (e.g., 2D RGB, 3D point cloud), multi-view images complement each other’s detailed features of the 3D object by adjusting rendering viewpoints, thus facilitating a more comprehensive understanding of the person for both holistic and occluded ReID situations. Experiments on occluded and holistic ReID tasks demonstrate performance levels comparable to state-of-the-art methods, validating the effectiveness of our proposed approach in tackling challenges related to occlusion. The code is available at https://github.com/hangjiaqi1/MV-TransReID.

Multi-View Pedestrian Recognition Using Shared Dictionary Learning with Group Sparsity

Cross-view Gait Recognition Through Ensemble Learning

A Deep Top-Down Framework Towards Generalisable Multi-View Pedestrian Detection

Multi-view gait recognition with incomplete training data

Pedestrian 3D Shape Understanding for Person Re-Identification via Multi-View Learning

Pedestrian Detection with Multi-View Convolution Fusion Algorithm

Unsupervised Multi-view Pedestrian Detection

Multi-person Multi-Camera Tracking for Live Stream Videos Based on Improved Motion Model and Matching Cascade

Pedestrian Recognition in Multi-Camera Networks Using Multilevel Important Salient Feature and Multicategory Incremental Learning.

Vision Based Multi-pedestrian Tracking Using Adaptive Detection and Clustering.

Multi-view and Multi-Plane Data Fusion for Effective Pedestrian Detection in Intelligent Visual Surveillance

Multi-Stream Representation Learning for Pedestrian Trajectory Prediction

3D Random Occlusion and Multi-Layer Projection for Deep Multi-Camera Pedestrian Localization

A Pedestrian-Detection Method Based on Heterogeneous Features and Ensemble of Multi-View–Pose Parts

Near-Online Multi-Pedestrian Tracking via Combining Multiple Consistent Appearance Cues

An End-to-end Tracking Framework Via Multi-View and Temporal Feature Aggregation

Robust Multiple Cameras Pedestrian Detection with Multi-View Bayesian Network.

Multi-Relational Pedestrian Trajectory Prediction in Complex Scenes.

Multi-view Visual Surveillance and Phantom Removal for Effective Pedestrian Detection.

Hierarchical Multi-Supervision Multi-Interaction Graph Attention Network for Multi-Camera Pedestrian Trajectory Prediction

Set-to-set gait recognition across varying views and walking conditions