Abstract:We focus on the occlusion problem in person re-identification (re-id), which is one of the main challenges in real-world person retrieval scenarios. Previous methods on the occluded re-id problem usually assume that only the probes are occluded, thereby removing occlusions by manually cropping. However, this may not always hold in practice. This article relaxes this assumption and investigates a more general occlusion problem, where both the probe and gallery images could be occluded. The key to this challenging problem is depressing the noise information by identifying bodies and occlusions. We propose to incorporate the pose information into the re-id framework, which benefits the model in three aspects. First, it provides the location of the body. We then design a Pose-Masked Feature Branch to make our model focus on the body region only and filter those noise features brought by occlusions. Second, the estimated pose reveals which body parts are visible, giving us a hint to construct more informative person features. We propose a Pose-Embedded Feature Branch to adaptively re-calibrate channel-wise feature responses based on the visible body parts. Third, in testing, the estimated pose indicates which regions are informative and reliable for both probe and gallery images. Then we explicitly split the extracted spatial feature into parts. Only part features from those commonly visible parts are utilized in the retrieval. To better evaluate the performances of the occluded re-id, we also propose a large-scale data set for the occluded re-id with more than 35 000 images, namely Occluded-DukeMTMC. Extensive experiments show our approach surpasses previous methods on the occluded, partial, and non-occluded re-id data sets.

Spatial-wise and channel-wise feature uncertainty for occluded person re-identification

Identifying Visible Parts via Pose Estimation for Occluded Person Re-Identification

Focus on the Visible Regions: Semantic-Guided Alignment Model for Occluded Person Re-Identification.

Pose-Guided Feature Alignment for Occluded Person Re-Identification

Adaptive Deep Metric Embeddings for Person Re-Identification under Occlusions

Pose-Guided Feature Learning with Knowledge Distillation for Occluded Person Re-Identification.

Deep Learning-Based Occluded Person Re-Identification: A Survey

Part-aware Network: a Simple but Efficient Method for Occluded Person Re-Identification

DDRN:a Data Distribution Reconstruction Network for Occluded Person Re-Identification

Interesting Receptive Region and Feature Excitation for Partial Person Re-identification

Dynamic Feature Pruning and Consolidation for Occluded Person Re-Identification

Semantic-Aware Occlusion-Robust Network for Occluded Person Re-Identification

Feature Completion for Occluded Person Re-Identification

Occluded Person Re-Identification with Single-scale Global Representations

Part-Attention Based Model Make Occluded Person Re-Identification Stronger

Occluded Visible-Infrared Person Re-Identification

Enhancement, integration, expansion: Activating representation of detailed features for occluded person re-identification

Learning transformer-based attention region with multiple scales for occluded person re-identification

Self-paced uncertainty estimation for one-shot person re-identification

A Deep Hierarchical Feature Sparse Framework for Occluded Person Re-Identification

Multi-view Information Integration and Propagation for Occluded Person Re-identification