Abstract:Occluded person re-IDentification (re-ID) is a challenging task in surveillance scenarios that remains unresolved. To address it, existing methods primarily rely on auxiliary models, e.g. pose estimation, to explore visible parts by detecting human keypoints. However, these approaches inevitably encounter two issues: domain gap and information asymmetry. The former arises from pre-training auxiliary models on different domains, while the latter indicates that the occluded query has asymmetric valid cues compared to the holistic visible gallery. In this paper, we propose a novel Precise Occlusion-aware and Feature-level Reconstruction (POFR) network for occluded re-ID. POFR addresses the occlusion issue from two viewpoints: perceiving the occlusions other than visible human bodies and reconstructing the occluded parts at the feature level. The first perspective is achieved through occlusion-driven contrastive learning (OCL). OCL incorporates an occlusion generator capable of generating object and person-specific occlusions. Unlike previous coarse occlusions, our generator leverages segmented pedestrians and obstacles to generate realistic occlusions which are then used for contrastive learning. The second perspective is implemented through an occlusion-guided feature reconstruction (OFR) module. OFR initially learns an occlusion predictor to estimate the occlusion mask, which is subsequently utilized to recover features corresponding to the occluded regions. Benefiting from the occlusion generator, the occlusion predictor can be effectively supervised with the precise occlusion masks, thereby mitigating the domain gap problem. Additionally, the recovered features alleviate information asymmetry when matching an occluded query and a holistic gallery. Extensive experiments conducted on occluded, partial, and holistic datasets demonstrate the superior performance of our POFR over state-of-the-art methods. The source code will be made publicly available upon paper acceptance.

Parallel Augmentation and Dual Enhancement for Occluded Person Re-identification.

Occluded person re-identification based on parallel triplet augmentation and parameter-free token spatial attention

Parallel Dense Vision Transformer and Augmentation Network for Occluded Person Re-identification.

Occluded Person Re-Identification with Pose Estimation Correction and Feature Reconstruction

Parallel Data Augmentation for Text-based Person Re-identification

Part-based Representation Enhancement for Occluded Person Re-identification

Dual Attention Matching Network for Context-Aware Feature Sequence based Person Re-Identification

Enhancement, integration, expansion: Activating representation of detailed features for occluded person re-identification

Augmentation to Disentangling: A Novel Approach for Improving Feature Disentanglement in Occluded Person Re-Identification

Pose-Guided Feature Alignment for Occluded Person Re-Identification

Deep Progressive Attention for Person Re-Identification

Precise Occlusion-Aware and Feature-Level Reconstruction for Occluded Person Re-Identification

Mgd: Mask Guided De-Occlusion Framework For Occluded Person Re-Identification

Part-Attention Based Model Make Occluded Person Re-Identification Stronger

Attention Disturbance and Dual-Path Constraint Network for Occluded Person Re-identification

Pose-Guided Feature Learning with Knowledge Distillation for Occluded Person Re-Identification.

Dynamic Patch-aware Enrichment Transformer for Occluded Person Re-Identification

A NEW PARADIGM FOR CROSS-MODALITY PERSON RE-IDENTIFICATION

Occlusion-Aware Feature Recover Model for Occluded Person Re-Identification

Occlude Them All: Occlusion-Aware Attention Network for Occluded Person Re-ID

DDRN:a Data Distribution Reconstruction Network for Occluded Person Re-Identification