Abstract:Occluded person re-identification is a challenging problem due to the destruction of occluders in different camera views. Most existing paradigms focus on visible human body parts through some external models to reduce noise interference. However, the feature misalignment problem caused by discarded occlusions negatively affects the performance of the network. Different from most previous works that discard the occluded regions, we present Feature Completion Transformer (FCFormer) that reduces noise interference and complements missing features in occluded parts. Specifically, Occlusion Instance Augmentation is proposed to simulate real and diverse occlusion situations on the holistic image, which enlarges the occlusion samples in the training set and forms aligned occluded-holistic pairs. To reduce the interference of noise, a two-stream architecture is proposed to learn pairwise discriminative features from aligned image pairs, while obtaining self-aligned occluded-holistic feature level sample-label pairs without additional auxiliary models. To complement the features of occluded regions, a Feature Completion Decoder is designed to aggregate possible information from self-generated occluded features in a self-supervised manner. Further, in order to correlate the completion features with identity information, Feature Completion Consistency loss is introduced to enforce the distribution of the generated completion features to be consistent with the real holistic feature distribution. In addition, we propose the Cross Hard Triplet loss to further bridge the gap between completion features and extracting features under the same ID. Extensive experiments over five challenging datasets demonstrate that the proposed FCFormer achieves superior performance and outperforms the state-of-theart methods by significant margins on Occluded-Duke dataset.

Large Occluded Human Image Completion Via Image-Prior Cooperating

Deep Portrait Image Completion and Extrapolation

Automatic and accurate image completion from a large displacement view

Feature Completion Transformer for Occluded Person Re-identification

Identity Preserving Face Completion for Large Ocular Region Occlusion

Object-Occluded Human Shape and Pose Estimation with Probabilistic Latent Consistency

Data-driven Image Completion for Complex Objects

See Through Occlusions: Detailed Human Shape Estimation from A Single Image with Occlusions.

Object-Occluded Human Shape and Pose Estimation From a Single Color Image

Image Completion Based on Creative Design of Massive Images

Bridging Global Context Interactions for High-Fidelity Image Completion

Removal and Recovery of the Human Invisible Region

Multi-person Pose Estimation with Object Occlusion Information

Large Scale Image Completion via Co-Modulated Generative Adversarial Networks

Instance-Aware Image Completion

Co-Completion for Occluded Facial Expression Recognition

Faithful Face Image Completion for HMD Occlusion Removal

A comprehensive framework for occluded human pose estimation

2D Pose-guided Complete Silhouette Estimation of Human Body in Occlusion

Learning Disentangling and Fusing Networks for Face Completion Under Structured Occlusions

Occluded Person Retrieval with Hierarchical Feature Optimization