Abstract:Cloth-changing person re-identification (ReID) is a newly emerging research topic that aims to retrieve pedestrians whose clothes are changed. Since the human appearance with different clothes exhibits large variations, it is very difficult for existing approaches to extract discriminative and robust feature representations. Current works mainly focus on body shape or contour sketches, but the human semantic information and the potential consistency of pedestrian features before and after changing clothes are not fully explored or are ignored. To solve these issues, in this work, a novel semantic-aware attention and visual shielding network for cloth-changing person ReID (abbreviated as SAVS) is proposed where the key idea is to shield clues related to the appearance of clothes and only focus on visual semantic information that is not sensitive to view/posture changes. Specifically, a visual semantic encoder is first employed to locate the human body and clothing regions based on human semantic segmentation information. Then, a human semantic attention (HSA) module is proposed to highlight the human semantic information and reweight the visual feature map. In addition, a visual clothes shielding (VCS) module is also designed to extract a more robust feature representation for the cloth-changing task by covering the clothing regions and focusing the model on the visual semantic information unrelated to the clothes. Most importantly, these two modules are jointly explored in an end-to-end unified framework. Extensive experiments demonstrate that the proposed method can significantly outperform state-of-the-art methods, and more robust features can be extracted for cloth-changing persons. Compared with multibiometric unified network (MBUNet) (published in TIP2023), this method can achieve improvements of 17.5% (30.9%) and 8.5% (10.4%) on the LTCC and Celeb-reID datasets in terms of mean average precision (mAP) (rank-1), respectively. When compared with the Swin Transformer (Swin-T), the improvements can reach 28.6% (17.3%), 22.5% (10.0%), 19.5% (10.2%), and 8.6% (10.1%) on the PRCC, LTCC, Celeb, and NKUP datasets in terms of rank-1 (mAP), respectively.

S<SUP>2</SUP>-Net:Semantic and Saliency Attention Network for Person Re-Identification

S$^{2}$-Net:Semantic and Saliency Attention Network for Person Re-Identification.

S<inline-formula><tex-math notation="LaTeX">$^{2}$</tex-math></inline-formula>-Net:Semantic and Saliency Attention Network for Person Re-Identification

A Novel Two-Stream Saliency Image Fusion CNN Architecture for Person Re-Identification

Deep Siamese Network with Multi-level Similarity Perception for Person Re-identification

Improving the Accuracy of Person Re- Identification by Mining Semantic Features and Applying New Attention Mechanism

Dual Attention Matching Network for Context-Aware Feature Sequence based Person Re-Identification

An Efficient Multi-Branch Attention Network for Person Re-Identification

Curriculum Enhanced Supervised Attention Network for Person Re-Identification

Dual Branch Attention Network for Person Re-Identification

Semantic-Aware Occlusion-Robust Network for Occluded Person Re-Identification

Person Re-identification Algorithm Based on Spatial Attention Network

Spatial Adaptive Cooperative Graph Convolution Attention for Person Re-Identification

A part-based attention network for person re-identification

A Supervisory Mask Attentional Network for Person Re-Identification in Uniform Dress Scenes.

A Semantic-aware Attention and Visual Shielding Network for Cloth-changing Person Re-identification.

Semantically enhanced attention map‐driven occluded person re‐identification

MIX-Net: Hybrid Attention/Diversity Network for Person Re-Identification

Semantics-Aligned Representation Learning for Person Re-Identification

Salience-Guided Cascaded Suppression Network for Person Re-identification

An Enhanced Siamese Angular Softmax Network with Dual Joint-Attention for Person Re-Identification.