Fine-Grained Depth Knowledge Distillation for Cloth-Changing Person Re-identification

Yuhan Yao,Jiawei Feng,Ancong Wu,Jiangqun Ni,Wei-Shi Zheng
DOI: https://doi.org/10.1109/ijcnn60899.2024.10651453
2024-01-01
Abstract:The mission of cloth-changing person re-identification (CC-ReID) is to discover cloth-invariant and identity-related cues, while traditional person ReID methods rely on appearance features that are biased to cloth-related cues. To tackle this cloth-biased problem, many CC-ReID methods introduced auxiliary body shape information to extract cloth-invariant features, such as 2D sketch images or the 3D Skinned Multi-Person Linear (SMPL) model. However, 2D auxiliary information lacks 3D spatial features, while the 3D SMPL model encounters challenges in capturing features at a finer granularity due to manually defined parameters. To extract fine-grained 3D shape features, we estimate depth maps that contain richer shape information and propose a Fine-grained Depth feature Mining and Distillation (FDMD) framework. We introduce a depth branch and design a fine-grained local feature interaction module to mine fine-grained 3D body shape knowledge from estimated depth maps by exploring the context of semantic-aware local body-part features. To integrate cloth-invariant depth knowledge into the appearance features, the fine-grained 3D shape features are transferred to an appearance branch by feature-space-aligned distillation. Extensive experiments demonstrate that FDMD can achieve state-of-the-art performance on three widely used CC-ReID benchmarks PRCC, Celeb-reID and LaST.
What problem does this paper attempt to address?