Multi-view Geometry Distillation for Cloth-Changing Person ReID.

Hanlei Yu,Bin Liu,Yan Lu,Qi Chu,Nenghai Yu
DOI: https://doi.org/10.1007/978-3-031-18907-4_3
2022-01-01
Abstract:Most person re-identification (ReID) methods aim at retrieving people with unchanged clothes. Meanwhile, fewer studies work on the cloth-inconsistency problem, which is more challenging but useful in the real intelligent surveillance scenario. We propose a novel method, named Multi-View Geometry Distillation (MVGD), taking advantage of 3D priors to explore cloth-unrelated multi-view human information. Specifically, a 3D Grouping Geometry Graph Convolution Network (3DG 3 ) is proposed to extract ReID-specific geometry representation from the 3D reconstructed body mesh, which encodes shape, pose, and other geometry patterns from the 3D perspective. Then, we design a 3D-Guided Appearance Learning scheme to extract more accurate part features. Furthermore, we also adopt a Multi-View Interactive Learning module (MVIL) to fuse the different types of features together and extract high-level multi-view geometry representation. Finally, these discriminative features are treated as the teacher to guide the backbone by the distillation mechanism for better representations. Extensive experiments on three popular cloth-changing ReID datasets demonstrate the effectiveness of our method. The proposed method brings 9 % and 7.5 % gains in average in terms of rank-1 and mAP metrics against the baseline, respectively.
What problem does this paper attempt to address?