Revisiting the Role of Texture in 3D Person Re-identification

Huy Nguyen,Kien Nguyen,Akila Pemasiri,Sridha Sridharan,Clinton Fookes
2024-10-01
Abstract:This study introduces a new framework for 3D person re-identification (re-ID) that leverages readily available high-resolution texture data in 3D reconstruction to improve the performance and explainability of the person re-ID task. We propose a method to emphasize texture in 3D person re-ID models by incorporating UVTexture mapping, which better differentiates human subjects. Our approach uniquely combines UVTexture and its heatmaps with 3D models to visualize and explain the person re-ID process. In particular, the visualization and explanation are achieved through activation maps and attribute-based attention maps, which highlight the important regions and features contributing to the person re-ID decision. Our contributions include: (1) a novel technique for emphasizing texture in 3D models using UVTexture processing, (2) an innovative method for explicating person re-ID matches through a combination of 3D models and UVTexture mapping, and (3) achieving state-of-the-art performance in 3D person re-ID. We ensure the reproducibility of our results by making all data, codes, and models publicly available.
Computer Vision and Pattern Recognition
What problem does this paper attempt to address?
### Problems the Paper Aims to Solve This paper aims to address several key issues in 3D person re-identification (3D person re-ID): 1. **Performance Improvement**: Existing 3D person re-identification methods still lag behind 2D methods in terms of performance. The paper proposes a new framework that improves the performance of 3D person re-identification by utilizing high-resolution texture data. 2. **Interpretability**: Existing 3D person re-identification methods lack interpretability, meaning it is difficult to understand how the model makes decisions. The paper proposes new methods to visualize and interpret the process of person re-identification by combining UV texture mapping and 3D models. 3. **Utilization of Texture Details**: Existing 3D person re-identification methods fail to fully utilize the texture information in 3D models. The paper proposes a new technique that emphasizes texture details in 3D models through UV texture processing, thereby improving the accuracy and reliability of feature extraction. Specifically, the main contributions of the paper include: - Proposing a new technique to emphasize texture details in 3D models through UV texture processing. - Innovatively combining 3D models and UV texture mapping to visualize and interpret the matching process of person re-identification. - Achieving state-of-the-art performance in 3D person re-identification tasks. - Ensuring the reproducibility of results, with all data, code, and models to be publicly released. Through these contributions, the paper not only surpasses 2D methods in 3D person re-identification performance for the first time but also introduces interpretability, paving the way for more reliable and interpretable person re-identification systems.