FRCE: Transformer-based Feature Reconstruction and Cross-Enhancement for Occluded Person Re-Identification

Fuzeng Zhang,Hongbing Ma,Jihong Zhu,Askar Hamdulla,Bin Zhu
DOI: https://doi.org/10.1016/j.eswa.2024.125110
2024-01-01
Abstract:Occluded person re-identification (ReID) aims to capture the same person from different camera views with partial occlusion. In real-world scenarios, any object can become a random occluder, which is still an unsettled challenge for person ReID. Previous methods used auxiliary models to locate or reconstruct the occluded parts for ReID, but these methods are affected by external models or unable to model well, leaving the difficulty unresolved. Currently, Transformer has been widely applied to occluded person ReID tasks, but due to the lack of attention to local features, these methods still have limitations. Therefore, we propose a Feature Reconstruction and Cross-Enhancement (FRCE) network. Firstly, a Cross-level Feature Reconstruction Distiller (CFRD) is designed to improve the feature richness in the recognition scope and generate higher quality identity feature mapping by reconstructing the effective recognition region of the target. Secondly, we introduce a Multi-Dimensional Local Refinement (MDLR) module to deeply excavate local details in spatial and channel dimensions, seek subtle target cues and similarity relationships at local angles, and achieve more efficient ReID. Extensive experiments on five challenging occluded and holistic person ReID datasets demonstrate the effectiveness of our approach.
What problem does this paper attempt to address?