Modal-Based Feature Relation Fusion for Visible-Infrared Pedestrian Re-Identification

Shuo Wang,Chen Xue,Enwen Hu,Zhongliang Deng
DOI: https://doi.org/10.1109/csecs60003.2023.10428460
2023-01-01
Abstract:Visible-infrared pedestrian re-identification is recently the focus and difficulty in the field of pedestrian re-identification. However, Modal gap between infrared and visible cameras poses considerable difficulty in matching the features of the images. To solve the above problems, it is necessary to effectively fuse features from different modalities. We propose a feature relation fusion method for visible-infrared pedestrian re-identification across modalities (FRFM). Firstly, we fused features within a picture by calculating intra-picture feature correlation to compensate for the problem of intra-picture feature differences. At the same time, the method is proposed for same-modality feature fusion and cross-modality feature fusion, which solves the problem of excessive differences between visible and infrared features by fusing features from inter-modal and intra-modal similar images. Ultimately, the robustness and expressiveness of the system is improved. The proposed algorithm achieves state-of-the-art results: the mAP on two mainstream benchmark datasets SYSU-MM01 and RegDB are 68.09% and 88.08%, respectively. Extensive experiments demonstrate the superiority of our method.
What problem does this paper attempt to address?