Multi-stage Feature Interaction Network for Masked Visible-thermal Person Re-identification

Fei Wu,Yang Gao,Jing Liu,Jiabin Zhang
DOI: https://doi.org/10.1109/CCDC58219.2023.10326963
2023-01-01
Abstract:Visible-thermal person re-identification (VT-ReID) aims to match person images between visible and thermal modalities. Existing methods have achieved desirable performance based on holistic person images. However, they cannot effectively cope with the information loss issue due to occlusion in the imaging process in complex scenes. In this paper, we propose a multi-stage feature interaction network (MSFIN) to learn features from the body and background regions respectively. First, a multi-stage feature fusion learning (MFL) module enhances semantic information by aggregating multi-dimensional features to mitigate adverse effect of occlusion. Second, a multi-scale attention (MSA) module is designed through receptive field scaling to effectively highlight the pixels of non-masked regions. Experiments on SYSU-MM01 and RegDB with occlusion demonstrate that our approach outperforms the state-of-the-art VT-ReID methods.
What problem does this paper attempt to address?