Robust person re-identification with wireless signals

Dong Xi,Wengang Zhou,Houqiang Li
DOI: https://doi.org/10.1109/ICME55011.2023.00308
2023-01-01
Abstract:Person re-identification (re-ID) has already attracted considerable attention. Most studies focus only on visual appearance, but the visual clue is susceptible to clothing changes, blur, occlusion, etc. The previous promising solution is to introduce data from different modalities to attenuate the impact of defects in the visual data. Some works have introduced wireless positioning to help person re-identification but have yet to explore the relationship between wireless data and visual data. To this end, we build a large synthetic wireless positioning person re-ID dataset (SWPR). With 2,000 labelled IDs captured by 24 cameras, we also collect over 32 million records of 2000 mobile trajectories in this dataset. In addition, we advocate a novel unsupervised multimodal framework (UMF). Our framework includes a multimodal information fusion strategy (MIFS) and a multimodal transformer network (MTN). Numerous experiments conducted on SWPR and WP-ReID datasets have shown the effectiveness of our approach, outperforming previous state-of-the-art methods.
What problem does this paper attempt to address?