Abstract:In addition to considering the recognition difficulty caused by human posture and occlusion, it is also necessary to solve the modal differences caused by different imaging systems in the Visible-Thermal cross-modal person re-identification (VT-ReID) task. In this paper,we propose the Cross-modal Local Shortest Path and Global Enhancement (CM-LSP-GE) modules,a two-stream network based on joint learning of local and global features. The core idea of our paper is to use local feature alignment to solve occlusion problem, and to solve modal difference by strengthening global feature. Firstly, Attention-based two-stream ResNet network is designed to extract dual-modality features and map to a unified feature space. Then, to solve the cross-modal person pose and occlusion problems, the image are cut horizontally into several equal parts to obtain local features and the shortest path in local features between two graphs is used to achieve the fine-grained local feature alignment. Thirdly, a batch normalization enhancement module applies global features to enhance strategy, resulting in difference enhancement between different classes. The multi granularity loss fusion strategy further improves the performance of the algorithm. Finally, joint learning mechanism of local and global features is used to improve cross-modal person re-identification accuracy. The experimental results on two typical datasets show that our model is obviously superior to the most state-of-the-art methods. Especially, on SYSU-MM01 datasets, our model can achieve a gain of 2.89%and 7.96% in all search term of Rank-1 and mAP. The source code will be released soon.

Person Re-Identification With Patch-Based Local Sparse Matching And Metric Learning

Joining Features by Global Guidance with Bi-Relevance Trihard Loss for Person Re-Identification

Joint Uneven Channel Information Network with Blend Metric Loss for Person Re-Identification

Person Re-identification Based on Transform Algorithm

Learning Correspondence Structures for Person Re-identification

Person Re-Identification with Correspondence Structure Learning

Person Re-Identification by Spatial Pyramid Color Representation and Local Region Matching

CA-Jaccard: Camera-aware Jaccard Distance for Person Re-identification

Multi-Scale Relation Network for Person Re-identification.

Deep Multi-Patch Matching Network for Visible Thermal Person Re-Identification

Part-aware Network: a Simple but Efficient Method for Occluded Person Re-Identification

Person Re-identification by Saliency Learning

AlignedReID++: Dynamically matching local information for person re-identification

Person Re-Identification Via Person Dpm Based Partition

Nonlinear Local Metric Learning for Person Re-identification.

Integrated Metric Learning with Adaptive Constraints for Person Re-Identification

Regularized Local Metric Learning for Person Re-Identification.

Cross-modal Local Shortest Path and Global Enhancement for Visible-Thermal Person Re-Identification

Lpcv: Learning Projections From Corresponding Views For Person Re-Identification

Person Re-Identification with Joint Verification and Identification of Identity-Attribute Labels

Weakly Supervised Distribution Discrepancy Minimization Learning with State Information for Person Re-Identification