Abstract:To tackle the challenge of vehicle re-identification (Re-ID) in complex lighting environments and diverse scenes, multi-spectral sources like visible and infrared information are taken into consideration due to their excellent complementary advantages. However, multi-spectral vehicle Re-ID suffers cross-modality discrepancy caused by heterogeneous properties of different modalities as well as a big challenge of the diverse appearance with different views in each identity. Meanwhile, diverse environmental interference leads to heavy sample distributional discrepancy in each modality. In this work, we propose a novel cross-directional consistency network to simultaneously overcome the discrepancies from both modality and sample aspects. In particular, we design a new cross-directional center loss to pull the modality centers of each identity close to mitigate cross-modality discrepancy, while the sample centers of each identity close to alleviate the sample discrepancy. Such strategy can generate discriminative multi-spectral feature representations for vehicle Re-ID. In addition, we design an adaptive layer normalization unit to dynamically adjust individual feature distribution to handle distributional discrepancy of intra-modality features for robust learning. To provide a comprehensive evaluation platform, we create a high-quality RGB-NIR-TIR multi-spectral vehicle Re-ID benchmark (MSVR310), including 310 different vehicles from a broad range of viewpoints, time spans and environmental complexities. Comprehensive experiments on both created and public datasets demonstrate the effectiveness of the proposed approach comparing to the state-of-the-art methods.

Multi-scale attention vehicle re-identification

Multi-View Spatial Attention Embedding for Vehicle Re-Identification

Combining Attention Mechanism and Local-Global Features Association Network for Vehicle Re-identification.

From Semantic to Spatial Awareness: Vehicle Reidentification with Multiple Attention Mechanisms

Vehicle Re-Identification Using Multi-Task Deep Learning Network and Spatio-Temporal Model.

A vehicle re-identification framework based on the improved multi-branch feature fusion network

A Dual Self-Attention Mechanism for Vehicle Re-Identification

Global attention-assisted representation learning for vehicle re-identification

Vehicle Re-identification Based on Multi-Scale Attention Feature Fusion.

Vehicle Re-Identification Based on Global Relational Attention and Multi-Granularity Feature Learning

Multi-spectral Vehicle Re-identification with Cross-directional Consistency Network and a High-quality Benchmark

Partial Attention and Multi-Attribute Learning for Vehicle Re-Identification

Coarse-to-fine Sparse Self-Attention for Vehicle Re-Identification

Multi-attention deep reinforcement learning and re-ranking for vehicle re-identification

Vehicle re-identification based on dimensional decoupling strategy and non-local relations

Multi-feature Fusion and Non-Local Operation for Vehicle Re-identification

MULTI-ATTRIBUTE DRIVEN VEHICLE RE-IDENTIFICATION WITH SPATIAL-TEMPORAL RE-RANKING

Exploring Multi-loss Function Based Attention Framework for Vehicle Re-Identification

SCAN: Spatial and Channel Attention Network for Vehicle Re-Identification

Dual-relational Attention Network for Vehicle Re-Identification.

Multi-Spectral Vehicle Re-Identification: A Challenge.