Abstract:Image-to-video person re-identification aims to retrieve the same pedestrian as the image-based query from a video-based gallery set. Existing methods treat it as a cross-modality retrieval task and learn the common latent embeddings from image and video modalities, which are both less effective and efficient due to large modality gap and redundant feature learning by utilizing all video frames. In this work, we first regard this task as point-to-set matching problem identical to human decision process, and propose a novel Temporal Complementarity-Guided Reinforcement Learning (TCRL) approach for image-to-video person re-identification. TCRL employs deep reinforcement learning to make sequential judgments on dynamically selecting suitable amount of frames from gallery videos, and accumulate adequate temporal complementary information among these frames by the guidance of the query image, towards balancing efficiency and accuracy. Specifically, TCRL formulates point-to-set matching procedure as Markov decision process, where a sequential judgement agent measures the uncertainty between the query image and all historical frames at each time step, and verifies that sufficient complementary clues are accumulated for judgment (same or different) or one more frames are requested to assist judgment. Moreover, TCRL maintains a sequential feature extraction module with complementary residual detectors to dynamically suppress redundant salient regions and thoroughly mine diverse complementary clues among these selected frames for enhancing frame-level representation. Extensive experiments demonstrate the superiority of our method.

Joint Temporal-Spatial Information and Common Network Consistency Constraint for Person Re-identification.

Reranking Optimization for Person Re-Identification under Temporal-Spatial Information and Common Network Consistency Constraints

Joining Features by Global Guidance with Bi-Relevance Trihard Loss for Person Re-Identification

Joint Uneven Channel Information Network with Blend Metric Loss for Person Re-Identification

Deep Siamese Network with Multi-level Similarity Perception for Person Re-identification

Contribution-Based Multi-Stream Feature Distance Fusion Method with ${k}$ -Distribution Re-Ranking for Person Re-Identification

Temporal Complementarity-Guided Reinforcement Learning for Image-to-Video Person Re-Identification

Spatial-Temporal Correlation and Topology Learning for Person Re-Identification in Videos

Spatial-Temporal Person Re-Identification

Dual Attention Matching Network for Context-Aware Feature Sequence based Person Re-Identification

Uncertainty-guided Joint Attention and Contextual Relation Network for Person Re-Identification

Consistent-Aware Deep Learning For Person Re-Identification In A Camera Network

Internal and External Spatial–temporal Constraints for Person Reidentification

Joint Cross-Consistency Learning and Multi-Feature Fusion for Person Re-Identification

Jointly Attentive Spatial-Temporal Pooling Networks for Video-based Person Re-Identification.

Unified Framework For Joint Attribute Classification And Person Re-Identification

Joint Attention Mechanism for Person Re-Identification

Learning Correspondence Structures for Person Re-identification

Joint Bilateral-Resolution Identity Modeling for Cross-Resolution Person Re-Identification

Joint Instance And Feature Importance Re-Weighting For Person Reidentification