Abstract:Image-to-video person re-identification aims to retrieve the same pedestrian as the image-based query from a video-based gallery set. Existing methods treat it as a cross-modality retrieval task and learn the common latent embeddings from image and video modalities, which are both less effective and efficient due to large modality gap and redundant feature learning by utilizing all video frames. In this work, we first regard this task as point-to-set matching problem identical to human decision process, and propose a novel Temporal Complementarity-Guided Reinforcement Learning (TCRL) approach for image-to-video person re-identification. TCRL employs deep reinforcement learning to make sequential judgments on dynamically selecting suitable amount of frames from gallery videos, and accumulate adequate temporal complementary information among these frames by the guidance of the query image, towards balancing efficiency and accuracy. Specifically, TCRL formulates point-to-set matching procedure as Markov decision process, where a sequential judgement agent measures the uncertainty between the query image and all historical frames at each time step, and verifies that sufficient complementary clues are accumulated for judgment (same or different) or one more frames are requested to assist judgment. Moreover, TCRL maintains a sequential feature extraction module with complementary residual detectors to dynamically suppress redundant salient regions and thoroughly mine diverse complementary clues among these selected frames for enhancing frame-level representation. Extensive experiments demonstrate the superiority of our method.

Learning Bidirectional Temporal Cues for Video-Based Person Re-Identification.

Joining Features by Global Guidance with Bi-Relevance Trihard Loss for Person Re-Identification

See The Forest For The Trees: Joint Spatial And Temporal Recurrent Neural Networks For Video-Based Person Re-Identification

Deep Recurrent Convolutional Networks for Video-based Person Re-identification: An End-to-End Approach

Deep Spatial-Temporal Fusion Network for Video-Based Person Re-identification.

Hierarchical Integration of Rich Features for Video-Based Person Re-Identification.

Spatial-Temporal Correlation and Topology Learning for Person Re-Identification in Videos

Video Person Re-Identification by Temporal Residual Learning

An Unbiased Temporal Representation for Video-Based Person Re-Identification

Convolutional LSTM networks for video-based person re-identification

Temporal Complementarity-Guided Reinforcement Learning for Image-to-Video Person Re-Identification

Recurrent Deep Attention Network for Person Re-Identification.

Multi-stage Deep Convolutional Learning for People Re-Identification

BiCnet-TKS: Learning Efficient Spatial-Temporal Representation for Video Person Re-Identification

Dual Attention Matching Network for Context-Aware Feature Sequence based Person Re-Identification

Video-based Person Re-Identification Via Spatio-Temporal Attentional and Two-Stream Fusion Convolutional Networks

Spatial-Temporal Synergic Residual Learning for Video Person Re-Identification.

Learning Compact Appearance Representation for Video-Based Person Re-Identification

AA-RGTCN: Reciprocal Global Temporal Convolution Network with Adaptive Alignment for Video-Based Person Re-Identification

Multi-Scale Temporal Cues Learning for Video Person Re-Identification

Learning View-Specific Deep Networks for Person Re-Identification.