Abstract:Person reidentification aims at matching images of the same person across disjoint camera views, which is a challenging problem in multimedia analysis, multimedia editing, and content-based media retrieval communities. The major challenge lies in how to preserve similarity of the same person across video footages with large appearance variations, while discriminating different individuals. To address this problem, conventional methods usually consider the pairwise similarity between persons by only measuring the point-to-point distance. In this paper, we propose using a deep learning technique to model a novel set-to-set (S2S) distance, in which the underline objective focuses on preserving the compactness of intraclass samples for each camera view, while maximizing the margin between the intraclass set and interclass set. The S2S distance metric consists of three terms, namely, the class-identity term, the relative distance term, and the regularization term. The class-identity term keeps the intraclass samples within each camera view gathering together, the relative distance term maximizes the distance between the intraclass class set and interclass set across different camera views, and the regularization term smoothes the parameters of the deep convolutional neural network. As a result, the final learned deep model can effectively find out the matched target to the probe object among various candidates in the video gallery by learning discriminative and stable feature representations. Using the CUHK01, CUHK03, PRID2011, and Market1501 benchmark datasets, we extensively conducted comparative evaluations to demonstrate the advantages of our method over the state-of-the-art approaches.

Effective Similarity Measurement for Video-based Person Re-identification

Shift-variant Similarity Learning for Person Re-identification

Spatial and Temporal Mutual Promotion for Video-Based Person Re-Identification.

People Re-Identification with Local Distance Comparison Using Learned Metric.

Video-based Person Re-identification Based on Feature Learning of Valid Regions and Distance Fusion

Deep Recurrent Convolutional Networks for Video-based Person Re-identification: An End-to-End Approach

Similarity Learning With Spatial Constraints For Person Re-Identification

Temporal Complementarity-Guided Reinforcement Learning for Image-to-Video Person Re-Identification

Deep Feature Learning with Relative Distance Comparison for Person Re-Identification.

Discriminative feature extraction for video person re-identification via multi-task network

Orientation-Guided Similarity Learning For Person Re-Identification

Spatial-Temporal Correlation and Topology Learning for Person Re-Identification in Videos

Person Re-Identification By Video Ranking

Hierarchical Temporal Modeling With Mutual Distance Matching for Video Based Person Re-Identification

Large Margin Learning in Set-to-Set Similarity Comparison for Person Reidentification.

Person Re-Identification by Unsupervised Video Matching.

Person Re-Identification with Weighted Spatial-Temporal Features

Efficient Lightweight Video Person Re-Identification with Online Difference Discrimination Module

Spatial-Temporal Synergic Residual Learning for Video Person Re-Identification.

Deep Similarity Feature Learning for Person Re-identification.

Learning Intra-Video Difference for Person Re-Identification