Abstract:Person reidentification aims at matching images of the same person across disjoint camera views, which is a challenging problem in multimedia analysis, multimedia editing, and content-based media retrieval communities. The major challenge lies in how to preserve similarity of the same person across video footages with large appearance variations, while discriminating different individuals. To address this problem, conventional methods usually consider the pairwise similarity between persons by only measuring the point-to-point distance. In this paper, we propose using a deep learning technique to model a novel set-to-set (S2S) distance, in which the underline objective focuses on preserving the compactness of intraclass samples for each camera view, while maximizing the margin between the intraclass set and interclass set. The S2S distance metric consists of three terms, namely, the class-identity term, the relative distance term, and the regularization term. The class-identity term keeps the intraclass samples within each camera view gathering together, the relative distance term maximizes the distance between the intraclass class set and interclass set across different camera views, and the regularization term smoothes the parameters of the deep convolutional neural network. As a result, the final learned deep model can effectively find out the matched target to the probe object among various candidates in the video gallery by learning discriminative and stable feature representations. Using the CUHK01, CUHK03, PRID2011, and Market1501 benchmark datasets, we extensively conducted comparative evaluations to demonstrate the advantages of our method over the state-of-the-art approaches.

Guest Editorial Introduction to the Special Issue on Large Scale and Nonlinear Similarity Learning for Intelligent Video Analysis.

Guest Editorial Introduction to the Special Issue on Advanced Machine Learning Methodologies for Large-Scale Video Object Segmentation and Detection

Guest Editorial Introduction to the Special Section on Intelligent Visual Content Analysis and Understanding

Sparse Online Learning of Image Similarity

Distance Metric Learning from Uncertain Side Information with Application to Automated Photo Tagging

Guest Editorial Introduction to the Special Issue on Label-Efficient Learning on Video Data

Learning Non-Metric Partial Similarity Based on Maximal Margin Criterion

Efficient Multimedia Similarity Measurement Using Similar Elements

Effective Similarity Measurement for Video-based Person Re-identification

Guest Editorial Introduction to the Special Section on Video and Language

An Efficient Video Similarity Search Algorithm

Efficient Similarity Search by Summarization in Large Video Database

Semantic Discriminative Metric Learning for Image Similarity Measurement

Cross-Domain Visual Matching via Generalized Similarity Measure and Feature Learning

Learning Similarity Measures in Non-Orthogonal Space.

Learning Based Neural Similarity Metrics for Multimedia Data Mining.

Machine learning in intelligent video and automated monitoring.

An Efficient Similarity Search Algorithm for Web Video

Soml: Sparse Online Metric Learning with Application to Image Retrieval

Large Margin Learning in Set-to-Set Similarity Comparison for Person Reidentification.

Collaborative Similarity Metric Learning for Semantic Image Annotation and Retrieval.