Abstract:Person re-identification (re-id), the process of matching pedestrian images across different camera views, is an important task in visual surveillance. Substantial development of re-id has recently been observed, and the majority of existing models are largely dependent on color appearance and assume that pedestrians do not change their clothes across camera views. This limitation, however, can be an issue for re-id when tracking a person at different places and at different time if that person (e.g., a criminal suspect) changes his/her clothes, causing most existing methods to fail, since they are heavily relying on color appearance, and thus, they are inclined to match a person to another person wearing similar clothes. In this work, we call the person re-id under clothing change the "cross-clothes person re-id." In particular, we consider the case when a person only changes his clothes moderately as a first attempt at solving this problem based on visible light images; that is, we assume that a person wears clothes of a similar thickness, and thus the shape of a person would not change significantly when the weather does not change substantially within a short period of time. We perform cross-clothes person re-id based on a contour sketch of person image to take advantage of the shape of the human body instead of color information for extracting features that are robust to moderate clothing change. To select/sample more reliable and discriminative curve patterns on a body contour sketch, we introduce a learning-based spatial polar transformation (SPT) layer in the deep neural network to transform contour sketch images for extracting reliable and discriminant convolutional neural network (CNN) features in a polar coordinate space. An angle-specific extractor (ASE) is applied in the following layers to extract more fine-grained discriminant angle-specific features. By varying the sampling range of the SPT, we develop a multistream network for aggregating multi-granularity features to better identify a person. Due to the lack of a large-scale dataset for cross-clothes person re-id, we contribute a new dataset that consists of 33,698 images from 221 identities. Our experiments illustrate the challenges of cross-clothes person re-id and demonstrate the effectiveness of our proposed method.

Person Re-Identification by Spatial Pyramid Color Representation and Local Region Matching

Person Re-identification Based on Transform Algorithm

Joining Features by Global Guidance with Bi-Relevance Trihard Loss for Person Re-Identification

Learning Invariant Color Features for Person Re-Identification

A person re-identification algorithm based on pyramid color topology feature

Person Re-identification Based on Color Histogram and Spatial Configuration of Dominant Color Regions

Person Re-Identification Based on Visual Saliency

Fast Low Rank Representation Based Spatial Pyramid Matching for Image Classification.

Evaluation of Color Spaces for Person Re-Identification

Discriminative Spatial Feature Learning for Person Re-Identification

Multi-Scale Cascading Network with Compact Feature Learning for RGB-Infrared Person Re-Identification.

Person Re-identification by Saliency Learning

Color Based Pre-Rank Categorization for Person Re-Identification

Multi-camera Handoff for Person Re-Identification

Person Re-Identification by Contour Sketch Under Moderate Clothing Change

Spatial-Temporal Person Re-Identification

Learning Correspondence Structures for Person Re-identification

Body-Structure Based Feature Representation For Person Re-Identification

Person Re-identification via Attention Pyramid

Person Re-Identification As Image Retrieval Using Bag of Ensemble Colors

Lpcv: Learning Projections From Corresponding Views For Person Re-Identification