Abstract:Person retrieval largely relies on the appearance features of pedestrians. This task is rather more difficult in surveillance videos due to the limitations of extracting robust appearance features brought by the cross-view and cross-camera data with lower image resolution, motion blur, occlusion and other kinds of image degradation. To build up a more reliable person retrieval system, recent works introduced appearance attribute models to describe and distinguish different persons with high-level semantic concepts. Despite the progress of previous works, the value of utilizing appearance attributes is still under-explored. On one hand, existing methods lack for concise and precise attribute representations that are specific for each attribute category and, in the meantime, are able to filter noisy information in irrelevant spatial locations and useless patterns. On the other hand, correlation and reasoning between different attributes are neglected, which could generate more useful information and add more robustness to the retrieval system. In this paper, we propose an Attribute Mining and Reasoning (AMR) framework which is capable to handle the issues in question. The AMR makes better use of appearance attributes with two main components. First, the AMR disentangles the representations of different attributes by localizing their spatial positions and identifying their effective patterns in a weakly supervised manner. To achieve more reliable localization, we propose the Attribute Localization Ensemble (ALE) module that is consisted of multiple localization heads and a voting mechanism. Second, we introduce the Attribute Reasoning (AR) module to correlate different attributes together with the global appearance features and discover their latent relations to generate more comprehensive descriptions of pedestrians. Extensive experiments on DukeMTMC-ReID and Market-1501 datasets demonstrate the effectiveness of the proposed AMR framework as well as its superiority o-er the existing state-of-the-art methods. The AMR model also shows great generalization ability on the unseen CUHK03 dataset when it is only trained on Market-1501 dataset.

Instance Retrieval at Fine-grained Level Using Multi-Attribute Recognition

Learning Feature Embedding with Strong Neural Activations for Fine-Grained Retrieval

Fine-grained Apparel Classification and Retrieval without rich annotations

Cross-domain Image Retrieval with a Dual Attribute-aware Ranking Network

MMFL-Net: Multi-scale and Multi-granularity Feature Learning for Cross-domain Fashion Retrieval

FashionSearchNet-v2: Learning Attribute Representations with Localization for Image Retrieval with Attribute Manipulation

Generic Instance Search and Re-identification from One Example via Attributes and Categories

Cross-Domain Shoe Retrieval with a Semantic Hierarchy of Attribute Classification Network.

Cross-domain Shoe Retrieval Using a Three-Level Deep Feature Representation

Fashionpedia: Ontology, Segmentation, and an Attribute Localization Dataset

DeepShoe: an Improved Multi-Task View-invariant CNN for Street-to-shop Shoe Retrieval.

Snap and Find: Deep Discrete Cross-domain Garment Image Retrieval

A Deep-Learning-Based Fashion Attributes Detection Model

Coarse-to-Fine: Learning Compact Discriminative Representation for Single-Stage Image Retrieval

Multi-Task Curriculum Transfer Deep Learning of Clothing Attributes

Attribute-Guided Multi-Level Attention Network for Fine-Grained Fashion Retrieval

Cross-Modal and Multi-Attribute Face Recognition: A Benchmark

Person Retrieval in Surveillance Videos Via Deep Attribute Mining and Reasoning

From Region to Patch: Attribute-Aware Foreground-Background Contrastive Learning for Fine-Grained Fashion Retrieval

Fashion Analysis With A Subordinate Attribute Classification Network

Multi-Attribute Enhancement Network for Person Search