Abstract:Person retrieval largely relies on the appearance features of pedestrians. This task is rather more difficult in surveillance videos due to the limitations of extracting robust appearance features brought by the cross-view and cross-camera data with lower image resolution, motion blur, occlusion and other kinds of image degradation. To build up a more reliable person retrieval system, recent works introduced appearance attribute models to describe and distinguish different persons with high-level semantic concepts. Despite the progress of previous works, the value of utilizing appearance attributes is still under-explored. On one hand, existing methods lack for concise and precise attribute representations that are specific for each attribute category and, in the meantime, are able to filter noisy information in irrelevant spatial locations and useless patterns. On the other hand, correlation and reasoning between different attributes are neglected, which could generate more useful information and add more robustness to the retrieval system. In this paper, we propose an Attribute Mining and Reasoning (AMR) framework which is capable to handle the issues in question. The AMR makes better use of appearance attributes with two main components. First, the AMR disentangles the representations of different attributes by localizing their spatial positions and identifying their effective patterns in a weakly supervised manner. To achieve more reliable localization, we propose the Attribute Localization Ensemble (ALE) module that is consisted of multiple localization heads and a voting mechanism. Second, we introduce the Attribute Reasoning (AR) module to correlate different attributes together with the global appearance features and discover their latent relations to generate more comprehensive descriptions of pedestrians. Extensive experiments on DukeMTMC-ReID and Market-1501 datasets demonstrate the effectiveness of the proposed AMR framework as well as its superiority o-er the existing state-of-the-art methods. The AMR model also shows great generalization ability on the unseen CUHK03 dataset when it is only trained on Market-1501 dataset.

RGB-D based multi-attribute people search in intelligent visual surveillance

Contribution-Based Multi-Stream Feature Distance Fusion Method with ${k}$ -Distribution Re-Ranking for Person Re-Identification

Unconstrained Face Detection and Recognition Based on Rgb-D Camera for the Visually Impaired

Contribution-Based Multi-Stream Feature Distance Fusion Method With <inline-formula> <tex-math notation="LaTeX">${k}$ </tex-math></inline-formula>-Distribution Re-Ranking for Person Re-Identification

Human Detection Based on Head and Shoulder Feature in Intelligent Surveillance System

A Novel Method For Real-Time Object Detection And Multiple Persons Tracking

Detecting and tracking people in real time with RGB-D camera

RGB-IR Person Re-identification by Cross-Modality Similarity Preservation

Person Retrieval in Surveillance Videos Via Deep Attribute Mining and Reasoning

Multi-camera Handoff for Person Re-Identification

A Comprehensive Study on Large-Scale Person Retrieval in Real Surveillance Scenarios

Pedestrian Attribute Recognition Via Spatio-temporal Relationship Learning for Visual Surveillance

A cross-view intelligent person search method based on multi-feature constraints

Multi-person Multi-Camera Tracking for Live Stream Videos Based on Improved Motion Model and Matching Cascade

Describing Human Identity Using Attributes.

Multi-Object Tracking Algorithm for RGB-D Images Based on Asymmetric Dual Siamese Networks

Real-time human detection and tracking in complex environments using single RGBD camera

Semantic-based surveillance video retrieval

RGB-D Human Identification and Tracking in a Smart Environment

Person Re-identification Based on Body Segmentation.

Human Instance Segmentation and Tracking via Data Association and Single-stage Detector