Abstract:Video-based person re-identification (Re-ID) aims at retrieving the person through the video sequences across non-overlapping cameras. Some characteristics of pedestrians are not consecutive across frames due to the variations of viewpoints, postures, and occlusions over time. However, existing methods ignore such data peculiarity and the networks tend to only learn those salient consecutive characteristics among frames in video sequences. As a result, the learned representations fail to cover all the characteristics of pedestrians, thus lacking integrity and discrimination. To tackle this problem, we present a novel deep architecture termed Hierarchical Mining Network (HMN), which mines as many pedestrians’ characteristics by referring to the temporal and intra-class knowledge. It consists of a novel Attentive Temporal Module (ATM) and a Dynamic Supervising Branch (DSB), with a Balancing Triplet Loss (BTL) assisting the training. The proposed ATM, with pedestrian perceiving capacity, is capable of evaluating each activation of features through temporal analysis, so that the temporally scattered characteristics of pedestrians can be better aggregated and the contaminated ones can be eliminated. Then, the DSB along with the BTL further enhances the integrity of representations by multiple supervision. Specifically, the DSB perceives the diversities of intra-class samples in each mini-batch and generates targeted supervising signals for them, in which process the BTL guarantees the signals with smaller intra-class variations and larger inter-class variations. Comprehensive experiments on two video-based datasets, i.e., MARS, and DukeMTMC-VideoReID, demonstrate the contribution of each component and the superiority of the proposed HMN over the state-of-the-arts. Benchmarking our model on three popular image-based datasets, i.e., Market1501, DukeMTMC-Reid, and MSMT17 additionally verifies the promising generalizability of the proposed DSB and BTL.

HSMR: A Head-Shoulder Mask Aided ResNet to Guide Focus of Re-Identification Implemented on Tour-Guide Robot.

Learning Hierarchical and Efficient Person Re-Identification for Robotic Navigation

Joining Features by Global Guidance with Bi-Relevance Trihard Loss for Person Re-Identification

SR-VIReID: Super Resolution Assisted Visible-Infrared Person Re-Identification

Video Pedestrian Re-identification Based on Human-Machine Collaboration

DIMGNet: A Transformer-based Network for Pedestrian Reidentification with Multi-granularity Information Mutual Gain

Robust Video-Based Person Re-Identification by Hierarchical Mining

A real-time and unsupervised face Re-Identification system for Human-Robot Interaction

Person Re-Identification for Robot Person Following with Online Continual Learning

Deep High-Resolution Representation Learning for Cross-Resolution Person Re-Identification

VMRFANet:View-Specific Multi-Receptive Field Attention Network for Person Re-identification

Improving Person Re-identification by Mask Guiding and Part Pooling

Cross modality person re-identification via mask-guided dynamic dual-task collaborative learning

Multiple-local feature and attention fused person re-identification method

ResT-ReID: Transformer Block-Based Residual Learning for Person Re-Identification

MHDNet: A Multi-Scale Hybrid Deep Learning Model for Person Re-Identification

User recognition for guiding and following people with a mobile robot in a clinical environment

Hybrid-attention guided network with multiple resolution features for person re-identification

Rethinking the competition between detection and ReID in Multi-Object Tracking

Multi-Level Fusion Temporal-Spatial Co-Attention for Video-Based Person Re-Identification

Multi-scale Spatial-temporal Network for Person Re-identification