Abstract:Person re-identification (Re-ID) has been promoted by the significant success of convolutional neural networks (CNNs). However, the application of such CNN-based Re-ID methods depends on the tremendous consumption of computation and memory resources, which affects its development on resource-limited devices such as next generation AI chips. As a result, CNN binarization has attracted increasing attention, which leads to binary neural networks (BNNs). In this article, we propose a new BNN-based framework for efficient person Re-ID (BiRe-ID). In this work, we discover that the significant performance drop of binarized models for Re-ID task is caused by the degraded representation capacity of kernels and features. To address the issues, we propose the kernel and feature refinement based on generative adversarial learning (KR-GAL and FR-GAL) to enhance the representation capacity of BNNs. We first introduce an adversarial attention mechanism to refine the binarized kernels based on their real-valued counterparts. Specifically, we introduce a scale factor to restore the scale of 1-bit convolution. And we employ an effective generative adversarial learning method to train the attention-aware scale factor. Furthermore, we introduce a self-supervised generative adversarial network to refine the low-level features using the corresponding high-level semantic information. Extensive experiments demonstrate that our BiRe-ID can be effectively implemented on various mainstream backbones for the Re-ID task. In terms of the performance, our BiRe-ID surpasses existing binarization methods by significant margins, at the level even comparable with the real-valued counterparts. For example, on Market-1501, BiRe-ID achieves 64.0% mAP on ResNet-18 backbone, with an impressive 12.51× speedup in theory and 11.75× storage saving. In particular, the KR-GAL and FR-GAL methods show strong generalization on multiple tasks such as Re-ID, image classification, object detection, and 3D point cloud processing.

Adversarial Binary Coding for Efficient Person Re-Identification

Deep Siamese Network with Multi-level Similarity Perception for Person Re-identification

Joint Uneven Channel Information Network with Blend Metric Loss for Person Re-Identification

Joining Features by Global Guidance with Bi-Relevance Trihard Loss for Person Re-Identification

HashReID: Dynamic Network with Binary Codes for Efficient Person Re-identification

BiRe-ID: Binary Neural Network for Efficient Person Re-ID

Rapid Person Re-Identification via Sub-space Consistency Regularization

Self-Guided Hash Coding for Large-Scale Person Re-identification

Asymmetric Deep Hashing for Person Re-Identifications

Weighted Bilinear Coding over Salient Body Parts for Person Re-Identification

MEIAH: Mixing Explicit and Implicit Formulation of Attributes in Binary Representation for Person Re-Identification.

Dual Attention Matching Network for Context-Aware Feature Sequence based Person Re-Identification

RGB-IR Person Re-identification by Cross-Modality Similarity Preservation

Weight-based Sparse Coding for Multi-Shot Person Re-Identification

Adversarial Disentanglement and Correlation Network for Rgb-Infrared Person Re-Identification.

Faster Person Re-Identification

BiCnet-TKS: Learning Efficient Spatial-Temporal Representation for Video Person Re-Identification

Decouple Co-Adaptation: Classifier Randomization for Person Re-Identification

Semi-Supervised Bayesian Attribute Learning for Person Re-Identification

Cross-Entropy Adversarial View Adaptation for Person Re-identification

Cross-Modality Person Re-Identification with Generative Adversarial Training