Abstract:Person re-identification (Re-ID) has been promoted by the significant success of convolutional neural networks (CNNs). However, the application of such CNN-based Re-ID methods depends on the tremendous consumption of computation and memory resources, which affects its development on resource-limited devices such as next generation AI chips. As a result, CNN binarization has attracted increasing attention, which leads to binary neural networks (BNNs). In this article, we propose a new BNN-based framework for efficient person Re-ID (BiRe-ID). In this work, we discover that the significant performance drop of binarized models for Re-ID task is caused by the degraded representation capacity of kernels and features. To address the issues, we propose the kernel and feature refinement based on generative adversarial learning (KR-GAL and FR-GAL) to enhance the representation capacity of BNNs. We first introduce an adversarial attention mechanism to refine the binarized kernels based on their real-valued counterparts. Specifically, we introduce a scale factor to restore the scale of 1-bit convolution. And we employ an effective generative adversarial learning method to train the attention-aware scale factor. Furthermore, we introduce a self-supervised generative adversarial network to refine the low-level features using the corresponding high-level semantic information. Extensive experiments demonstrate that our BiRe-ID can be effectively implemented on various mainstream backbones for the Re-ID task. In terms of the performance, our BiRe-ID surpasses existing binarization methods by significant margins, at the level even comparable with the real-valued counterparts. For example, on Market-1501, BiRe-ID achieves 64.0% mAP on ResNet-18 backbone, with an impressive 12.51× speedup in theory and 11.75× storage saving. In particular, the KR-GAL and FR-GAL methods show strong generalization on multiple tasks such as Re-ID, image classification, object detection, and 3D point cloud processing.

Rectified Binary Convolutional Networks with Generative Adversarial Learning

RBCN: Rectified Binary Convolutional Networks for Enhancing the Performance of 1-bit DCNNs

Hyperbolic Binary Neural Network

Rectified Binary Network for Single-Image Super-Resolution

BCNN: Binary Complex Neural Network

BiRe-ID: Binary Neural Network for Efficient Person Re-ID

Basic Binary Convolution Unit for Binarized Image Restoration Network

Recurrent Bilinear Optimization for Binary Neural Networks

Bi-GCN: Binary Graph Convolutional Network

Memristive KDG-BNN: Memristive binary neural networks trained via knowledge distillation and generative adversarial networks

Gradient Corrected Approximation for Binary Neural Networks.

Binary Convolutional Neural Network on RRAM.

AdaBin: Improving Binary Neural Networks with Adaptive Binary Sets

ReActXGB: A Hybrid Binary Convolutional Neural Network Architecture for Improved Performance and Computational Efficiency

Distribution-sensitive Information Retention for Accurate Binary Neural Network

BDC-Occ: Binarized Deep Convolution Unit For Binarized Occupancy Network

FracBNN: Accurate and FPGA-Efficient Binary Neural Networks with Fractional Activations.

Network Binarization via Contrastive Learning

Binarized Neural Networks: Training Deep Neural Networks with Weights and Activations Constrained to +1 or -1

Modulated Convolutional Networks

Distillation Guided Residual Learning for Binary Convolutional Neural Networks