Abstract:Deep convolutional neural networks (DCCNs) have shown pleasing performance in single image super-resolution (SISR). To deploy them onto real devices with limited storage and computational resources, a promising solution is to binarize the network, i.e., quantize each float-point weight and activation into 1 bit. However, existing works on binarizing DCNNs still suffer from severe performance degradation in SISR. To mitigate this problem, we argue that the performance degradation mainly comes from no appropriate constraint on the network weights, which causes it difficult to sensitively reverse the binarization results of these weights using the backpropagated gradient during training and thus limits the flexibility of network in respect of fitting extensive training samples. Inspired by this, we present an embarrassingly simple but effective binarization scheme for SISR, which can obviously relieve the performance degeneration resulted from network binarization and is applicable to different DCNN architectures. Specifically, we force each weight to follow a compact uniform prior, with which the weight will be given a very small absolute value close to zero and its binarization result can be straightforwardly reversed even by a small backpropagated gradient. By doing this, the flexibility and the generalization performance of the binarized network can be improved. Moreover, such a prior performs much better when introducing real identity shortcuts into the network. In addition, to avoid falling into bad local minima during training, we employ a pixel-wise curriculum learning strategy to learn the constrained weights in an easy-to-hard manner. Experiments on four SISR benchmark datasets demonstrate the effectiveness of the proposed binarization method in terms of binarizing different SISR network architectures, e.g., it even achieves performance comparable to the baseline with 5 quantization bits.

Flexible Network Binarization with Layer-Wise Priority.

Network Binarization via Contrastive Learning

Distribution-sensitive Information Retention for Accurate Binary Neural Network

BiPointNet: Binary Neural Network for Point Clouds

Binary Convolutional Neural Network with High Accuracy and Compression Rate

Iterative Training: Finding Binary Weight Deep Neural Networks with Layer Binarization

Binarizing by Classification: is Soft Function Really Necessary?

Forward and Backward Information Retention for Accurate Binary Neural Networks

Learning Efficient Binarized Object Detectors With Information Compression

AdaBin: Improving Binary Neural Networks with Adaptive Binary Sets

IR-Net: Forward and Backward Information Retention for Highly Accurate Binary Neural Networks

Learning to Binarize Convolutional Neural Networks with Adaptive Neural Encoder

Loss-aware Binarization of Deep Networks.

Bi-Real Net: Binarizing Deep Network Towards Real-Network Performance

Embarrassingly Simple Binarization for Deep Single Imagery Super-Resolution Networks

BiFSMNv2: Pushing Binary Neural Networks for Keyword Spotting to Real-Network Performance.

How to Train A Compact Binary Neural Network with High Accuracy?

Bi-Real Net V2: Rethinking Non-linearity for 1-Bit CNNs and Going Beyond

Performance Guaranteed Network Acceleration Via High-Order Residual Quantization.

Binarizing Sparse Convolutional Networks for Efficient Point Cloud Analysis

SBNN: Slimming binarized neural network