Abstract:Deep convolutional neural networks (DCCNs) have shown pleasing performance in single image super-resolution (SISR). To deploy them onto real devices with limited storage and computational resources, a promising solution is to binarize the network, i.e., quantize each float-point weight and activation into 1 bit. However, existing works on binarizing DCNNs still suffer from severe performance degradation in SISR. To mitigate this problem, we argue that the performance degradation mainly comes from no appropriate constraint on the network weights, which causes it difficult to sensitively reverse the binarization results of these weights using the backpropagated gradient during training and thus limits the flexibility of network in respect of fitting extensive training samples. Inspired by this, we present an embarrassingly simple but effective binarization scheme for SISR, which can obviously relieve the performance degeneration resulted from network binarization and is applicable to different DCNN architectures. Specifically, we force each weight to follow a compact uniform prior, with which the weight will be given a very small absolute value close to zero and its binarization result can be straightforwardly reversed even by a small backpropagated gradient. By doing this, the flexibility and the generalization performance of the binarized network can be improved. Moreover, such a prior performs much better when introducing real identity shortcuts into the network. In addition, to avoid falling into bad local minima during training, we employ a pixel-wise curriculum learning strategy to learn the constrained weights in an easy-to-hard manner. Experiments on four SISR benchmark datasets demonstrate the effectiveness of the proposed binarization method in terms of binarizing different SISR network architectures, e.g., it even achieves performance comparable to the baseline with 5 quantization bits.

AuxBranch: Binarization Residual-Aware Network Design via Auxiliary Branch Search

Learning to Slim Deep Networks with Bandit Channel Pruning

Flexible Network Binarization with Layer-Wise Priority.

A Main/Subsidiary Network Framework for Simplifying Binary Neural Network

Low-complex and Highly-performed Binary Residual Neural Network for Small-footprint Keyword Spotting

Extremely Sparse Networks Via Binary Augmented Pruning for Fast Image Classification.

AdaBin: Improving Binary Neural Networks with Adaptive Binary Sets

BiPointNet: Binary Neural Network for Point Clouds

Binarizing Sparse Convolutional Networks for Efficient Point Cloud Analysis

Distribution-sensitive Information Retention for Accurate Binary Neural Network

A High-Efficiency FPGA-Based Accelerator for Binarized Neural Network

BCNet: Searching for Network Width with Bilaterally Coupled Network

FBNA: A Fully Binarized Neural Network Accelerator.

Network Binarization via Contrastive Learning

Performance Guaranteed Network Acceleration Via High-Order Residual Quantization.

An Efficient Channel-Aware Sparse Binarized Neural Networks Inference Accelerator

Arbitrary Bit-width Network: A Joint Layer-Wise Quantization and Adaptive Inference Approach

ReBNet: Residual Binarized Neural Network

Embarrassingly Simple Binarization for Deep Single Imagery Super-Resolution Networks

Improving the Accuracy of Binarized Neural Networks and Application on Remote Sensing Data

Searching for Network Width With Bilaterally Coupled Network