Abstract:Deep convolutional neural networks (DCCNs) have shown pleasing performance in single image super-resolution (SISR). To deploy them onto real devices with limited storage and computational resources, a promising solution is to binarize the network, i.e., quantize each float-point weight and activation into 1 bit. However, existing works on binarizing DCNNs still suffer from severe performance degradation in SISR. To mitigate this problem, we argue that the performance degradation mainly comes from no appropriate constraint on the network weights, which causes it difficult to sensitively reverse the binarization results of these weights using the backpropagated gradient during training and thus limits the flexibility of network in respect of fitting extensive training samples. Inspired by this, we present an embarrassingly simple but effective binarization scheme for SISR, which can obviously relieve the performance degeneration resulted from network binarization and is applicable to different DCNN architectures. Specifically, we force each weight to follow a compact uniform prior, with which the weight will be given a very small absolute value close to zero and its binarization result can be straightforwardly reversed even by a small backpropagated gradient. By doing this, the flexibility and the generalization performance of the binarized network can be improved. Moreover, such a prior performs much better when introducing real identity shortcuts into the network. In addition, to avoid falling into bad local minima during training, we employ a pixel-wise curriculum learning strategy to learn the constrained weights in an easy-to-hard manner. Experiments on four SISR benchmark datasets demonstrate the effectiveness of the proposed binarization method in terms of binarizing different SISR network architectures, e.g., it even achieves performance comparable to the baseline with 5 quantization bits.

A Simple and General Binarization Method for Image Restoration Neural Networks.

Binary Image-Restoration Using Neural-Network Models

Basic Binary Convolution Unit for Binarized Image Restoration Network

Embarrassingly Simple Binarization for Deep Single Imagery Super-Resolution Networks

Binarized Low-light Raw Video Enhancement

Distribution-sensitive Information Retention for Accurate Binary Neural Network

Efficient Super Resolution Using Binarized Neural Network

Binarizing Super-Resolution Neural Network Without Batch Normalization.

Training Binary Neural Network Without Batch Normalization for Image Super-Resolution

Network Binarization via Contrastive Learning

Binarized Neural Network for Single Image Super Resolution

Fast Image Restoration with Multi-Bin Trainable Linear Units.

BiPointNet: Binary Neural Network for Point Clouds

Image Restoration after Pixel Binning in Image Sensors

FABNet: Frequency-Aware Binarized Network for Single Image Super-Resolution

Gradient Corrected Approximation for Binary Neural Networks.

Multi-bin Trainable Linear Unit for Fast Image Restoration Networks

Improving the Accuracy of Binarized Neural Networks and Application on Remote Sensing Data

Image Restoration Based on End-to-End Unrolled Network

Document Image Binarization with Fully Convolutional Neural Networks

Toward Pixel-Level Precision for Binary Super-Resolution With Mixed Binary Representation