Abstract:The success of modern single image super-resolution (SISR) algorithms is inspired by the development of deep convolutional neural networks (CNNs). However, these CNN-based methods require considerable computation and complexity, making it impossible for these methods to perform real-time calculations in edge devices. Thus, lightweight model design has become a development trend in the super-resolution field, including pruning, quantization, and other methods. The 1-bit quantization is an extreme lightweight method which can reduce the calculation amount of the model in an extreme manner and is friendly to hardware such as edge devices. Most existing binary quantization approaches lead to a large information loss during forward propagation, especially in detailed color information (e.g., edge, texture, and contrast). The loss of color information makes modern binary methods unsuitable for SISR tasks. We think the loss occurs because these methods typically utilize a uniform threshold to quantize the weights and activations. Thus, in this article, we thoroughly analyze the difference between normal classification tasks and SISR tasks, and present a binarization scheme based on local means. The proposed method can maintain more detailed information in feature maps using dynamic thresholds during quantization. Specifically, each value in the full precision activations has a corresponding threshold during the quantization process, and those thresholds are determined by the full precision values of the surroundings. In addition, a gradient approximator is introduced to adaptively optimize the gradient for updating binary weights. We then verify the effectiveness of our method for training binary networks on several SISR benchmarks including VDSR and SRResNet. Experimental results show that the proposed method can outperform the state-of-the-art algorithms to obtain binary networks for image super-resolution with better peak signal-to-noise ratio (PSNR) values and visual quality.

Training Binary Neural Network Without Batch Normalization for Image Super-Resolution

Binarizing Super-Resolution Neural Network Without Batch Normalization.

Advanced Binary Neural Network for Single Image Super Resolution

Rectified Binary Network for Single-Image Super-Resolution

Toward Pixel-Level Precision for Binary Super-Resolution With Mixed Binary Representation

Binarized Neural Network for Single Image Super Resolution

Efficient Super Resolution Using Binarized Neural Network

Binarizing super-resolution networks by pixel-correlation knowledge distillation

Local Means Binary Networks for Image Super-Resolution

EBSR: Enhanced Binary Neural Network for Image Super-Resolution

Hyperbolic Binary Neural Network

Flexible Residual Binarization for Image Super-Resolution

E2FIF: Push the Limit of Binarized Deep Imagery Super-Resolution Using End-to-End Full-Precision Information Flow

"BNN - BN = ?": Training Binary Neural Networks Without Batch Normalization

“BNN - BN = ?”: Training Binary Neural Networks Without Batch Normalization

Ultralight-weight Binary Neural Network with 1K Parameters for Image Super-Resolution

FABNet: Frequency-Aware Binarized Network for Single Image Super-Resolution

Binarized Diffusion Model for Image Super-Resolution

Embarrassingly Simple Binarization for Deep Single Imagery Super-Resolution Networks

Bi-Real Net V2: Rethinking Non-linearity for 1-Bit CNNs and Going Beyond

FTBNN: Rethinking Non-linearity for 1-bit CNNs and Going Beyond