Abstract:The success of modern single image super-resolution (SISR) algorithms is inspired by the development of deep convolutional neural networks (CNNs). However, these CNN-based methods require considerable computation and complexity, making it impossible for these methods to perform real-time calculations in edge devices. Thus, lightweight model design has become a development trend in the super-resolution field, including pruning, quantization, and other methods. The 1-bit quantization is an extreme lightweight method which can reduce the calculation amount of the model in an extreme manner and is friendly to hardware such as edge devices. Most existing binary quantization approaches lead to a large information loss during forward propagation, especially in detailed color information (e.g., edge, texture, and contrast). The loss of color information makes modern binary methods unsuitable for SISR tasks. We think the loss occurs because these methods typically utilize a uniform threshold to quantize the weights and activations. Thus, in this article, we thoroughly analyze the difference between normal classification tasks and SISR tasks, and present a binarization scheme based on local means. The proposed method can maintain more detailed information in feature maps using dynamic thresholds during quantization. Specifically, each value in the full precision activations has a corresponding threshold during the quantization process, and those thresholds are determined by the full precision values of the surroundings. In addition, a gradient approximator is introduced to adaptively optimize the gradient for updating binary weights. We then verify the effectiveness of our method for training binary networks on several SISR benchmarks including VDSR and SRResNet. Experimental results show that the proposed method can outperform the state-of-the-art algorithms to obtain binary networks for image super-resolution with better peak signal-to-noise ratio (PSNR) values and visual quality.

Binarizing super-resolution networks by pixel-correlation knowledge distillation

Embarrassingly Simple Binarization for Deep Single Imagery Super-Resolution Networks

Binarized Neural Network for Single Image Super Resolution

Epistemic-Uncertainty-Based Divide-and-Conquer Network for Single-Image Super-Resolution

Lightweight Image Super-Resolution Network Using 3D Convolutional Neural Networks

Local Means Binary Networks for Image Super-Resolution

Binarized Diffusion Model for Image Super-Resolution

Toward Pixel-Level Precision for Binary Super-Resolution With Mixed Binary Representation

EBSR: Enhanced Binary Neural Network for Image Super-Resolution

Rectified Binary Network for Single-Image Super-Resolution

Advanced Binary Neural Network for Single Image Super Resolution

DDistill-SR: Reparameterized Dynamic Distillation Network for Lightweight Image Super-Resolution

E2FIF: Push the Limit of Binarized Deep Imagery Super-Resolution Using End-to-End Full-Precision Information Flow

FABNet: Frequency-Aware Binarized Network for Single Image Super-Resolution

Learning a Convolutional Neural Network for Image Compact-Resolution

Fully Quantized Image Super-Resolution Networks

Image super-resolution based on residually dense distilled attention network q

SBNN: Slimming binarized neural network

Sub-Pixel Convolutional Neural Network for Image Super-Resolution Reconstruction

Lightweight global-locally connected distillation network for single image super-resolution

A Lightweight Image Super-Resolution Reconstruction Algorithm Based on the Residual Feature Distillation Mechanism