Abstract:Single image super-resolution (SR) is an important low-level vision task, and the dynamic SR trading off performance and efficiency are increasingly in demand. The existing dynamic SR methods are divided into two classes: the structured pruning and non-structured compressing methods. The former removes redundant structures in the network, which often leads to significant performance degradation, and the latter searches for extremely sparse parameter masks, achieving promising performance, but they are not deployable in hardware platforms with irregular memory access. In order to solve the mentioned problems, we propose Hardware-friendly Scalable SR (HSSR) with progressively structured sparsity. The superiority of our method is that with only a single scalable model it covers multiple SR models with different sizes, without extra retraining or post-processing. HSSR contains the forward and backward processing. In the forward process, we gradually shrink the SR networks with structured iterative sparsity where grouping convolution together with knowledge distillation is conducted to reduce the amount of SR parameters and the computational complexity while keeping the performance, and in the backward process, we gradually expand the compressed SR networks with structured iterative recovery. Comprehensive experiments on benchmark datasets show that HSSR is perfectly compatible with common convolution baselines. Compared with the Slimmable method, our model is superior in performance, flops, and model size. Experimental results demonstrate that HSSR achieves significant compression, saving up to 1500K parameters and 100 GFlops calculation compared to the original model in real-world applications.

Single Image Super-Resolution Via the Implementation of the Hardware-Friendly Sparse Coding

A Sparse Representation Based Super-Resolution Image Reconstruction Scheme Utilizing Dual Dictionaries

A Hybrid Multi-Frame Super-Resolution Algorithm Using Multi-Channel Memristive Pulse Coupled Neural Network and Sparse Coding

Hybrid Dual-Complementary Metal-Oxide-semiconductor/memristor Synapse-Based Neural Network with Its Applications in Image Super-Resolution

A Compact Memristor-based GAN Architecture with a Case Study on Single Image Super-Resolution

Adaptive Sparse Coding Based on Memristive Neural Network with Applications

Single Image Super Resolution Based on Sparse Domain Selection

Single Image Super-Resolution Via Adaptive Sparse Representation and Low-Rank Constraint.

Single Image Super-Resolution Based on Nonlocal Similarity and Sparse Representation

Single-Image Super-Resolution by Subdictionary Coding and Kernel Regression

Single Image Super-Resolution Via Convolutional Sparse Coding with One Group of Filters.

Single Image Super-Resolution Using Incoherent Sub-Dictionaries Learning

Hardware-friendly Scalable Image Super Resolution with Progressively Structured Sparsity

A 28-nm Computing-in-Memory-Based Super-Resolution Accelerator Incorporating Macro-Level Pipeline and Texture/Algebraic Sparsity

Sparse Support Regression for Image Super-Resolution

Memristive neural network circuit design based on locally competitive algorithm for sparse coding application

Image Super-Resolution Via RL-CSC: when Residual Learning Meets Convolutional Sparse Coding

Convolutional Sparse Coding for Image Super-Resolution

Sparse coding with memristor networks

Hundred-Kilobyte Lookup Tables for Efficient Single-Image Super-Resolution

Combining Synthesis Sparse with Analysis Sparse for Single Image Super-Resolution