Abstract:The single image super-resolution(SISR) algorithms under deep learning currently have two main models, one based on convolutional neural networks and the other based on Transformer. The former uses the stacking of convolutional layers with different convolutional kernel sizes to design the model, which enables the model to better extract the local features of the image; the latter uses the self-attention mechanism to design the model, which allows the model to establish long-distance dependencies between image pixel points through the self-attention mechanism and then better extract the global features of the image. However, both of the above methods face their problems. Based on this, this paper proposes a new lightweight multi-scale feature fusion network model based on two-way complementary convolutional and Transformer, which integrates the respective features of Transformer and convolutional neural networks through a two-branch network architecture, to realize the mutual fusion of global and local information. Meanwhile, considering the partial loss of information caused by the low-pixel images trained by the deep neural network, this paper designs a modular connection method of multi-stage feature supplementation to fuse the feature maps extracted from the shallow stage of the model with those extracted from the deep stage of the model, to minimize the loss of the information in the feature images that is beneficial to the image restoration as much as possible, to facilitate the obtaining of a higher-quality restored image. The practical results finally show that the model proposed in this paper is optimal in image recovery performance when compared with other lightweight models with the same amount of parameters.

Transformer-based image super-resolution and its lightweight

Lightweight Image Super-Resolution Network Using 3D Convolutional Neural Networks

A Residual Network with Efficient Transformer for Lightweight Image Super-Resolution

Efficient Transformer for Single Image Super-Resolution.

A Simple Transformer-style Network for Lightweight Image Super-resolution.

SRConvNet: A Transformer-Style ConvNet for Lightweight Image Super-Resolution

Self-Calibrated Efficient Transformer for Lightweight Super-Resolution

Efficient local cascading residual network for real-time single image super-resolution

Joint Features-Guided Linear Transformer and CNN for Efficient Image Super-Resolution

Transforming Image Super-Resolution: A ConvFormer-Based Efficient Approach

Incorporating Transformer Designs into Convolutions for Lightweight Image Super-Resolution

Lightweight Super-Resolution Via Multi-Group Window Self-Attention and Residual Blueprint Separable Convolution

Cross-receptive Focused Inference Network for Lightweight Image Super-Resolution

Lightweight single-image super-resolution network based on dual paths

Lightweight Image Super-Resolution with Pyramid Clustering Transformer

Lightweight image super-resolution based on stepwise feedback mechanism and multi-feature maps fusion

Image Super-Resolution Using a Simple Transformer Without Pretraining

Lightweight Single Image Super-Resolution via Efficient Mixture of Transformers and Convolutional Networks

A very lightweight and efficient image super-resolution network

Lightweight Wavelet-Based Transformer for Image Super-Resolution