Abstract:Current super-resolution networks typically reduce network parameters and multiadds operations by designing lightweight structures, but lightening the convolution layer is often ignored. In this work, we observe that $3 \times 3$ convolutions occupy a high percentage of network parameters in most lightweight super-resolution networks. This motivates us to consider lightening super-resolution networks by replacing $3 \times 3$ convolutions with lightweight convolutions, while maintaining the performance. To achieve this, we propose a lightweight convolution layer named contextual transformation layer (CTL). It can yield efficient contextual features through a context feature extraction module and enrich extracted contextual features through a context feature transformation module. Based on CTLs, we build a lightweight super-resolution network called contextual transformation network (CTN) for remote-sensing image super-resolution. Specifically, we use two CTLs to construct a contextual transformation block (CTB) for hierarchical feature learning. Interleaved with a CTB, a context enhancement module (CEM) is employed to enhance the extracted feature representations. All extracted features are processed by a contextual feature aggregation module for final remote-sensing image super-resolution. Extensive experiments are performed on a remote-sensing image super-resolution benchmark named UC Merced. Our method achieves superior results to the other state-of-the-art methods. To demonstrate the generalization ability of our CTL, we extend our CTN to two relevant tasks: natural image super-resolution and natural image denoising. Experimental results on natural image super-resolution benchmarks (i.e., Set5, Set14, B100, Urban100, and Manga109) and natural image denoising benchmarks (i.e., SIDD and DND) further prove the superiority of our method. Our code is publicly available at https://github.com/BITszwang/CTNet.

Lightweight Image Super-Resolution with Pyramid Clustering Transformer

Lightweight Image Super-Resolution Network Using 3D Convolutional Neural Networks

Transformer-based image super-resolution and its lightweight

Efficient Transformer for Single Image Super-Resolution.

Cross-receptive Focused Inference Network for Lightweight Image Super-Resolution

An efficient parallel fusion structure of distilled and transformer-enhanced modules for lightweight image super-resolution

Incorporating Transformer Designs into Convolutions for Lightweight Image Super-Resolution

A Residual Network with Efficient Transformer for Lightweight Image Super-Resolution

Multi-granularity Backprojection Transformer for Remote Sensing Image Super-Resolution

Lightweight Single Image Super-Resolution via Efficient Mixture of Transformers and Convolutional Networks

Contextual Transformation Network for Lightweight Remote-Sensing Image Super-Resolution

A Lightweight Pyramid Feature Fusion Network for Single Image Super-Resolution Reconstruction

DRCT: Saving Image Super-resolution away from Information Bottleneck

An Efficient Hybrid CNN-Transformer Approach for Remote Sensing Super-Resolution

PCCFormer: Parallel coupled convolutional transformer for image super-resolution

Dynamic feature distillation and pyramid split large kernel attention network for lightweight image super-resolution

Transforming Image Super-Resolution: A ConvFormer-based Efficient Approach

HiT-SR: Hierarchical Transformer for Efficient Image Super-Resolution

Attention-guided hybrid transformer-convolutional neural network for underwater image super-resolution

Efficient Mixed Transformer for Single Image Super-Resolution