Abstract:Current super-resolution networks typically reduce network parameters and multiadds operations by designing lightweight structures, but lightening the convolution layer is often ignored. In this work, we observe that $3 \times 3$ convolutions occupy a high percentage of network parameters in most lightweight super-resolution networks. This motivates us to consider lightening super-resolution networks by replacing $3 \times 3$ convolutions with lightweight convolutions, while maintaining the performance. To achieve this, we propose a lightweight convolution layer named contextual transformation layer (CTL). It can yield efficient contextual features through a context feature extraction module and enrich extracted contextual features through a context feature transformation module. Based on CTLs, we build a lightweight super-resolution network called contextual transformation network (CTN) for remote-sensing image super-resolution. Specifically, we use two CTLs to construct a contextual transformation block (CTB) for hierarchical feature learning. Interleaved with a CTB, a context enhancement module (CEM) is employed to enhance the extracted feature representations. All extracted features are processed by a contextual feature aggregation module for final remote-sensing image super-resolution. Extensive experiments are performed on a remote-sensing image super-resolution benchmark named UC Merced. Our method achieves superior results to the other state-of-the-art methods. To demonstrate the generalization ability of our CTL, we extend our CTN to two relevant tasks: natural image super-resolution and natural image denoising. Experimental results on natural image super-resolution benchmarks (i.e., Set5, Set14, B100, Urban100, and Manga109) and natural image denoising benchmarks (i.e., SIDD and DND) further prove the superiority of our method. Our code is publicly available at https://github.com/BITszwang/CTNet.

CGC-Net: A Context-Guided Constrained Network for Remote-Sensing Image Super Resolution

Parallel-Connected Residual Channel Attention Network for Remote Sensing Image Super-Resolution

Optimizing Spatial Relationships in GCN to Improve the Classification Accuracy of Remote Sensing Images

Image Super-Resolution Using Residual Global Context Network.

Context-aware lightweight remote-sensing image super-resolution network

Non-Local Similarity-Based Attentive Graph Convolution Network for Remote Sensing Image Super-Resolution

CGGLNet: Semantic Segmentation Network for Remote Sensing Images Based on Category-Guided Global–Local Feature Interaction

CFGN: A Lightweight Context Feature Guided Network for Image Super-Resolution

Pre-training of Gated Convolution Neural Network for Remote Sensing Image Super-Resolution

Contextual Transformation Network for Lightweight Remote-Sensing Image Super-Resolution

Dual Residual Global Context Attention Network for Super-Resolution.

Gradient Prior Dilated Convolution Network for Remote Sensing Image Super-Resolution

Remote Sensing Single-Image Resolution Improvement Using A Deep Gradient-Aware Network with Image-Specific Enhancement

SCSNet: an Efficient Paradigm for Learning Simultaneously Image Colorization and Super-resolution

Super-Resolution for Remote Sensing Images Via Local–Global Combined Network

Context Enhancing Representation for Semantic Segmentation in Remote Sensing Images.

CNN-GCN Joint Network for Remote Sensing Scene Classification

Context-Aware Guided Attention Based Cross-Feedback Dense Network for Hyperspectral Image Super-Resolution

CTE-Net: Contextual Texture Enhancement Network for Image Super-Resolution

Local-Global Context-Aware Generative Dual-Region Adversarial Networks for Remote Sensing Scene Image Super-Resolution

Real-time Deep Image Super-Resolution Via Global Context Aggregation and Local Queue Jumping