Abstract:The performance of single image super-resolution has achieved significant improvement by utilizing deep convolutional neural networks (CNNs). The features in deep CNN contain different types of information which make different contributions to image reconstruction. However, the most CNN-based models lack discriminative ability for different types of information and deal with them equally, which results in the representational capacity of the models being limited. On the other hand, as the depth of neural network grows, the long-term information coming from preceding layers is easy to be weaken or lost at later layers, which is adverse to super-resolving image. To capture more informative features and maintain long-term information for image super-resolution, we propose a channel-wise and spatial feature modulation (CSFM) network in which a series of feature modulation memory (FMM) modules are cascaded with a densely connected structure to transform shallow features to high informative features. In each FMM module, we construct a set of channel-wise and spatial attention residual (CSAR) blocks and stack them in a chain structure to dynamically modulate the multi-level features in global and local manners. This feature modulation strategy enables the valuable information to be enhanced and the redundant information to be suppressed. Meanwhile, for long-term information persistence, a gated fusion (GF) node is attached at the end of the FMM module to adaptively fuse hierarchical features and distill more effective information via the dense skip connections and the gating mechanism. The extensive quantitative and qualitative evaluations on benchmark datasets illustrate the superiority of our proposed method over the state-of-the-art methods.

SFHN: Spatial-Frequency Domain Hybrid Network for Image Super-Resolution

A High-Frequency Focused Network for Lightweight Single Image Super-Resolution

FSR: A General Frequency-Oriented Framework to Accelerate Image Super-resolution Networks.

Sub-Pixel Convolutional Neural Network for Image Super-Resolution Reconstruction

A Super-Resolution Algorithm Based on Hybrid Network for Multi-Channel Remote Sensing Images

Channel-Wise and Spatial Feature Modulation Network for Single Image Super-Resolution

SSF-CNN: Spatial and Spectral Fusion with CNN for Hyperspectral Image Super-Resolution

Orientation-Aware Deep Neural Network for Real Image Super-Resolution.

Diffused Convolutional Neural Network for Hyperspectral Image Super-Resolution

Deeply Recursive Low- and High-Frequency Fusing Networks for Single Image Super-Resolution

Faster Image Super-Resolution by Improved Frequency-Domain Neural Networks.

Learning Frequency-aware Dynamic Network for Efficient Super-Resolution.

A Hybrid Convolutional Neural Network for Super-Resolution Reconstruction of MR Images.

High-frequency channel attention and contrastive learning for image super-resolution

Hybrid Residual Attention Network for Single Image Super Resolution

Frequency Consistent Adaptation for Real World Super Resolution

Super-Resolution for Noisy Images Via Deep Convolutional Neural Network

Hyperspectral Image Super-Resolution via Dual-domain Network Based on Hybrid Convolution

A Wavelet-Based Asymmetric Convolution Network for Single Image Super-Resolution

Single Image Super-Resolution Neural Network Using Frequency-Domain Information

Frequency-Spatial Domain Feature Fusion for Spectral Super-Resolution