Abstract:The performance of single image super-resolution has achieved significant improvement by utilizing deep convolutional neural networks (CNNs). The features in deep CNN contain different types of information which make different contributions to image reconstruction. However, the most CNN-based models lack discriminative ability for different types of information and deal with them equally, which results in the representational capacity of the models being limited. On the other hand, as the depth of neural network grows, the long-term information coming from preceding layers is easy to be weaken or lost at later layers, which is adverse to super-resolving image. To capture more informative features and maintain long-term information for image super-resolution, we propose a channel-wise and spatial feature modulation (CSFM) network in which a series of feature modulation memory (FMM) modules are cascaded with a densely connected structure to transform shallow features to high informative features. In each FMM module, we construct a set of channel-wise and spatial attention residual (CSAR) blocks and stack them in a chain structure to dynamically modulate the multi-level features in global and local manners. This feature modulation strategy enables the valuable information to be enhanced and the redundant information to be suppressed. Meanwhile, for long-term information persistence, a gated fusion (GF) node is attached at the end of the FMM module to adaptively fuse hierarchical features and distill more effective information via the dense skip connections and the gating mechanism. The extensive quantitative and qualitative evaluations on benchmark datasets illustrate the superiority of our proposed method over the state-of-the-art methods.

Real-Time Channel Mixing Net for Mobile Image Super-Resolution.

NoUCSR: Efficient Super-Resolution Network Without Upsampling Convolution.

Lightweight Image Super-Resolution Network Using 3D Convolutional Neural Networks

Learning to Joint Remosaic and Denoise in Quad Bayer CFA via Universal Multi-scale Channel Attention Network.

Anchor-based Plain Net for Mobile Image Super-Resolution

ShuffleMixer: An Efficient ConvNet for Image Super-Resolution

RFCNet: Remote Sensing Image Super-Resolution Using Residual Feature Calibration Network

Learning Frequency-aware Dynamic Network for Efficient Super-Resolution.

Orientation-Aware Deep Neural Network for Real Image Super-Resolution.

Image Super-Resolution Using Very Deep Residual Channel Attention Networks

Lightweight image super-resolution network based on extended convolution mixer

Channel-Wise and Spatial Feature Modulation Network for Single Image Super-Resolution

A Ray-tracing and Deep Learning Fusion Super-resolution Modeling Method for Wireless Mobile Channel

CAMixerSR: Only Details Need More "Attention"

Lightweight Feature De-redundancy and Self-calibration Network for Efficient Image Super-resolution

Multi-branch aware module with channel shuffle pixel-wise attention for lightweight image super-resolution

Image Super-Resolution Using Deep Convolutional Networks

Multi-Attention Based Ultra Lightweight Image Super-Resolution

Deep Learning for Super-Resolution Channel Estimation in Reconfigurable Intelligent Surface Aided Systems.

Fluid Micelle Network for Image Super-Resolution Reconstruction

Image Super-Resolution via Lightweight Attention-Directed Feature Aggregation Network