Abstract:Convolution-based networks show impressive performance in Single Image Super-Resolution (SISR) task by making full use of local patterns. However, it requires deeper structure to capture the long-range dependencies which is inefficient. Hence, the Non-Local Attention (NLA) is introduced to search similar patterns globally and effectively exchange information globally. Nevertheless, the naïve NLA only exchanges information in original spatial scale and has quadratic computational complexity with spatial size of input image. Besides, the global fusion of all similar patterns may lead to blurring, which deviates from the goal of SISR to accurately recover image details. Hence, the naïve NLA is not suit for SISR. To solve this problem, we propose a novel Cross-Scale Collaborative Attention (CSCA) which is designed for SISR. Due to similar patterns tend to occur at different locations and scales, we explore self-similarity and cross-scale similarity simultaneously on multi-scale feature pyramid to utilize more rich details for improving the performance of recovery. To guarantee the recovered details are accurate, we aggregate features in each layer of pyramid into groups and only exchange information between the most relevant groups across multi-scale. Hence, CSCA is both efficient and can accurately recover details using the rich information contained in multi-scale. Furthermore, we propose a Cross-Scale Collaborative Network (CSCN) by inserting a few CSCA modules into a simple backbone network. Extensive experiments show the effectivity and efficiency of CSCA, and state-of-the-art performance of CSCN in SISR task.

A channel-wise multi-scale network for single image super-resolution

Multi-Scale Cross-Attention Fusion Network Based on Image Super-Resolution

Lightweight Multi-Attention Fusion Network for Image Super-Resolution

Single-image Super-Resolution Via Selective Multi-Scale Network

A Lightweight Multi-Scale Channel Attention Network for Image Super-Resolution.

A Multi-Scale Layer-Channel Attention Network for Image Super-Resolution

Single Image Super-Resolution Using Asynchronous Multi-Scale Network

A Content-Based Multi-Scale Network for Single Image Super-Resolution.

Multi-scale Feature Selection Network for Lightweight Image Super-Resolution

Multi-feature Self-Attention Super-Resolution Network

Lightweight single-image super-resolution via multi-scale feature fusion CNN and multiple attention block

Non-linear Perceptual Multi-Scale Network for Single Image Super-Resolution

The Multi-scale Fast Network for Image Super-resolution

Multi-Scale Residual Network For Image Super-Resolution

A Multi-Scale Recursive Attention Feature Fusion Network for Image Super-Resolution Reconstruction Algorithm

Multi-scale Receptive Field Fusion Network for Lightweight Image Super-Resolution

Dual-attention Guided Multi-Scale Network for Single Image Super-Resolution

Lightweight multi-scale residual networks with attention for image super-resolution

Multi-scale attention network for image super-resolution

Cross-scale collaborative network for single image super resolution

Multi-Level Feature Fusion Mechanism for Single Image Super-Resolution