Abstract:Deep learning methods have shown outstanding performance in many applications, including single-image super-resolution (SISR). With residual connection architecture, deeply stacked convolutional neural networks provide a substantial performance boost for SISR, but their huge parameters and computational loads are impractical for real-world applications. Thus, designing lightweight models with acceptable performance is one of the major tasks in current SISR research. The objective of lightweight network design is to balance a computational load and reconstruction performance. Most of the previous methods have manually designed complex and predefined fixed structures, which generally required a large number of experiments and lacked flexibility in the diversity of input image statistics. In this paper, we propose a dynamic residual self-attention network (DRSAN) for lightweight SISR, while focusing on the automated design of residual connections between building blocks. The proposed DRSAN has dynamic residual connections based on dynamic residual attention (DRA), which adaptively changes its structure according to input statistics. Specifically, we propose a dynamic residual module that explicitly models the DRA by finding the interrelation between residual paths and input image statistics, as well as assigning proper weights to each residual path. We also propose a residual self-attention (RSA) module to further boost the performance, which produces 3-dimensional attention maps without additional parameters by cooperating with residual structures. The proposed dynamic scheme, exploiting the combination of DRA and RSA, shows an efficient trade-off between computational complexity and network performance. Experimental results show that the DRSAN performs better than or comparable to existing state-of-the-art lightweight models for SISR.

Residual Attention Block Search for Lightweight Image Super-Resolution.

Lightweight Multi-Attention Fusion Network for Image Super-Resolution

Lightweight Attention-Guided Network for Image Super-Resolution

Image Super-Resolution Via Residual Block Attention Networks.

SRNSSI: A Deep Light-Weight Network for Single Image Super Resolution Using Spatial and Spectral Information

Lightweight Multi-Scale Asymmetric Attention Network for Image Super-Resolution

A Dynamic Residual Self-Attention Network for Lightweight Single Image Super-Resolution

Lightweight adaptive weighted network for single image super-resolution

Lightweight Image Super-Resolution with Adaptive Weighted Learning Network

Lightweight multi-scale residual networks with attention for image super-resolution

Multi-scale strip-shaped convolution attention network for lightweight image super-resolution

Efficient Residual Dense Block Search for Image Super-Resolution

Wide Weighted Attention Multi-Scale Network for Accurate MR Image Super-Resolution

Single Image Super-Resolution with Sequential Multi-axis Blocked Attention

Wavelet-based Residual Attention Network for Image Super-Resolution

Single-image Super-Resolution with Multilevel Residual Attention Network

Multi-branch aware module with channel shuffle pixel-wise attention for lightweight image super-resolution

HASN: Hybrid Attention Separable Network for Efficient Image Super-resolution

Image Super-Resolution via Lightweight Attention-Directed Feature Aggregation Network

Hybrid Residual Attention Network for Single Image Super Resolution

A very lightweight and efficient image super-resolution network