Abstract:Single image super-resolution (SISR) is a task of reconstructing high-resolution (HR) images from low-resolution (LR) images, which are obtained by some degradation process. Deep neural networks (DNNs) have greatly advanced the frontier of image super-resolution research and replaced traditional methods as the de facto standard approach. The attention mechanism enables the SR algorithms to achieve breakthrough performance after another. However, limited research has been conducted on the interaction and integration of attention mechanisms across different dimensions. To tackle this issue, in this paper, we propose a cross-dimensional attention fusion network (CAFN) to effectively achieve cross-dimensional inter-action with long-range dependencies. Specifically, the proposed approach involves the utilization of a cross-dimensional aggrega-tion module (CAM) to effectively capture contextual information by integrating both spatial and channel importance maps. The design of information fusion module (IFM) in CAM serves as a bridge for parallel dual-attention information fusion. In addition, a novel memory-adaptive multi-stage (MAMS) training method is proposed. We perform warm-start retraining with the same setting as the previous stage, without increasing memory consumption. If the memory is sufficient, we finetune the model with a larger patch size after the warm-start. The experimental results definitively demonstrate the superior performance of our cross-dimensional attention fusion network and training strategy compared to state-of-the-art (SOTA) methods, as evidenced by both quantitative and qualitative metrics.

Multi-Scale Cross-Attention Fusion Network Based on Image Super-Resolution

Lightweight Multi-Attention Fusion Network for Image Super-Resolution

Single image super-resolution with multi-scale information cross-fusion network

Single-image Super-Resolution Via Selective Multi-Scale Network

Lightweight Multiresolution Feature Fusion Network for Spectral Super-Resolution

A Multi-Scale Recursive Attention Feature Fusion Network for Image Super-Resolution Reconstruction Algorithm

Multi-feature Self-Attention Super-Resolution Network

Multi-scale Receptive Field Fusion Network for Lightweight Image Super-Resolution

Single Image Super Resolution Via Multi-Attention Fusion Recurrent Network.

Cross-Dimensional Attention Fusion Network for Simulated Single Image Super-Resolution

A Lightweight Multi-Scale Channel Attention Network for Image Super-Resolution.

An Image Super-Resolution Network Based on Multi-Scale Convolution Fusion

Image super-resolution reconstruction based on attention mechanism and feature fusion

Fused Pyramid Attention Network for Single Image Super-Resolution.

Multi-Scale Residual Network For Image Super-Resolution

Compressed Multi-Scale Feature Fusion Network for Single Image Super-Resolution.

A channel-wise multi-scale network for single image super-resolution

Multi-scale attention network for image super-resolution

A Multi-Scale Layer-Channel Attention Network for Image Super-Resolution

Single Image Super-Resolution Via Cascaded Multi-Scale Cross Network.

Image Reconstruction of Multi Branch Feature Multiplexing Fusion Network with Mixed Multi-layer Attention