Abstract:Since the global self-attention mechanism can capture long-distance dependencies well, Transformer-based methods have achieved remarkable performance in many vision tasks, including single-image super-resolution (SISR). However, there are strong local self-similarities in images, if the global self-attention mechanism is still used for image processing, it may lead to excessive use of computing resources on parts of the image with weak correlation. Especially in the high-resolution large-size image, the global self-attention will lead to a large number of redundant calculations. To solve this problem, we propose the Enhanced Local Multi-windows Attention Network (ELMA), which contains two main designs. First, different from the traditional self-attention based on square window partition, we propose a Multi-windows Self-Attention (M-WSA) which uses a new window partitioning mechanism to obtain different types of local long-distance dependencies. Compared with original self-attention mechanisms commonly used in other SR networks, M-WSA reduces computational complexity and achieves superior performance through analysis and experiments. Secondly, we propose a Spatial Gated Network (SGN) as a feed-forward network, which can effectively overcome the problem of intermediate channel redundancy in traditional MLP, thereby improving the parameter utilization and computational efficiency of the network. Meanwhile, SGN introduces spatial information into the feed-forward network that traditional MLP cannot obtain. It can better understand and use the spatial structure information in the image, and enhances the network performance and generalization ability. Extensive experiments show that ELMA achieves competitive performance compared to state-of-the-art methods while maintaining fewer parameters and computational costs.

Learning Epipolar Line Window Attention for Stereo Image Super-Resolution Reconstruction

CSwT-SR: Conv-Swin Transformer for Blind Remote Sensing Image Super-Resolution with Amplitude-Phase Learning and Structural Detail Alternating Learning

Learning Accurate and Enriched Features for Stereo Image Super-Resolution

Stereo Image Restoration Via Attention-Guided Correspondence Learning

Non-Local Nested Residual Attention Network for Stereo Image Super-Resolution.

Efficient Hybrid Feature Interaction Network for Stereo Image Super-Resolution

Learning Inter- and Intra-frame Representations for Non-Lambertian Photometric Stereo

Stereo Endoscopic Image Super-Resolution Using Disparity-Constrained Parallel Attention

Multi-scale Parallax Attention for Stereo Image Super-Resolution

Orientation-Aware Deep Neural Network for Real Image Super-Resolution.

CVGSR: Stereo image Super-Resolution with Cross-View guidance

Enhanced Context Attention Network for Image Super Resolution

Multi-Stage Edge-Guided Stereo Feature Interaction Network for Stereoscopic Image Super-Resolution

Multi-Window Fusion Spatial-Frequency Joint Self-Attention for Remote-Sensing Image Super-Resolution

Coarse-to-Fine Cross-View Interaction Based Accurate Stereo Image Super-Resolution Network

Parallax Attention for Unsupervised Stereo Correspondence Learning

Stereo Matching Method for Remote Sensing Images Based on Attention and Scale Fusion

Enhanced local multi-windows attention network for lightweight image super-resolution

Selective-Stereo: Adaptive Frequency Information Selection for Stereo Matching

Multi-Level Feature Fusion Network for Lightweight Stereo Image Super-Resolution

Efficient Image Super-Resolution via Symmetric Visual Attention Network