Abstract:Arbitrary scale super-resolution (ASSR) aims to super-resolve low-resolution images to high-resolution images at any scale using a single model, addressing the limitations of traditional super-resolution methods that are restricted to fixed-scale factors (e.g., ×2, ×4). The advent of Implicit Neural Representations (INR) has brought forth a plethora of novel methodologies for ASSR, which facilitate the reconstruction of original continuous signals by modeling a continuous representation space for coordinates and pixel values, thereby enabling arbitrary-scale super-resolution. Consequently, the primary objective of ASSR is to construct a continuous representation space derived from low-resolution inputs. However, existing methods, primarily based on CNNs and Transformers, face significant challenges such as high computational complexity and inadequate modeling of long-range dependencies, which hinder their effectiveness in real-world applications. To overcome these limitations, we propose a novel arbitrary-scale super-resolution method, called S^3Mamba, to construct a scalable continuous representation space. Specifically, we propose a Scalable State Space Model (SSSM) to modulate the state transition matrix and the sampling matrix of step size during the discretization process, achieving scalable and continuous representation modeling with linear computational complexity. Additionally, we propose a novel scale-aware self-attention mechanism to further enhance the network's ability to perceive global important features at different scales, thereby building the S^3Mamba to achieve superior arbitrary-scale super-resolution. Extensive experiments on both synthetic and real-world benchmarks demonstrate that our method achieves state-of-the-art performance and superior generalization capabilities at arbitrary super-resolution scales.

Deep Arbitrary-Scale Image Super-Resolution Via Scale-Equivariance Pursuit

Rethinking Multi-Contrast MRI Super-Resolution: Rectangle-Window Cross-Attention Transformer and Arbitrary-Scale Upsampling

Activating More Information in Arbitrary-Scale Image Super-Resolution

Learning A Single Network for Scale-Arbitrary Super-Resolution

Enhanced Implicit Function-Based Network for Arbitrary-Scale Image Super-Resolution

SAVSR: Arbitrary-Scale Video Super-Resolution Via a Learned Scale-Adaptive Network

Single Remote Sensing Image Super-Resolution Via a Generative Adversarial Network with Stratified Dense Sampling and Chain Training

An Image Arbitrary-Scale Super-Resolution Network Using Frequency-domain Information

Task-Aware Dynamic Transformer for Efficient Arbitrary-Scale Image Super-Resolution

ASDN: A Deep Convolutional Network for Arbitrary Scale Image Super-Resolution

Meta-SR: A Magnification-Arbitrary Network for Super-Resolution

A2M: an Amplification-Arbitrary Module for Remote Sensing Image Super-Resolution

Arbitrary-scale Super-resolution Via Deep Learning: A Comprehensive Survey

Residual Scale Attention Network for Arbitrary Scale Image Super-Resolution

Bidirectional Scale-Aware Upsampling Network for Arbitrary-Scale Video Super-Resolution

Single-image Super-Resolution Via Selective Multi-Scale Network

Dual Arbitrary Scale Super-Resolution for Multi-Contrast MRI

Implicit Grid Convolution for Multi-Scale Image Super-Resolution

Scalable Super-Resolution Neural Operator

GaussianSR: High Fidelity 2D Gaussian Splatting for Arbitrary-Scale Image Super-Resolution

S^3Mamba: Arbitrary-Scale Super-Resolution Via Scaleable State Space Model