Abstract:Super-resolution is vital for the quality improvement of hyperspectral images (HSIs) under the spatial and spectral resolution trade-off. However, deep learning HSI super-resolution approaches typically adopt the "one model and one scale" scheme that is inefficient in training and storing. This is difficult in maximizing orbit equipment performance and aligning multiple spatial resolution data in remote sensing. Therefore, this article intends to address HSI arbitrary-scale super-resolution, enabling the scaling of HSIs to arbitrary sizes using a single model. To do this end, we treat HSI arbitrary-scale super-resolution as a retrieval problem. It conceptualizes the HSI as a dictionary of pixelwise tokens with spatial-spectral features, position information, and scale information. Its objective is to employ a set of initialized tokens related to the high-resolution (HR) HSI as queries to retrieve matched spectral features from low-resolution (LR) one, which is so-called token-based query-to-spectrum. Since these query tokens can be constructed flexibly (e.g., through random initialization), we can generate a desired number of them to reconstruct our HR HSI, thus achieving arbitrary-scale super-resolution. This process considers not only position information but also spectral features so that it can decrease spectral distortion. With the above idea, we developed an HSI arbitrary-scale super-resolution method, dubbed as spectral-query transformer (SQformer). Specifically, it begins by converting the LR HSI into a dictionary of LR tokens and then constructs a desired number of HR tokens. To enable flexible token construction, we design an implicit spectral token (particularly a learnable vector) and replicate it times to form the HR tokens. Next, the HR and LR tokens are passed into a transformer decoder to find the most matched spectral response for the former by soft-weighting the LR tokens. Finally, the HR tokens are spatially rearranged in order, forming an HR HSI. Extensive experiments have demonstrated its effectiveness on remote sensing data. The code will be released at: https://github.com/ShuGuoJ/SQformer.git.

SQformer: Spectral-Query Transformer for Hyperspectral Image Arbitrary-Scale Super-Resolution

CSwT-SR: Conv-Swin Transformer for Blind Remote Sensing Image Super-Resolution with Amplitude-Phase Learning and Structural Detail Alternating Learning

A spectral and spatial transformer for hyperspectral remote sensing image super-resolution

Remote Sensing Hyperspectral Image Super-Resolution via Multidomain Spatial Information and Multiscale Spectral Information Fusion

Spatial-Spectral Structured Sparse Low-Rank Representation for Hyperspectral Image Super-Resolution

Hyperspectral Image Superresolution Using Unidirectional Total Variation with Tucker Decomposition

Deep Arbitrary-Scale Image Super-Resolution Via Scale-Equivariance Pursuit

Hyperspectral Image Super-Resolution via Deep Spatiospectral Attention Convolutional Neural Networks

S2CycleDiff: Spatial-Spectral-Bilateral Cycle-Diffusion Framework for Hyperspectral Image Super-resolution

Interactformer: Interactive Transformer and CNN for Hyperspectral Image Super-Resolution

Spectral-Enhanced Sparse Transformer Network for Hyperspectral Super-Resolution Reconstruction

Spectral Super-Resolution Based on Dictionary Optimization Learning via Spectral Library

Multi-Task Interaction Learning for Spatiospectral Image Super-Resolution.

Spectral Query Spatial: Revisiting the Role of Center Pixel in Transformer for Hyperspectral Image Classification

A Variational Approach with Nonlocal Self-Similarity and Joint-Sparsity for Hyperspectral Image Super-Resolution.

DsTer: A dense spectral transformer for remote sensing spectral super-resolution

ESSAformer: Efficient Transformer for Hyperspectral Image Super-resolution

Spectral Superresolution Using Transformer with Convolutional Spectral Self-Attention

Hyperspectral image super-resolution via a multi-stage scheme without employing spatial degradation

Hyperspectral Image Superresolution via Deep Structure and Texture Interfusion

Self-Similarity Constrained Sparse Representation for Hyperspectral Image Super-Resolution.