Abstract:The hyperspectral image (HSI) super-resolution (SR) without auxiliary high-resolution images is a challenging task in computer vision applications. The existing methods almost resort to the deep convolutional neural networks of fixed geometrical kernel, which can not model the long-range dependencies and does not conform to the human visual cognition. To address this issue, we propose the cognitively-inspired multi-scale spectral-spatial transformer for HSI SR. To solve the problem of high storage and computation burden, the overlapped band grouping strategy is adopted in light of high similarity between neighboring spectral bands of HSI. Considering the different textures and details that appear in HSIs, inspired by the human cognitive mechanism, the multi-scale spatial and spectral transformer blocks are developed which can efficiently and effectively learn the spatial and spectral feature representation at different scales and long-range dependencies of features. Finally, to fuse the feature information of neighboring groups, the 2D convolution mixed with 3D separable convolution is designed, which fully explores the complementarity and continuity of spatial and spectral information. Extensive experiments conducted on three benchmark datasets demonstrate that the proposed method yields state-of-the-art results at different scales. The effectiveness of the proposed method is verified through spatial and spectral dimension data visualization and ablation experiments. The code and models are publicly available at https://github.com/liushiji666/MMSSTN . The experimental results prove the effectiveness of our proposed method, which largely overcomes the disadvantage that convolution is ineffective for long-range dependence modeling. The method performs long-range dependence modeling on both spatial and spectral features and efficiently mines complementary information between bands, thereby enhancing the model’s high perceptual ability.

A Diffusion Model-Assisted Multiscale Spectral Attention Network for Hyperspectral Image Super-Resolution

Attention in Attention for Hyperspectral with High Spatial Resolution (H) Image Classification

Hyperspectral Image Super-Resolution with 1D-2D Attentional Convolutional Neural Network.

Hyperspectral Imagery Spatial Super-Resolution Using Generative Adversarial Network.

Spectral-Cascaded Diffusion Model for Remote Sensing Image Spectral Super-Resolution

Hyperspectral Image Super-Resolution via Deep Spatiospectral Attention Convolutional Neural Networks

A Hybrid Spectral Attention-Enabled Multiscale Spatial–Spectral Learning Network for Hyperspectral Image Superresolution

Multi-Scale Feature Mapping Network for Hyperspectral Image Super-Resolution

Hyperspectral Image Super-Resolution Network Based on Cross-Scale Nonlocal Attention.

Diffused Convolutional Neural Network for Hyperspectral Image Super-Resolution

Cognitively-Inspired Multi-Scale Spectral-Spatial Transformer for Hyperspectral Image Super-Resolution

Multilevel Progressive Network with Nonlocal Channel Attention for Hyperspectral Image Super-Resolution

Spatial-Spectral Aggregation Transformer with Diffusion Prior for Hyperspectral Image Super-Resolution

Remote Sensing Hyperspectral Image Super-Resolution via Multidomain Spatial Information and Multiscale Spectral Information Fusion

Multiscale Spatial Fusion and Regularization Induced Unsupervised Auxiliary Task CNN Model for Deep Super-Resolution of Hyperspectral Images

Super-Resolution for Hyperspectral Remote Sensing Images Based on the 3D Attention-SRGAN Network

Hyperspectral Image Super-Resolution Based on Spatial-Spectral Feature Extraction Network

Hyperspectral Image Super-Resolution via Dual-domain Network Based on Hybrid Convolution

Multiscale Densely Connected Attention Network for Hyperspectral Image Classification

Hyperspectral Image Super-resolution via Deep Spatio-spectral Convolutional Neural Networks

Progressive Spatial Information-Guided Deep Aggregation Convolutional Network for Hyperspectral Spectral Super-Resolution