Abstract:Fusion-based spectral super-resolution aims to yield a high-resolution hyperspectral image (HR-HSI) by integrating the available high-resolution multispectral image (HR-MSI) with the corresponding low-resolution hyperspectral image (LR-HSI). With the prosperity of deep convolutional neural networks, plentiful fusion methods have made breakthroughs in reconstruction performance promotions. Nevertheless, due to inadequate and improper utilization of cross-modality information, the most current state-of-the-art (SOTA) fusion-based methods cannot produce very satisfactory recovery quality and only yield desired results with a small upsampling scale, thus affecting the practical applications. In this article, we propose a novel progressive spatial information-guided deep aggregation convolutional neural network (SIGnet) for enhancing the performance of hyperspectral image (HSI) spectral super-resolution (SSR), which is decorated through several dense residual channel affinity learning (DRCA) blocks cooperating with a spatial-guided propagation (SGP) module as the backbone. Specifically, the DRCA block consists of an encoding part and a decoding part connected by a channel affinity propagation (CAP) module and several cross-layer skip connections. In detail, the CAP module is customized by exploiting the channel affinity matrix to model correlations among channels of the feature maps for aggregating the channel-wise interdependencies of the middle layers, thereby further boosting the reconstruction accuracy. Additionally, to efficiently utilize the two cross-modality information, we developed an innovative SGP module equipped with a simulation of the degradation part and a deformable adaptive fusion part, which is capable of refining the coarse HSI feature maps at pixel-level progressively. Extensive experimental results demonstrate the superiority of our proposed SIGnet over several SOTA fusion-based algorithms.

Frequency-Spatial Domain Feature Fusion for Spectral Super-Resolution

Lightweight Multi-Attention Fusion Network for Image Super-Resolution

Spectral Super-Resolution via Model-Guided Cross-Fusion Network

Multistage Spatial-Spectral Fusion Network for Spectral Super-Resolution

Pixel-aware Deep Function-mixture Network for Spectral Super-Resolution

SSF-CNN: Spatial and Spectral Fusion with CNN for Hyperspectral Image Super-Resolution

SSR-NET: Spatial–Spectral Reconstruction Network for Hyperspectral and Multispectral Image Fusion

Local–Global Feature Fusion Network for Efficient Hyperspectral Image Super-Resolution

Spectral Superresolution Using Transformer with Convolutional Spectral Self-Attention

Remote Sensing Hyperspectral Image Super-Resolution via Multidomain Spatial Information and Multiscale Spectral Information Fusion

Progressive Spatial Information-Guided Deep Aggregation Convolutional Network for Hyperspectral Spectral Super-Resolution

Efficient Adaptive Feature Fusion Network for Remote-Sensing Image Super-Resolution

A High-Frequency Focused Network for Lightweight Single Image Super-Resolution

Hyperspectral Image Super-Resolution with Self-Supervised Spectral-Spatial Residual Network

Lightweight Feature Fusion Network for Single Image Super-Resolution

Hyperspectral Image Super-Resolution via Dual-domain Network Based on Hybrid Convolution

Two-Stage Spatial-Frequency Joint Learning for Large-Factor Remote Sensing Image Super-Resolution

Spectral Response Function-Guided Deep Optimization-Driven Network for Spectral Super-Resolution

Frequency Reciprocal Action and Fusion for Single Image Super-Resolution

SFHN: Spatial-Frequency Domain Hybrid Network for Image Super-Resolution

DCT-FANet: DCT based frequency attention network for single image super-resolution