Abstract:Fusion-based spectral super-resolution aims to yield a high-resolution hyperspectral image (HR-HSI) by integrating the available high-resolution multispectral image (HR-MSI) with the corresponding low-resolution hyperspectral image (LR-HSI). With the prosperity of deep convolutional neural networks, plentiful fusion methods have made breakthroughs in reconstruction performance promotions. Nevertheless, due to inadequate and improper utilization of cross-modality information, the most current state-of-the-art (SOTA) fusion-based methods cannot produce very satisfactory recovery quality and only yield desired results with a small upsampling scale, thus affecting the practical applications. In this article, we propose a novel progressive spatial information-guided deep aggregation convolutional neural network (SIGnet) for enhancing the performance of hyperspectral image (HSI) spectral super-resolution (SSR), which is decorated through several dense residual channel affinity learning (DRCA) blocks cooperating with a spatial-guided propagation (SGP) module as the backbone. Specifically, the DRCA block consists of an encoding part and a decoding part connected by a channel affinity propagation (CAP) module and several cross-layer skip connections. In detail, the CAP module is customized by exploiting the channel affinity matrix to model correlations among channels of the feature maps for aggregating the channel-wise interdependencies of the middle layers, thereby further boosting the reconstruction accuracy. Additionally, to efficiently utilize the two cross-modality information, we developed an innovative SGP module equipped with a simulation of the degradation part and a deformable adaptive fusion part, which is capable of refining the coarse HSI feature maps at pixel-level progressively. Extensive experimental results demonstrate the superiority of our proposed SIGnet over several SOTA fusion-based algorithms.

Separable-spectral convolution and inception network for hyperspectral image super-resolution

Deep Networks with Detail Enhancement for Infrared Image Super-Resolution

Hyperspectral Image Super-Resolution via Dual-domain Network Based on Hybrid Convolution

Hyperspectral Image Super-Resolution via Intrafusion Network

Hyperspectral Image Super-resolution via Deep Spatio-spectral Convolutional Neural Networks

Hyperspectral Image Super-Resolution via Deep Spatiospectral Attention Convolutional Neural Networks

Remote Sensing Hyperspectral Image Super-Resolution via Multidomain Spatial Information and Multiscale Spectral Information Fusion

Diffused Convolutional Neural Network for Hyperspectral Image Super-Resolution

Spectral Response Function-Guided Deep Optimization-Driven Network for Spectral Super-Resolution

Progressive Spatial Information-Guided Deep Aggregation Convolutional Network for Hyperspectral Spectral Super-Resolution

Hyperspectral Image Joint Super-Resolution via Local Implicit Spatial-Spectral Function Learning

Deep Residual Attention Network For Spectral Image Super-Resolution

Hyperspectral Image Superresolution via Deep Structure and Texture Interfusion

Multi-Task Interaction Learning for Spatiospectral Image Super-Resolution.

A Spectral Grouping and Attention-Driven Residual Dense Network for Hyperspectral Image Super-Resolution

Hyperspectral Image Super-Resolution with Self-Supervised Spectral-Spatial Residual Network

Spectral Super-Resolution via Model-Guided Cross-Fusion Network

An Efficient Residual Learning Neural Network for Hyperspectral Image Superresolution

A hyperspectral image denoising method based on land cover spectral autocorrelation

HASN: Hybrid Attention Separable Network for Efficient Image Super-resolution

Spatial-spectral dual path hyperspectral image super-resolution reconstruction network based on spectral response functions