Abstract:Fusion-based spectral super-resolution aims to yield a high-resolution hyperspectral image (HR-HSI) by integrating the available high-resolution multispectral image (HR-MSI) with the corresponding low-resolution hyperspectral image (LR-HSI). With the prosperity of deep convolutional neural networks, plentiful fusion methods have made breakthroughs in reconstruction performance promotions. Nevertheless, due to inadequate and improper utilization of cross-modality information, the most current state-of-the-art (SOTA) fusion-based methods cannot produce very satisfactory recovery quality and only yield desired results with a small upsampling scale, thus affecting the practical applications. In this article, we propose a novel progressive spatial information-guided deep aggregation convolutional neural network (SIGnet) for enhancing the performance of hyperspectral image (HSI) spectral super-resolution (SSR), which is decorated through several dense residual channel affinity learning (DRCA) blocks cooperating with a spatial-guided propagation (SGP) module as the backbone. Specifically, the DRCA block consists of an encoding part and a decoding part connected by a channel affinity propagation (CAP) module and several cross-layer skip connections. In detail, the CAP module is customized by exploiting the channel affinity matrix to model correlations among channels of the feature maps for aggregating the channel-wise interdependencies of the middle layers, thereby further boosting the reconstruction accuracy. Additionally, to efficiently utilize the two cross-modality information, we developed an innovative SGP module equipped with a simulation of the degradation part and a deformable adaptive fusion part, which is capable of refining the coarse HSI feature maps at pixel-level progressively. Extensive experimental results demonstrate the superiority of our proposed SIGnet over several SOTA fusion-based algorithms.

Asymmetric Dual-Direction Quasi-Recursive Network for Single Hyperspectral Image Super-Resolution

Hyperspectral Image Super-Resolution via Dual-domain Network Based on Hybrid Convolution

Hyperspectral Image Super-resolution via Deep Spatio-spectral Convolutional Neural Networks

Neighbor Spectra Maintenance and Context Affinity Enhancement for Single Hyperspectral Image Super-Resolution

Spatial-spectral dual path hyperspectral image super-resolution reconstruction network based on spectral response functions

Exploring the Spectral Prior for Hyperspectral Image Super-Resolution

Difference Curvature Multidimensional Network for Hyperspectral Image Super-Resolution

Hyperspectral Image Super-Resolution via Deep Spatiospectral Attention Convolutional Neural Networks

Progressive Spatial Information-Guided Deep Aggregation Convolutional Network for Hyperspectral Spectral Super-Resolution

Learning Spatial-Spectral Prior for Super-Resolution of Hyperspectral Imagery

An Efficient Residual Learning Neural Network for Hyperspectral Image Superresolution

Unsupervised Across Domain Consistency- Difference Network for Hyperspectral Image Super-Resolution

A Recurrent Feedback Hyperspectral Image Super-Resolution Reconstruction Method by Using Self-Attention-Based Pixel Awareness

Hyperspectral Image Super-Resolution With ConvLSTM Skip-Connections

A Spectral Grouping and Attention-Driven Residual Dense Network for Hyperspectral Image Super-Resolution

Remote Sensing Hyperspectral Image Super-Resolution via Multidomain Spatial Information and Multiscale Spectral Information Fusion

Spectral-Enhanced Sparse Transformer Network for Hyperspectral Super-Resolution Reconstruction

Spectral Super-Resolution via Model-Guided Cross-Fusion Network

Progressive split-merge super resolution for hyperspectral imagery with group attention and gradient guidance

Spatial-Spectral Middle Cross-Attention Fusion Network for Hyperspectral Image Superresolution

Decoupled-and-Coupled Networks: Self-Supervised Hyperspectral Image Super-Resolution With Subpixel Fusion