Abstract:Fusion-based spectral super-resolution aims to yield a high-resolution hyperspectral image (HR-HSI) by integrating the available high-resolution multispectral image (HR-MSI) with the corresponding low-resolution hyperspectral image (LR-HSI). With the prosperity of deep convolutional neural networks, plentiful fusion methods have made breakthroughs in reconstruction performance promotions. Nevertheless, due to inadequate and improper utilization of cross-modality information, the most current state-of-the-art (SOTA) fusion-based methods cannot produce very satisfactory recovery quality and only yield desired results with a small upsampling scale, thus affecting the practical applications. In this article, we propose a novel progressive spatial information-guided deep aggregation convolutional neural network (SIGnet) for enhancing the performance of hyperspectral image (HSI) spectral super-resolution (SSR), which is decorated through several dense residual channel affinity learning (DRCA) blocks cooperating with a spatial-guided propagation (SGP) module as the backbone. Specifically, the DRCA block consists of an encoding part and a decoding part connected by a channel affinity propagation (CAP) module and several cross-layer skip connections. In detail, the CAP module is customized by exploiting the channel affinity matrix to model correlations among channels of the feature maps for aggregating the channel-wise interdependencies of the middle layers, thereby further boosting the reconstruction accuracy. Additionally, to efficiently utilize the two cross-modality information, we developed an innovative SGP module equipped with a simulation of the degradation part and a deformable adaptive fusion part, which is capable of refining the coarse HSI feature maps at pixel-level progressively. Extensive experimental results demonstrate the superiority of our proposed SIGnet over several SOTA fusion-based algorithms.

Blind Spectral Super-Resolution by Estimating Spectral Degradation Between Unpaired Images

SBHSR: single-band super-resolution method for hyperspectral images based on blind degradation and fusion of auxiliary band

Blind Super-Resolution of Single Remotely Sensed Hyperspectral Image

Single Remote Sensing Image Super-Resolution Via a Generative Adversarial Network with Stratified Dense Sampling and Chain Training

Blind Super-Resolution for SAR Images with Speckle Noise Based on Deep Learning Probabilistic Degradation Model and SAR Priors

Large-Factor Super-Resolution of Remote Sensing Images With Spectra-Guided Generative Adversarial Networks

Hyperspectral Reconstruction From RGB Images via Physically Guided Graph Deep Prior Learning

Spectral Response Function-Guided Deep Optimization-Driven Network for Spectral Super-Resolution

A Latent Encoder Coupled Generative Adversarial Network (LE-GAN) for Efficient Hyperspectral Image Super-resolution

Deep Unsupervised Blind Hyperspectral and Multispectral Data Fusion

Hyperspectral Image Super-Resolution via Deep Spatiospectral Attention Convolutional Neural Networks

Super-Resolution for Hyperspectral Remote Sensing Images Based on the 3D Attention-SRGAN Network

Progressive split-merge super resolution for hyperspectral imagery with group attention and gradient guidance

EigenSR: Eigenimage-Bridged Pre-Trained RGB Learners for Single Hyperspectral Image Super-Resolution

R2D2-GAN: Robust Dual Discriminator Generative Adversarial Network for Microscopy Hyperspectral Image Super-Resolution

Hyperspectral image super-resolution via a multi-stage scheme without employing spatial degradation

Attention-Enhanced Generative Adversarial Network for Hyperspectral Imagery Spatial Super-Resolution

Hyperspectral Image Super-resolution via Deep Spatio-spectral Convolutional Neural Networks

Spectral Super-Resolution via Model-Guided Cross-Fusion Network

Progressive Spatial Information-Guided Deep Aggregation Convolutional Network for Hyperspectral Spectral Super-Resolution

Model-Guided Deep Hyperspectral Image Super-Resolution