Abstract:Fusion-based spectral super-resolution aims to yield a high-resolution hyperspectral image (HR-HSI) by integrating the available high-resolution multispectral image (HR-MSI) with the corresponding low-resolution hyperspectral image (LR-HSI). With the prosperity of deep convolutional neural networks, plentiful fusion methods have made breakthroughs in reconstruction performance promotions. Nevertheless, due to inadequate and improper utilization of cross-modality information, the most current state-of-the-art (SOTA) fusion-based methods cannot produce very satisfactory recovery quality and only yield desired results with a small upsampling scale, thus affecting the practical applications. In this article, we propose a novel progressive spatial information-guided deep aggregation convolutional neural network (SIGnet) for enhancing the performance of hyperspectral image (HSI) spectral super-resolution (SSR), which is decorated through several dense residual channel affinity learning (DRCA) blocks cooperating with a spatial-guided propagation (SGP) module as the backbone. Specifically, the DRCA block consists of an encoding part and a decoding part connected by a channel affinity propagation (CAP) module and several cross-layer skip connections. In detail, the CAP module is customized by exploiting the channel affinity matrix to model correlations among channels of the feature maps for aggregating the channel-wise interdependencies of the middle layers, thereby further boosting the reconstruction accuracy. Additionally, to efficiently utilize the two cross-modality information, we developed an innovative SGP module equipped with a simulation of the degradation part and a deformable adaptive fusion part, which is capable of refining the coarse HSI feature maps at pixel-level progressively. Extensive experimental results demonstrate the superiority of our proposed SIGnet over several SOTA fusion-based algorithms.

Spectral Response Function-Guided Deep Optimization-Driven Network for Spectral Super-Resolution

Spectral Super-Resolution via Model-Guided Cross-Fusion Network

Deep Networks with Detail Enhancement for Infrared Image Super-Resolution

Hyperspectral Image Super-Resolution via Deep Spatiospectral Attention Convolutional Neural Networks

Progressive Spatial Information-Guided Deep Aggregation Convolutional Network for Hyperspectral Spectral Super-Resolution

Hyperspectral Image Super-Resolution with Self-Supervised Spectral-Spatial Residual Network

A Spectral Grouping and Attention-Driven Residual Dense Network for Hyperspectral Image Super-Resolution

Hyperspectral Image Super-resolution via Deep Spatio-spectral Convolutional Neural Networks

Spectral Superresolution Using Transformer with Convolutional Spectral Self-Attention

Learning Spatial-Spectral Prior for Super-Resolution of Hyperspectral Imagery

Remote Sensing Hyperspectral Image Super-Resolution via Multidomain Spatial Information and Multiscale Spectral Information Fusion

Diffused Convolutional Neural Network for Hyperspectral Image Super-Resolution

A Super-Resolution Algorithm Based on Hybrid Network for Multi-Channel Remote Sensing Images

Hyperspectral Image Super-Resolution via Dual-domain Network Based on Hybrid Convolution

Hyperspectral Reconstruction From RGB Images via Physically Guided Graph Deep Prior Learning

Pixel-aware Deep Function-mixture Network for Spectral Super-Resolution

Spectral super-resolution meets deep learning: Achievements and challenges

Nonlocal Spatial–Spectral Neural Network for Hyperspectral Image Denoising

An Efficient Residual Learning Neural Network for Hyperspectral Image Superresolution

Spatial-spectral dual path hyperspectral image super-resolution reconstruction network based on spectral response functions

Deep Residual Attention Network For Spectral Image Super-Resolution