Abstract:Fusion-based spectral super-resolution aims to yield a high-resolution hyperspectral image (HR-HSI) by integrating the available high-resolution multispectral image (HR-MSI) with the corresponding low-resolution hyperspectral image (LR-HSI). With the prosperity of deep convolutional neural networks, plentiful fusion methods have made breakthroughs in reconstruction performance promotions. Nevertheless, due to inadequate and improper utilization of cross-modality information, the most current state-of-the-art (SOTA) fusion-based methods cannot produce very satisfactory recovery quality and only yield desired results with a small upsampling scale, thus affecting the practical applications. In this article, we propose a novel progressive spatial information-guided deep aggregation convolutional neural network (SIGnet) for enhancing the performance of hyperspectral image (HSI) spectral super-resolution (SSR), which is decorated through several dense residual channel affinity learning (DRCA) blocks cooperating with a spatial-guided propagation (SGP) module as the backbone. Specifically, the DRCA block consists of an encoding part and a decoding part connected by a channel affinity propagation (CAP) module and several cross-layer skip connections. In detail, the CAP module is customized by exploiting the channel affinity matrix to model correlations among channels of the feature maps for aggregating the channel-wise interdependencies of the middle layers, thereby further boosting the reconstruction accuracy. Additionally, to efficiently utilize the two cross-modality information, we developed an innovative SGP module equipped with a simulation of the degradation part and a deformable adaptive fusion part, which is capable of refining the coarse HSI feature maps at pixel-level progressively. Extensive experimental results demonstrate the superiority of our proposed SIGnet over several SOTA fusion-based algorithms.

Global priors guided modulation network for joint super-resolution and SDRTV-to-HDRTV

Beyond Feature Mapping GAP: Integrating Real HDRTV Priors for Superior SDRTV-to-HDRTV Conversion

Towards Efficient SDRTV-to-HDRTV by Learning from Image Formation

A New Journey from SDRTV to HDRTV

SCSNet: an Efficient Paradigm for Learning Simultaneously Image Colorization and Super-resolution

Compressed-SDR to HDR Video Reconstruction.

Single Remote Sensing Image Super-Resolution Via a Generative Adversarial Network with Stratified Dense Sampling and Chain Training

Hyperspectral Reconstruction From RGB Images via Physically Guided Graph Deep Prior Learning

Progressive Spatial Information-Guided Deep Aggregation Convolutional Network for Hyperspectral Spectral Super-Resolution

A multi-color and multistage collaborative network guided by refined transmission prior for underwater image enhancement

Memory-augmented Deep Unfolding Network for Guided Image Super-resolution

Learning a Practical SDR-to-HDRTV Up-conversion using New Dataset and Degradation Models

DVSRNet: Deep Video Super-Resolution Based on Progressive Deformable Alignment and Temporal-Sparse Enhancement

FastHDRNet: A new efficient method for SDR-to-HDR Translation

Towards Robust SDRTV-to-HDRTV via Dual Inverse Degradation Network

Dual Inverse Degradation Network for Real-World SDRTV-to-HDRTV Conversion

Multi-Frame Content-Aware Mapping Network for Standard-Dynamic-Range to High-Dynamic-Range Television Artifact Removal

A Robust Quality Enhancement Method Based on Joint Spatial-Temporal Priors for Video Coding

Dual-Streams Edge Driven Encoder-Decoder Network for Image Super-Resolution.

Position-Guided Multi-Head Alignment and Fusion for Video Super-Resolution

Spherical Space Feature Decomposition for Guided Depth Map Super-Resolution