Abstract:Hyperspectral imagery contains both spatial structure information and abundant spectral features of imaged objects. However, due to sensor limitations, abundant spectral information always comes at the sacrifice of low spatial resolution, which brings about difficulties with object analysis and identification. The super-resolution (SR) of HSIs, restored by the traditional interpolation algorithms or the network models trained with the mean-square-error-based loss function, tends to produce over-smoothed images. In this paper, we propose a novel Hyperspectral imagery Spatial Super-Resolution algorithm based on a Generative Adversarial Network (HSSRGAN). The generator network in HSSRGAN consists of two interacting part, i.e., a spatial feature enhanced network (SFEN) and a spectral refined network (SRN), while the discriminator network is employed to predict the probability that the authentic HR image is comparatively more similar than the forged generated image. Concretely, SFEN with the special dense residual blocks is designed to fully extract and enhance more deep hierarchical spatial features of hyperspectral imagery, while SRN is constructed to capture spectral interrelationships and refine the spatial context information so as to increase spatial resolution and alleviate spectral distortion. Moreover, SFEN and SRN are trained by the least-absolute-deviation based loss function to investigate spatial context and the spectral-angle-mapper based loss function to refine spectral information. We validate two versions of our proposed algorithm, 3D-HSSRGAN and 2D-HSSRGAN, on Pavia Centre dataset and Cuprite dataset. Experimental results show that the presented approach is superior to several existing state-of-the-art works.

CCC-SSA-UNet: U-Shaped Pansharpening Network with Channel Cross-Concatenation and Spatial-Spectral Attention Mechanism for Hyperspectral Image Super-Resolution

SSETPAN: Spatial-Spectral Enhanced Transformer Based Network for Pansharpening

Hyperspectral Image Super-Resolution with 1D-2D Attentional Convolutional Neural Network.

Hyperspectral Imagery Spatial Super-Resolution Using Generative Adversarial Network.

Cross Spectral and Spatial Scale Non-local Attention-Based Unsupervised Pansharpening Network

Hybrid Attention-Based U-Shaped Network for Remote Sensing Image Super-Resolution.

Hyperspectral Image Super-Resolution Network Based on Cross-Scale Nonlocal Attention.

Spectral-Spatial Interaction Network for Multispectral Image and Panchromatic Image Fusion

Cross-Attention in Coupled Unmixing Nets for Unsupervised Hyperspectral Super-Resolution

A Dual-UNet With Multistage Details Injection for Hyperspectral Image Fusion

Multispectral Pan-sharpening via Dual-Channel Convolutional Network with Convolutional LSTM Based Hierarchical Spatial-Spectral Feature Fusion

Structure–Color Preserving Network for Hyperspectral Image Super-Resolution

SSCAConv: Self-Guided Spatial-Channel Adaptive Convolution for Image Fusion

A Deep-Shallow Fusion Network With Multidetail Extractor and Spectral Attention for Hyperspectral Pansharpening

A Unified Two-Stage Spatial and Spectral Network with Few-Shot Learning for Pansharpening.

SSconv

A Unified Two-Stage Spatial and Spectral Network With Few-Shot Learning for Pan-Sharpening

Spectral-Fidelity Convolutional Neural Networks for Hyperspectral Pansharpening

Unsupervised Pansharpening Method Using Residual Network with Spatial Texture Attention.

CNN-Based Hyperspectral Pansharpening With Arbitrary Resolution

Detail Information Prior Net for Remote Sensing Image Pansharpening