Abstract:Hyperspectral imagery contains both spatial structure information and abundant spectral features of imaged objects. However, due to sensor limitations, abundant spectral information always comes at the sacrifice of low spatial resolution, which brings about difficulties with object analysis and identification. The super-resolution (SR) of HSIs, restored by the traditional interpolation algorithms or the network models trained with the mean-square-error-based loss function, tends to produce over-smoothed images. In this paper, we propose a novel Hyperspectral imagery Spatial Super-Resolution algorithm based on a Generative Adversarial Network (HSSRGAN). The generator network in HSSRGAN consists of two interacting part, i.e., a spatial feature enhanced network (SFEN) and a spectral refined network (SRN), while the discriminator network is employed to predict the probability that the authentic HR image is comparatively more similar than the forged generated image. Concretely, SFEN with the special dense residual blocks is designed to fully extract and enhance more deep hierarchical spatial features of hyperspectral imagery, while SRN is constructed to capture spectral interrelationships and refine the spatial context information so as to increase spatial resolution and alleviate spectral distortion. Moreover, SFEN and SRN are trained by the least-absolute-deviation based loss function to investigate spatial context and the spectral-angle-mapper based loss function to refine spectral information. We validate two versions of our proposed algorithm, 3D-HSSRGAN and 2D-HSSRGAN, on Pavia Centre dataset and Cuprite dataset. Experimental results show that the presented approach is superior to several existing state-of-the-art works.

HYPERSPECTRAL IMAGE SUPER-RESOLUTION EXTENDING: AN EFFECTIVE FUSION BASED METHOD WITHOUT KNOWING THE SPATIAL TRANSFORMATION MATRIX

Hyperspectral Image Super-Resolution Based on Spatial and Spectral Correlation Fusion

Hyperspectral Image Super-Resolution Via Deep Prior Regularization with Parameter Estimation

U-Shape Spectral-Transformer for Robust Fusion Based Hyperspectral Super-Resolution

HYPERSPECTRAL AND MULTISPECTRAL IMAGE FUSION USING DUAL-SOURCE LOCALIZED DICTIONARY PAIR

Hyperspectral Imagery Spatial Super-Resolution Using Generative Adversarial Network.

A spectral and spatial transformer for hyperspectral remote sensing image super-resolution

Hyperspectral Image Super Resolution Reconstruction with a Joint Spectral-Spatial Sub-Pixel Mapping Model.

Optimization-Based Hyperspectral Spatiotemporal Super-Resolution

Hierarchical Spatio-Spectral Fusion for Hyperspectral Image Super Resolution Via Sparse Representation and Pre-Trained Deep Model

Image Fusion for Spatial Enhancement of Hyperspectral Image via Pixel Group Based Non-Local Sparse Representation

Unsupervised Deep Hyperspectral Super-Resolution with Unregistered Images

Hyperspectral Image Super-Resolution under Misaligned Hybrid Camera System.

Remote Sensing Hyperspectral Image Super-Resolution via Multidomain Spatial Information and Multiscale Spectral Information Fusion

Hyperspectral Image Super-Resolution Using Deep Feature Matrix Factorization

Deep Intra Fusion for Hyperspectral Image Super-Resolution

Adaptive Nonnegative Sparse Representation for Hyperspectral Image Super-Resolution

Hyperspectral Super-Resolution: A Coupled Tensor Factorization Approach

Spectral Super-Resolution Based On Matrix Factorization And Spectral Dictionary

Unsupervised Recurrent Hyperspectral Imagery Super-Resolution Using Pixel-Aware Refinement.

Fast HSI Super Resolution Using Linear Regression