Abstract:Hyperspectral (HS) imaging is conducive to better describing and understanding the subtle differences in spectral characteristics of different materials due to sufficient spectral information compared with traditional imaging systems. However, it is still challenging to obtain high resolution (HR) HS images in both the spectral and spatial domains. Different from previous methods, we first propose spectral constrained adversarial autoencoder (SCAAE) to extract deep features of HS images and combine with the panchromatic (PAN) image to competently represent the spatial information of HR HS images, which is more comprehensive and representative. In particular, based on the adversarial autoencoder (AAE) network, the SCAAE network is built with the added spectral constraint in the loss function so that spectral consistency and a higher quality of spatial information enhancement can be ensured. Then, an adaptive fusion approach with a simple feature selection rule is induced to make full use of the spatial information contained in both the HS image and PAN image. Specifically, the spatial information from two different sensors is introduced into a convex optimization equation to obtain the fusion proportion of the two parts and estimate the generated HR HS image. By analyzing the results from the experiments executed on the tested data sets through different methods, it can be found that, in CC, SAM, and RMSE, the performance of the proposed algorithm is improved by about 1.42%, 13.12%, and 29.26% respectively on average which is preferable to the well-performed method HySure. Compared to the MRA-based method, the improvement of the proposed method in in the above three indexes is 17.63%, 0.83%, and 11.02%, respectively. Moreover, the results are 0.87%, 22.11%, and 20.66%, respectively, better than the PCA-based method, which fully illustrated the superiority of the proposed method in spatial information preservation. All the experimental results demonstrate that the proposed method is superior to the state-of-the-art fusion methods in terms of subjective and objective evaluations.

Fusion of Hyperspectral and Panchromatic Images Using Generative Adversarial Network and Image Segmentation

Hyperspectral and Multispectral Image Fusion Based on Deep Attention Network.

Fusion of Hyperspectral and Panchromatic Images Using an Average Filter and a Guided Filter.

Hyperspectral and Panchromatic Image Fusion Via Adaptive Tensor and Multi-Scale Retinex Algorithm

Unmixing based PAN guided fusion network for hyperspectral imagery

Fusion of Hyperspectral and Multispectral Images: A Novel Framework Based on Generalization of Pan-Sharpening Methods

HPGAN: Hyperspectral Pansharpening Using 3-D Generative Adversarial Networks

Fusion of Hyperspectral and Panchromatic Images with Guided Filter

Hyperspectral pansharpening via improved PCA approach and optimal weighted fusion strategy.

FUSION OF HYPERSPECTRAL AND PANCHROMATIC IMAGES BASED ON MATTING MODEL

HyperNet: A Deep Network for Hyperspectral, Multispectral, and Panchromatic Image Fusion

HyperFusion: A Computational Approach for Hyperspectral, Multispectral, and Panchromatic Image Fusion

Fusion of Multispectral and Panchromatic Images Based on a Novel Inter-Band Structure Model

Structure Tensor-Based Algorithm for Hyperspectral and Panchromatic Images Fusion.

Pan-GAN: An unsupervised pan-sharpening method for remote sensing image fusion

Multispectral And Panchromatic Images Fusion Based On Nsct And Gs Transform

Hyperspectral and Panchromatic Image Fusion Through an Improved Ratio Enhancement

Hyperspectral Image Fusion Based on Multistage Guided Filter

Coupled Spatial-Spectral Constrained Convolutional Fusion Network for Hyperspectral and Panchromatic images

Hyperspectral Pansharpening Based on Spectral Constrained Adversarial Autoencoder

Hyperspectral Image Fusion Via Sc- NMF