Spectral-Fidelity Convolutional Neural Networks for Hyperspectral Pansharpening

Lin He,Jiawei Zhu,Jun Li,Deyu Meng,Jocelyn Chanussot,Antonio J. Plaza
DOI: https://doi.org/10.1109/jstars.2020.3025040
IF: 4.715
2020-01-01
IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
Abstract:Hyperspectral (HS) pansharpening aims at fusing a low-resolution HS (LRHS) image with a panchromatic image to obtain a full-resolution HS image. Most of the existing HS pansharpening approaches are usually based on traditional multispectral pansharpening techniques, which are not especially tailored for two inherent challenges of the HS pansharpening, i.e., much wider spectral range gap between the two kinds of images and having to recover details in many continuous spectral bands simultaneously. In this article, we develop new spectral-fidelity convolutional neural networks (called HSpeNets) for HS pansharpening to keep the fidelity of a pansharpened image to its true spectra as much as possible. Our methods particularly focus on the decomposability of HS details, accordingly synthesizing these details progressively, and meanwhile introduce a spectral-fidelity loss. We give theoretical justifications and provide detailed experimental results, showing the superiorities of the proposed HSpeNets with regard to other state-of-the-art pansharpening approaches.
What problem does this paper attempt to address?