Hyperspectral Compressive Image Reconstruction With Deep Tucker Decomposition and Spatial–Spectral Learning Network
Hao Xiang,Baozhu Li,Le Sun,Yuhui Zheng,Zebin Wu,Jianwei Zhang,Byeungwoo Jeon
DOI: https://doi.org/10.1109/jstars.2022.3229761
IF: 4.715
2022-12-31
IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
Abstract:Hyperspectral compressive imaging has taken advantage of compressive sensing theory to capture spectral information of the dynamic world in recent decades of years, where an optical encoder is employed to compress high dimensional signals into a single 2-D measurement. The core issue is how to reconstruct the underlying hyperspectral image (HSI), although deep neural network methods have achieved much success in compressed sensing image reconstruction in recent years, they still have some unsolved issues, such as tradeoffs between performance and efficiency, and accurate exploitation of cubic structure information. In this article, we propose a deep Tucker decomposition and spatial–spectral learning network (DS-net) to learn the tensor low-lank structure features and spatial–spectral correlation of HSI for reconstruction quality promotion. Inspired by tensor decomposition, we first construct a deep Tucker decomposition module to learn the principal components from different modes of the image features. Then, we cascade a series of decomposition modules to learn multihierarchical features. Furthermore, to jointly capture the spatial–spectral correlation of HSI, we propose a spatial–spectral correlation learning module in a U-net structure for more robust reconstruction performance. Finally, experimental results on both synthetic and real datasets demonstrate the superiority of the proposed method compared to several state-of-the-art methods in quantitative assessment and visual effects.
imaging science & photographic technology,remote sensing,engineering, electrical & electronic,geography, physical