Remote Sensing Hyperspectral Image Super-Resolution via Multidomain Spatial Information and Multiscale Spectral Information Fusion
Chi Chen,Yongcheng Wang,Yuxi Zhang,Zhikang Zhao,Hao Feng
DOI: https://doi.org/10.1109/tgrs.2024.3388531
IF: 8.2
2024-04-27
IEEE Transactions on Geoscience and Remote Sensing
Abstract:Hyperspectral image (HSI) super-resolution (SR) technology has made remarkable progress due to the development of deep learning (DL). However, the technique still faces two challenges, i.e., the imbalance between spectral and spatial information extraction, and the parameter deviation and high computational effort associated with 3-D convolution. In this article, we propose an SR method for remote sensing HSIs based on multidomain spatial information and multiscale spectral information fusion (MSSR). Specifically, inspired by the high degree of self-similarity of remote sensing HSIs, a spatial–spectral attention module based on dilated convolution (DSSA) for capturing global spatial information is proposed. The extraction of local spatial information is then accomplished by residual blocks using small-size convolution kernels. Meanwhile, we propose the 3-D inception module to efficiently mine multiscale spectral information. The module only retains the scale of the 3-D convolution kernel in spectral dimension, which greatly reduces the high computational cost caused by 3-D convolution. Comparative experimental results on four benchmark datasets demonstrate that compared with the current cutting-edge models, our method achieves state-of-the-art (SOTA) results and the model computation is greatly reduced.
imaging science & photographic technology,remote sensing,engineering, electrical & electronic,geochemistry & geophysics