Abstract:Spectral super-resolution, which reconstructs a hyperspectral image (HSI) from a single red-green-blue (RGB) image, has acquired more and more attention. Recently, convolution neural networks (CNNs) have achieved promising performance. However, they often fail to simultaneously exploit the imaging model of the spectral super-resolution and complex spatial and spectral characteristics of the HSI. To tackle the above problems, we build a novel cross fusion (CF)-based model-guided network (called SSRNet) for spectral super-resolution. In specific, based on the imaging model, we unfold the spectral super-resolution into the HSI prior learning (HPL) module and imaging model guiding (IMG) module. Instead of just modeling one kind of image prior, the HPL module is composed of two subnetworks with different structures, which can effectively learn the complex spatial and spectral priors of the HSI, respectively. Furthermore, a CF strategy is used to establish the connection between the two subnetworks, which further improves the learning performance of the CNN. The IMG module results in solving a strong convex optimization problem, which adaptively optimizes and merges the two features learned by the HPL module by exploiting the imaging model. The two modules are alternately connected to achieve optimal HSI reconstruction performance. Experiments on both the simulated and real data demonstrate that the proposed method can achieve superior spectral reconstruction results with relatively small model size. The code will be available at https://github.com/renweidian.

HSCNN+: Advanced CNN-Based Hyperspectral Recovery from RGB Images

HSCNN: CNN-Based Hyperspectral Image Recovery from Spectrally Undersampled Projections

Fast non-iterative blind restoration of hyperspectral images with PSFs

Residual HSRCNN: Residual Hyper-Spectral Reconstruction CNN from an RGB Image

Convolutional Neural Network Based Computational Imaging Spectroscopy

Hsvcnn: Cnn-Based Hyperspectral Reconstruction From Rgb Videos

HSI-CNN: A Novel Convolution Neural Network for Hyperspectral Image

Diffused Convolutional Neural Network for Hyperspectral Image Super-Resolution

Cluster-based deep convolutional networks for spectral reconstruction from RGB images

Random Convolutional Network for Hyperspectral Image Classification.

Spectral Super-Resolution via Model-Guided Cross-Fusion Network

Spatial-spectral convolutional sparse neural network for hyperspectral image denoising

Nonlocal Spatial–Spectral Neural Network for Hyperspectral Image Denoising

SSF-CNN: Spatial and Spectral Fusion with CNN for Hyperspectral Image Super-Resolution

HSI-DeNet: Hyperspectral Image Restoration via Convolutional Neural Network

Hyperspectral Image Compression Sensing Network With CNN–Transformer Mixture Architectures

Deep-learning-based hyperspectral imaging through a RGB camera

Hyperspectral image restoration via CNN denoiser prior regularized low-rank tensor recovery

Hyperspectral Image Super-Resolution via Deep Spatiospectral Attention Convolutional Neural Networks

An Efficient Residual Learning Neural Network for Hyperspectral Image Superresolution

Coarse-Fine Spectral-Aware Deformable Convolution For Hyperspectral Image Reconstruction