Abstract:Current research on the reconstruction of hyperspectral images from RGB images using deep learning mainly focuses on learning complex mappings through deeper and wider convolutional neural networks (CNNs). However, the reconstruction accuracy of the hyperspectral image is not high and among other issues the model for generating these images takes up too much storage space. In this study, we propose the double ghost convolution attention mechanism network (DGCAMN) framework for the reconstruction of a single RGB image to improve the accuracy of spectral reconstruction and reduce the storage occupied by the model. The proposed DGCAMN consists of a double ghost residual attention block (DGRAB) module and optimal nonlocal block (ONB). DGRAB module uses GhostNet and PRELU activation functions to reduce the calculation parameters of the data and reduce the storage size of the generative model. At the same time, the proposed double output feature Convolutional Block Attention Module (DOFCBAM) is used to capture the texture details on the feature map to maximize the content of the reconstructed hyperspectral image. In the proposed ONB, the Argmax activation function is used to obtain the region with the most abundant feature information and maximize the most useful feature parameters. This helps to improve the accuracy of spectral reconstruction. These contributions enable the DGCAMN framework to achieve the highest spectral accuracy with minimal storage consumption. The proposed method has been applied to the NTIRE 2020 dataset. Experimental results show that the proposed DGCAMN method outperforms the spectral accuracy reconstructed by advanced deep learning methods and greatly reduces storage consumption.

Data-driven framework for high-accuracy color restoration of RGBN multispectral filter array sensors under extremely low-light conditions.

Fast non-iterative blind restoration of hyperspectral images with PSFs

Image restoration for real-world under-display imaging

Multispectral Fusion of RGB and NIR Images Using Weighted Least Squares and Convolution Neural Networks

HSCNN+: Advanced CNN-Based Hyperspectral Recovery from RGB Images

Hsvcnn: Cnn-Based Hyperspectral Reconstruction From Rgb Videos

DARK: Denoising, Amplification, Restoration Kit

Double Ghost Convolution Attention Mechanism Network: A Framework for Hyperspectral Reconstruction of a Single RGB Image

Abandoning the Bayer-Filter to See in the Dark

Restoration and enhancement on low exposure raw images by joint demosaicing and denoising

TSN-CA: A Two-Stage Network with Channel Attention for Low-Light Image Enhancement

A Dual Sensor Computational Camera for High Quality Dark Videography

A Restoration Scheme for Spatial and Spectral Resolution of the Panchromatic Image Using the Convolutional Neural Network

Low-Light Image Restoration With Short- and Long-Exposure Raw Pairs

Near-Infrared Image Guided Neural Networks For Color Image Denoising

Super-Pixel Guided Low-Light Images Enhancement with Features Restoration

Transfer Learning for Spectral Image Reconstruction from RGB Images

DarkVisionNet: Low-Light Imaging via RGB-NIR Fusion with Deep Inconsistency Prior

Low-light Image Enhancement Network Based on Multi-Stream Information Supplement

Underwater Hyperspectral Image Recovery Based on a Single Chromatic Aberration Blur Image Using Deep Learning

Advanced RetinexNet: A fully convolutional network for low-light image enhancement