Abstract:Hyperspectral images are a valuable tool for remotely sensing important characteristics of a variety of landscapes, including water quality and the status of marine disasters. However, hyperspectral data are rare or expensive to obtain, which has spurred interest in low-cost, fast methods for reconstructing hyperspectral data from much more common RGB images. We designed a novel algorithm to achieve this goal using multi-scale atrous convolution residual network (MACRN). The algorithm includes three parts: low-level feature extraction, high-level feature extraction, and feature transformation. The high-level feature extraction module is composed of cascading multi-scale atrous convolution residual blocks (ACRB). It stacks multiple modules to form a depth network for extracting high-level features from the RGB image used as an input. The algorithm uses jump connection for residual learning, and the final high-level feature combines the output of the low-level feature extraction module and the output of the cascaded atrous convolution residual block element by element, so as to prevent gradient dispersion and gradient explosion in the deep network. Without adding too many parameters, the model can extract multi-scale features under different receptive fields, make better use of the spatial information in RGB images, and enrich the contextual information. As a proof of concept, we ran an experiment using the algorithm to reconstruct hyperspectral Sentinel-2 satellite data from the northern coast of Australia. The algorithm achieves hyperspectral spectral reconstruction in 443nm-2190nm band with less computational cost, and the results are stable. On the Realworld dataset, the reconstruction error MARE index is less than 0.0645, and the reconstruction time is less than 9.24S. Therefore, in the near infrared band, MACRN reconstruction accuracy is significantly better than other spectral reconstruction algorithms. MACRN hyperspectral reconstruction algorithm has the characteristics of low reconstruction cost and high reconstruction accuracy, and its advantages in ocean spectral reconstruction are more obvious.

Reconstruction hyperspectral reflectance cube based on artificial neural networks for multispectral imaging system applied to dermatology

Convolutional Neural Network Based Computational Imaging Spectroscopy

Hyperspectral imaging with deep learning for quantification of tissue hemoglobin, melanin, and scattering

A novel hybrid artificial neural network technique for the early skin cancer diagnosis using color space conversions of original images

Acne Detection Based on Reconstructed Hyperspectral Images

Deep learning approach for hyperspectral image demosaicking, spectral correction and high-resolution RGB reconstruction

An Unsupervised Multispectral Image Registration Network for Skin Diseases

Deep-Learning-Based Multispectral Image Reconstruction from Single Natural Color RGB Image - Enhancing UAV-Based Phenotyping

Fast non-iterative blind restoration of hyperspectral images with PSFs

Hybrid transformation with first order statistics for medical image analysis and classification

Hyperspectral Reconstruction of Skin Through Fusion of Scattering Transform Features

A self-supervised and adversarial approach to hyperspectral demosaicking and RGB reconstruction in surgical imaging

Hyper-Skin: A Hyperspectral Dataset for Reconstructing Facial Skin-Spectra from RGB Images

Hybrid transformation with 1’st order statistics for medical image analysis and classification

Spectrum-based deep learning framework for dermatological pigment analysis and simulation

A hyperspectral image reconstruction algorithm based on RGB image using multi-scale atrous residual convolution network

Novel method for reconstruction of hyperspectral resolution images from multispectral data for complex coastal and inland waters

Efficient and Accurate Hyperspectral Image Demosaicing with Neural Network Architectures

Hyperspectral Neural Radiance Fields

Spatial gradient consistency for unsupervised learning of hyperspectral demosaicking: Application to surgical imaging

Reconstruction of spectral irradiance in a real application with a multi-channel spectral sensor using convolutional neural networks.