Abstract:The tasks of storing and transmitting hyperspectral images (HSIs) face challenges due to the extensive number of present bands. The recovery of HSIs at extremely low compression ratios represents a significant challenge in hyperspectral applications. To address these challenges, we propose a CNN-transformer mixture (CTM) architecture-based compressed sensing network (CTCSN). Its core feature enhancement backbone network incorporates a multilayer CTM module and is integrated with a spatial-spectral superresolution (SR) decoder module; this network aims to surmount the challenges posed by traditional compressed sensing (CS) technology in terms of reconstructing HSIs. Furthermore, to satisfy the receptive field requirements of strip data acquired from spaceborne push-broom hyperspectral sensors, we employ nonsquare convolutional layers and CTM-like blocks to devise a lightweight encoder. Overall, our approach, which is grounded in deep learning (DL), achieves significantly improved reconstruction quality and efficiency by merging the local modeling capabilities of a convolutional neural network (CNN) with the global information processing prowess of a transformer. Experimental results demonstrate that, compared to the recently proposed deep CS network (DCSN) and bit-level tensor data compression network (BTC-Net) (32-bit) methods, our method achieves an average SAM improvement of approximately 10% at a sampling rate of 1%, confirming its superiority in the field of CS for HSIs. The code is available at https://github.com/ANIMZLS/CTCSN.

HSCNN: CNN-Based Hyperspectral Image Recovery from Spectrally Undersampled Projections

HSCNN+: Advanced CNN-Based Hyperspectral Recovery from RGB Images

Convolutional Neural Network Based Computational Imaging Spectroscopy

Fast non-iterative blind restoration of hyperspectral images with PSFs

Hyperspectral image recovery based on fusion of coded aperture snapshot spectral imaging and RGB images by guided filtering

Learning Hyperspectral Images from RGB Images Via a Coarse-to-fine CNN.

Hyperspectral Image Super-Resolution Via Convolutional Neural Network

Dual 1d-2d Spatial-Spectral Cnn For Hyperspectral Image Super-Resolution

Hyperspectral Image Super-Resolution with 1D-2D Attentional Convolutional Neural Network.

Learning Sensor-Specific Spatial-Spectral Features of Hyperspectral Images Via Convolutional Neural Networks

Hsvcnn: Cnn-Based Hyperspectral Reconstruction From Rgb Videos

Residual HSRCNN: Residual Hyper-Spectral Reconstruction CNN from an RGB Image

Hyperspectral Image Spatial Super-Resolution Via 3d Full Convolutional Neural Network

Phscnn: CNN-based Hyperspectral Recovery from a Pair of RGB Images.

Hyperspectral Image Reconstruction Based on Improved Residual Dense Network

Hyperspectral Image Compression Sensing Network With CNN–Transformer Mixture Architectures

Hyperspectral image super-resolution using deep convolutional neural network.

HSI-CNN: A Novel Convolution Neural Network for Hyperspectral Image

Coarse-Fine Spectral-Aware Deformable Convolution For Hyperspectral Image Reconstruction

Hyperspectral Compressive Image Reconstruction With Deep Tucker Decomposition and Spatial–Spectral Learning Network

Unsupervised Spatial-spectral Network Learning for Hyperspectral Compressive Snapshot Reconstruction