Abstract:The advent of the information age and the continuous development of spectrum imaging technologies have both triggered an explosion of multispectral image information data. Hence, image data need to be compressed first no matter transmitting or storing information. This paper designs an end-to-end compression algorithm based on spectral–spatial domain feature leaning (SSDFL). SSDFL consists of dual branches: one to obtain spectral features by Bi-ConvLSTM, and the other for spatial feature extraction via residual multiscale depth-wise convolutions (RMDCs). The attention mechanism is conductive to ulteriorly fuse features. The encoder with SSDFL serves to extract important features from multispectral images and decrease their size to 1/8 of its original size. After decreasing dimensions of images, the quantizer turns the latent floating-point characteristics into integer data. The following phase utilizes lossless entropy coding to execute coding on the integer input and estimate the bitstream. The rate-distortion is added to the training process in order to jointly optimize the image bitstream and loss. The decoder is nearly symmetrical to the encoder to restore high-quality images. Two datasets from the WorldView-3 and Setinel-2 satellites are adopted in experiment with PSNR, MS-SSIM, SS, and MSA as evaluation indexes. Corresponding results prove that the performance of the proposed approach is superior to that of traditional compression algorithms 3D-SPIHT and JPEG2000. In addition, compared with deep learning compression methods CNN-based, ConvGRU-based and Partitioned, the suggested method still outperforms at various bitrates.

Mosaicked multispectral image compression based on inter- and intra-band correlation

Multispectral image compression by cluster-adaptive subspace representation

Hybrid Compressive Spectral Imaging with Coded Aperture Optimization Based on Coherence Minimization

Compressive Single-Pixel Spectral Imaging with Spatial-Spectral Modulation Optimization Via Coherence Minimization

Compressive Single-Pixel Hyperspectral Imaging Using RGB Sensors

Spatial-spectral Encoding and Dictionary Optimization in Compressive Single-Pixel Hyperspectral Imaging Based on Mutual Coherence Minimization

Single-pixel Multispectral Imaging Based on Macropixel Segmentation Method

Joint optimization of multispectral filter arrays and demosaicking for pathological images

End-to-End Multispectral Image Compression Using Convolutional Neural Network

Three-stages Hyperspectral Image Compression Sensing with Band Selection

Fast Multispectral Imaging by Spatial Pixel-Binning and Spectral Unmixing

Multispectral image compression based on DSC combined with CCSDS-IDC

Progressive Distributed Coding of Multispectral Images

Lossy Compression Algorithm of Multispectral Remote Sensing Images Based on IHS Transform

Snapshot multispectral imaging using a filter array

Optimized High-Frequency Based Interpolation for Multispectral Demosaicking

Hyperspectral Image Compression Using Sampling and Implicit Neural Representations

Hybrid-resolution multispectral imaging using color filter array

Multispectral computational ghost imaging with multiplexed illumination

Single-shot multispectral imaging with a monochromatic camera

Dual-branch spectral–spatial feature extraction network for multispectral image compression