Abstract:Deep learning has achieved great success in many computer vision tasks, such as recognition, image enhancement and image compression. However, it is difficult to use a residual network that can efficiently consider the characteristics of multispectral images for multispectral image compression. In this paper, a novel end-to-end multispectral image compression framework based on a weighted feature channel residual network is proposed to efficiently remove the spatial and spectral redundancy of multispectral images by extracting the importance of each channel. The multispectral image compression framework includes a forward coding network, a rate-distortion optimizer, a quantizer/inverse quantizer, an entropy encoder/decoder and an inverse decoding network. In the encoder, multispectral images are directly fed into the forward coding network, and the main spectral and spatial features of the multispectral images are extracted by the residual block. Additionally, the weighted feature channel module can explicitly model the relationship between feature channels when extracting features from multispectral images and adaptively allocate different weights for each feature channel through training. The rate-distortion optimizer is added to make the main features compact. Then, the intermediate feature data are quantized and encoded by lossless entropy coding to obtain a code stream. In the decoder, the code stream is approximately restored to the intermediate features through the entropy decoder and the inverse quantizer. Then, the intermediate features are reconstructed to the multispectral images by the inverse decoding network. Experimental results on 7-band multispectral images of the Landsat 8 satellite and 8-band multispectral images of WorldView-3 satellite demonstrate that the proposed algorithm can achieve a better PSNR than conventional 2D schemes (which are JPEG2000 and JPEG in this paper) and 3D scheme (which is 3D-SPIHT in this paper) and can effectively preserve more spectral information of multispectral images.

End-to-End Multispectral Image Compression Using Convolutional Neural Network

Convolutional Neural Network Based Computational Imaging Spectroscopy

Spectral–Spatial Feature Partitioned Extraction Based on CNN for Multispectral Image Compression

End-to-end feature domain residual coding network for multispectral image compression based on interspectral prediction

Multispectral image compression by cluster-adaptive subspace representation

Dual-branch spectral–spatial feature extraction network for multispectral image compression

A Spectral-Spatial Feature Extraction Method With Polydirectional CNN for Multispectral Image Compression

A residual network framework based on weighted feature channels for multispectral image compression

Multihead Global Attention and Spatial Spectral Information Fusion for Remote Sensing Image Compression

Multi‐scale spatial‐spectral attention network for multispectral image compression based on variational autoencoder

Multiscale Progressive Image Compression Network Guided by Learnable Just Noticeable Distortion

Lightweight Bit-Depth Recovery Network for Gaofen Satellite Multispectral Image Compression

Compression of multispectral image using HEVC

Hyperspectral Image Compression Sensing Network With CNN–Transformer Mixture Architectures

An End-to-End Compression Framework Based on Convolutional Neural Networks

Deep Image Compression via End-to-End Learning

Classification of Compressed Remote Sensing Multispectral Images via Convolutional Neural Networks

Multispectral image compression based on DSC combined with CCSDS-IDC

End-to-end joint spectral-spatial compression and reconstruction of hyperspectral images using a 3D convolutional autoencoder

Hyperspectral Image Compression Via Cross-Channel Contrastive Learning.

GFSCompNet: remote sensing image compression network based on global feature-assisted segmentation