Abstract:Recently, deep learning-based image compression has made significant progresses, and has achieved better rate-distortion (R-D) performance than the latest traditional method, H.266/VVC, in both MS-SSIM metric and the more challenging PSNR metric. However, a major problem is that the complexities of many leading learned schemes are too high. In this paper, we propose an efficient and effective image coding framework, which achieves similar R-D performance with lower complexity than the state of the art. First, we develop an improved multi-scale residual block (MSRB) that can expand the receptive field and capture global information more efficiently, which further reduces the spatial correlation of the latent representations. Second, an importance scaling network is introduced to directly scale the latents to achieve content-adaptive bit allocation without sending side information, which is more flexible than previous importance map methods. Third, we apply a post-quantization filter (PQF) to reduce the quantization error, motivated by the Sample Adaptive Offset (SAO) filter in video coding. Moreover, our experiments show that the performance of the system is less sensitive to the complexity of the decoder. Therefore, we design an asymmetric paradigm, in which the encoder employs three stages of MSRBs to improve the learning capacity, whereas the decoder only uses one stage of MSRB, which reduces the decoder complexity and still yields satisfactory performance. Experimental results show that compared to the state-of-the-art method, the encoding and decoding time of the proposed method are about 17 times faster, and the R-D performance is only reduced by about 1% on both Kodak and Tecnick-40 datasets, which is still better than H.266/VVC(4:4:4) and other leading learning-based methods. Our source code is publicly available at https://github.com/fengyurenpingsheng.

Research on Image Compression Technique by Deep Learning Algorithm with Semantic Coding and Decoding

An End-to-End Deep Learning Image Compression Framework Based on Semantic Analysis

Semantic-Aware Image Compression Architecture for Semantic Communication

Towards Semantically Scalable Image Coding Using Semantic Map.

Deep Learning-Based Image Semantic Coding for Semantic Communications

Deep Learning-Based Image Semantic Communication System

Towards Semantic Communications: Deep Learning-Based Image Semantic Coding

Image Compression Based on Octave Convolution and Semantic Segmentation

Image Coding and Compression Method Based on Semantics of Pixels for Semantic Communication

Toward Semantic Communications: Deep Learning-Based Image Semantic Coding

Semantic Communication Approach for Multi-Task Image Transmission

Semantically-Disentangled Progressive Image Compression for Deep Space Communications: Exploring the Ultra-low Rate Regime

A Deep Image Coding Scheme With Generative Network to Learn From Correlated Images

Multi-Modality Deep Network for Extreme Learned Image Compression

Deep Image Semantic Communication Model for Artificial Intelligent Internet of Things

A novel image semantic communication method via dynamic decision generation network and generative adversarial network

Semantic-Aware Visual Decomposition for Image Coding

Asymmetric Learned Image Compression with Multi-Scale Residual Block, Importance Scaling, and Post-Quantization Filtering

A Novel Deep Progressive Image Compression Framework

An Image Adaptive Rate Mechanism in Semantic Communication for Image Endogenous Semantics

Content-aware Facial Image Compression with Deep Learning Method