Abstract:Recently, deep learning-based image compression has made significant progresses, and has achieved better rate-distortion (R-D) performance than the latest traditional method, H.266/VVC, in both MS-SSIM metric and the more challenging PSNR metric. However, a major problem is that the complexities of many leading learned schemes are too high. In this paper, we propose an efficient and effective image coding framework, which achieves similar R-D performance with lower complexity than the state of the art. First, we develop an improved multi-scale residual block (MSRB) that can expand the receptive field and capture global information more efficiently, which further reduces the spatial correlation of the latent representations. Second, an importance scaling network is introduced to directly scale the latents to achieve content-adaptive bit allocation without sending side information, which is more flexible than previous importance map methods. Third, we apply a post-quantization filter (PQF) to reduce the quantization error, motivated by the Sample Adaptive Offset (SAO) filter in video coding. Moreover, our experiments show that the performance of the system is less sensitive to the complexity of the decoder. Therefore, we design an asymmetric paradigm, in which the encoder employs three stages of MSRBs to improve the learning capacity, whereas the decoder only uses one stage of MSRB, which reduces the decoder complexity and still yields satisfactory performance. Experimental results show that compared to the state-of-the-art method, the encoding and decoding time of the proposed method are about 17 times faster, and the R-D performance is only reduced by about 1% on both Kodak and Tecnick-40 datasets, which is still better than H.266/VVC(4:4:4) and other leading learning-based methods. Our source code is publicly available at https://github.com/fengyurenpingsheng.

Incorporating Primal Sketch Based Learning Into Low Bit-Rate Image Compression

A Unified Active and Semi-Supervised Learning Framework for Image Compression

Image Compression with Edge-Based Inpainting

Quality Adaptive Low-Rank Based JPEG Decoding with Applications

Coarse-to-Fine Hyper-Prior Modeling for Learned Image Compression

Perceptual Quality Study on Deep Learning based Image Compression

Deep Image Compression via End-to-End Learning

Sketch Assisted Face Image Coding for Human and Machine Vision: A Joint Training Approach

Asymmetric Learned Image Compression with Multi-Scale Residual Block, Importance Scaling, and Post-Quantization Filtering

Wavelet inpainting driven image compression via collaborative sparsity at low bit rates

Adaptive DCT-Domain Down-Sampling and Learning Based Mapping for Low Bit-Rate Image Compression

Deep Image Compression with Residual Learning

Practical Learned Image Compression with Online Encoder Optimization

Deep Convolutional Network Based Image Quality Enhancement for Low Bit Rate Image Compression

Color Image Compression with Transform Domain Down-Sampling and Deep Convolutional Reconstruction

Learned Image Compression for Machine Perception

Improved deep learning image compression model: performance optimization based on convolutional modules and local attention mechanism

Interpretable Learned Image Compression: A Frequency Transform Decomposition Perspective

Text + Sketch: Image Compression at Ultra Low Rates

Traditional Transformation Theory Guided Model for Learned Image Compression

Learned Block-based Hybrid Image Compression