Abstract:Recently, deep learning-based image compression has made significant progresses, and has achieved better rate-distortion (R-D) performance than the latest traditional method, H.266/VVC, in both MS-SSIM metric and the more challenging PSNR metric. However, a major problem is that the complexities of many leading learned schemes are too high. In this paper, we propose an efficient and effective image coding framework, which achieves similar R-D performance with lower complexity than the state of the art. First, we develop an improved multi-scale residual block (MSRB) that can expand the receptive field and capture global information more efficiently, which further reduces the spatial correlation of the latent representations. Second, an importance scaling network is introduced to directly scale the latents to achieve content-adaptive bit allocation without sending side information, which is more flexible than previous importance map methods. Third, we apply a post-quantization filter (PQF) to reduce the quantization error, motivated by the Sample Adaptive Offset (SAO) filter in video coding. Moreover, our experiments show that the performance of the system is less sensitive to the complexity of the decoder. Therefore, we design an asymmetric paradigm, in which the encoder employs three stages of MSRBs to improve the learning capacity, whereas the decoder only uses one stage of MSRB, which reduces the decoder complexity and still yields satisfactory performance. Experimental results show that compared to the state-of-the-art method, the encoding and decoding time of the proposed method are about 17 times faster, and the R-D performance is only reduced by about 1% on both Kodak and Tecnick-40 datasets, which is still better than H.266/VVC(4:4:4) and other leading learning-based methods. Our source code is publicly available at https://github.com/fengyurenpingsheng.

Lossy Image Compression with Filter Bank Based Convolutional Networks.

Asymmetric Learned Image Compression with Multi-Scale Residual Block, Importance Scaling, and Post-Quantization Filtering

Context-Based Lossless Compression of Mosaic Image with Bayer Pattern

Fuzzy Neural Network Based Prediction Coding for Bayer Pattern Image

An End-to-End Compression Framework Based on Convolutional Neural Networks

Content-Aware Convolutional Neural Network for In-Loop Filtering in High Efficiency Video Coding

Convolutional Neural Network Based In-Loop Filter for VVC Intra Coding

Ultra High Fidelity Image Compression with -constrained Encoding and Deep Decoding

An Integrated CNN-based Post Processing Filter For Intra Frame in Versatile Video Coding

Multi-Density Convolutional Neural Network for In-Loop Filter in Video Coding.

Wavelet-like Transform with Subbands Fusion in Decoupled Structure for Deep Image Compression

Ultra High Fidelity Deep Image Decompression With l∞-Constrained Compression

A Convolutional Neural Network-Based Quantization Method for Block Compressed Sensing of Images

Learned Image Compression with Inception Residual Blocks and Multi-Scale Attention Module.

Multi-Scale Feature Prediction with Auxiliary-Info for Neural Image Compression

Frequency-Aware Transformer for Learned Image Compression

A CNN-Based In-Loop Filter with CU Classification for HEVC

Residual in Residual Based Convolutional Neural Network In-loop Filter for AVS3

Learned Block-based Hybrid Image Compression

Bi-Level Spatial and Channel-aware Transformer for Learned Image Compression

A Learning-Based Low Complexity In-Loop Filter for Video Coding