Abstract:Recently, deep learning-based image compression has made significant progresses, and has achieved better rate-distortion (R-D) performance than the latest traditional method, H.266/VVC, in both MS-SSIM metric and the more challenging PSNR metric. However, a major problem is that the complexities of many leading learned schemes are too high. In this paper, we propose an efficient and effective image coding framework, which achieves similar R-D performance with lower complexity than the state of the art. First, we develop an improved multi-scale residual block (MSRB) that can expand the receptive field and capture global information more efficiently, which further reduces the spatial correlation of the latent representations. Second, an importance scaling network is introduced to directly scale the latents to achieve content-adaptive bit allocation without sending side information, which is more flexible than previous importance map methods. Third, we apply a post-quantization filter (PQF) to reduce the quantization error, motivated by the Sample Adaptive Offset (SAO) filter in video coding. Moreover, our experiments show that the performance of the system is less sensitive to the complexity of the decoder. Therefore, we design an asymmetric paradigm, in which the encoder employs three stages of MSRBs to improve the learning capacity, whereas the decoder only uses one stage of MSRB, which reduces the decoder complexity and still yields satisfactory performance. Experimental results show that compared to the state-of-the-art method, the encoding and decoding time of the proposed method are about 17 times faster, and the R-D performance is only reduced by about 1% on both Kodak and Tecnick-40 datasets, which is still better than H.266/VVC(4:4:4) and other leading learning-based methods. Our source code is publicly available at https://github.com/fengyurenpingsheng.

A Single Image Compression Framework Combined with Sparse Representation-Based Super-Resolution

Low Bit Rates Image Compression Via Adaptive Block Downsampling and Super Resolution

A Sparse Representation Based Super-Resolution Image Reconstruction Scheme Utilizing Dual Dictionaries

An Iterative Framework of Cascaded Deblocking and Superresolution for Compressed Images.

Low-rate Image Compression with Super-resolution Learning

Multi-frame Image Super-resolution Reconstruction Combined with Sparse Coding Model

Bidirectionally Aligned Sparse Representation for Single Image Super-Resolution

Single-Frame Super-Resolution Via Compressive Sampling on Hybrid Reconstructions

Image Compression Via Multiple Sampling-Rate Downsampling and Super-Resolution Upconversion

Super-Resolution of Low-Quality Images Based on Compressed Sensing and Sequence Information

FIPER: Generalizable Factorized Fields for Joint Image Compression and Super-Resolution

Single Image Super-Resolution Using Sparse Prior

Asymmetric Learned Image Compression with Multi-Scale Residual Block, Importance Scaling, and Post-Quantization Filtering

Single Image Super Resolution Based on Sparse Representation and Adaptive Dictionary Selection

CISRDCNN: Super-resolution of compressed images using deep convolutional neural networks

Semantic Structured Image Coding Framework for Multiple Intelligent Applications

Adaptive Image Coding Efficiency Enhancement Using Deep Convolutional Neural Networks

A Codec Information Assisted Framework for Efficient Compressed Video Super-Resolution

Low Bit Rate Image Compression via Down-sampling and Reconstruction in DCT

Single-image Super-Resolution Reconstruction Via Double Layer Reconstructing

Convolutional Sparse Coding for Image Super-Resolution