Abstract:Recently, deep learning-based image compression has made significant progresses, and has achieved better rate-distortion (R-D) performance than the latest traditional method, H.266/VVC, in both MS-SSIM metric and the more challenging PSNR metric. However, a major problem is that the complexities of many leading learned schemes are too high. In this paper, we propose an efficient and effective image coding framework, which achieves similar R-D performance with lower complexity than the state of the art. First, we develop an improved multi-scale residual block (MSRB) that can expand the receptive field and capture global information more efficiently, which further reduces the spatial correlation of the latent representations. Second, an importance scaling network is introduced to directly scale the latents to achieve content-adaptive bit allocation without sending side information, which is more flexible than previous importance map methods. Third, we apply a post-quantization filter (PQF) to reduce the quantization error, motivated by the Sample Adaptive Offset (SAO) filter in video coding. Moreover, our experiments show that the performance of the system is less sensitive to the complexity of the decoder. Therefore, we design an asymmetric paradigm, in which the encoder employs three stages of MSRBs to improve the learning capacity, whereas the decoder only uses one stage of MSRB, which reduces the decoder complexity and still yields satisfactory performance. Experimental results show that compared to the state-of-the-art method, the encoding and decoding time of the proposed method are about 17 times faster, and the R-D performance is only reduced by about 1% on both Kodak and Tecnick-40 datasets, which is still better than H.266/VVC(4:4:4) and other leading learning-based methods. Our source code is publicly available at https://github.com/fengyurenpingsheng.

Learned Image Compression for Both Humans and Machines Via Dynamic Adaptation

Dynamic Low-Rank Instance Adaptation for Universal Neural Image Compression

Learned Image Coding for Machines: A Content-Adaptive Approach

Unveiling the Future of Human and Machine Coding: A Survey of End-to-End Learned Image Compression

Machine Perception-Driven Image Compression: A Layered Generative Approach

Learned Image Compression for Machine Perception

Learned Image Coding for Human-Machine Collaborative Optimization

DNN-Compressed Domain Visual Recognition with Feature Adaptation

A New Image Codec Paradigm for Human and Machine Uses

Learned Image Compression Guided Adaptive Quantization for Perceptual Quality

A Unified Efficient Deep Image Compression Framework and Its Application on Human-Centric Task

Asymmetric Learned Image Compression with Multi-Scale Residual Block, Importance Scaling, and Post-Quantization Filtering

Unified and Scalable Deep Image Compression Framework for Human and Machine

Toward Scalable Image Feature Compression: A Content-Adaptive and Diffusion-Based Approach

Deep Image Compression Toward Machine Vision: A Unified Optimization Framework

Deep Image Compression Towards Machine Vision: A Unified Optimization Framework

A Unified Image Compression Method for Human Perception and Multiple Vision Tasks

Real-Time Adaptive Image Compression

Rate-Distortion-Cognition Controllable Versatile Neural Image Compression

Learned Image Compression Using Adaptive Block-Wise Encoding and Reconstruction Network

Multi-Modality Deep Network for Extreme Learned Image Compression