Abstract:Recently, deep learning-based image compression has made significant progresses, and has achieved better rate-distortion (R-D) performance than the latest traditional method, H.266/VVC, in both MS-SSIM metric and the more challenging PSNR metric. However, a major problem is that the complexities of many leading learned schemes are too high. In this paper, we propose an efficient and effective image coding framework, which achieves similar R-D performance with lower complexity than the state of the art. First, we develop an improved multi-scale residual block (MSRB) that can expand the receptive field and capture global information more efficiently, which further reduces the spatial correlation of the latent representations. Second, an importance scaling network is introduced to directly scale the latents to achieve content-adaptive bit allocation without sending side information, which is more flexible than previous importance map methods. Third, we apply a post-quantization filter (PQF) to reduce the quantization error, motivated by the Sample Adaptive Offset (SAO) filter in video coding. Moreover, our experiments show that the performance of the system is less sensitive to the complexity of the decoder. Therefore, we design an asymmetric paradigm, in which the encoder employs three stages of MSRBs to improve the learning capacity, whereas the decoder only uses one stage of MSRB, which reduces the decoder complexity and still yields satisfactory performance. Experimental results show that compared to the state-of-the-art method, the encoding and decoding time of the proposed method are about 17 times faster, and the R-D performance is only reduced by about 1% on both Kodak and Tecnick-40 datasets, which is still better than H.266/VVC(4:4:4) and other leading learning-based methods. Our source code is publicly available at https://github.com/fengyurenpingsheng.

Multi-scale Architectures Matter: Examining the Adversarial Robustness of Flow-Based Lossless Compression

MALICE: Manipulation Attacks on Learned Image ComprEssion

On the Adversarial Robustness of Learning-based Image Compression Against Rate-Distortion Attacks

Secure Federated Learning with Model Compression.

Attack and Defense Analysis of Learned Image Compression

An Imperceptible Adversarial Attack Against Reconstruction for Learned Image Compression

Multiscale Augmented Normalizing Flows for Image Compression

DualFlow: Generating imperceptible adversarial examples by flow field and normalize flow-based model

A Training-Free Defense Framework for Robust Learned Image Compression

Modeling Lost Information in Lossy Image Compression.

Towards Robust Neural Image Compression: Adversarial Attack and Model Finetuning

Security Analysis and Enhancement of Model Compressed Deep Learning Systems under Adversarial Attacks

Robust and Transferable Backdoor Attacks Against Deep Image Compression With Selective Frequency Prior

Toward Robust Neural Image Compression: Adversarial Attack and Model Finetuning

Large Language Models for Lossless Image Compression: Next-Pixel Prediction in Language Space is All You Need

Model Compression with Adversarial Robustness: A Unified Optimization Framework

Stealthy Backdoors as Compression Artifacts

Learned Image Compression With Gaussian-Laplacian-Logistic Mixture Model and Concatenated Residual Modules

Learned Low Bit-rate Image Compression with Adversarial Mechanism

Understanding The Effectiveness of Lossy Compression in Machine Learning Training Sets

Asymmetric Learned Image Compression with Multi-Scale Residual Block, Importance Scaling, and Post-Quantization Filtering