Abstract:Recently, deep learning-based image compression has made significant progresses, and has achieved better rate-distortion (R-D) performance than the latest traditional method, H.266/VVC, in both MS-SSIM metric and the more challenging PSNR metric. However, a major problem is that the complexities of many leading learned schemes are too high. In this paper, we propose an efficient and effective image coding framework, which achieves similar R-D performance with lower complexity than the state of the art. First, we develop an improved multi-scale residual block (MSRB) that can expand the receptive field and capture global information more efficiently, which further reduces the spatial correlation of the latent representations. Second, an importance scaling network is introduced to directly scale the latents to achieve content-adaptive bit allocation without sending side information, which is more flexible than previous importance map methods. Third, we apply a post-quantization filter (PQF) to reduce the quantization error, motivated by the Sample Adaptive Offset (SAO) filter in video coding. Moreover, our experiments show that the performance of the system is less sensitive to the complexity of the decoder. Therefore, we design an asymmetric paradigm, in which the encoder employs three stages of MSRBs to improve the learning capacity, whereas the decoder only uses one stage of MSRB, which reduces the decoder complexity and still yields satisfactory performance. Experimental results show that compared to the state-of-the-art method, the encoding and decoding time of the proposed method are about 17 times faster, and the R-D performance is only reduced by about 1% on both Kodak and Tecnick-40 datasets, which is still better than H.266/VVC(4:4:4) and other leading learning-based methods. Our source code is publicly available at https://github.com/fengyurenpingsheng.

An Energy Efficient JPEG Encoder with Neural Network Based Approximation and Near-Threshold Computing.

Approximate DCT and Quantization Techniques for Energy-Constrained Image Sensors

Efficient Learned Lossless JPEG Recompression

Design Methodology of Low Power JPEG2000 Codec Exploiting Dual Voltage Scaling

A Low Power, Fully Pipelined JPEG-LS Encoder for Lossless Image Compression

Design and Implementation of a Low-Power JPEG Compressor IC

Improved JPEG Lossless Compression for Compression of Intermediate Layers in Neural Networks Based on Compute-In-Memory

A Low Power VLSI Implementation for JPEG2000 Codec

EARN: Toward Efficient and Robust JPEG Compression Artifact Reduction

Low-complexity Transform Network Architecture for JPEG AI Image Codec.

JPEG Inspired Deep Learning

DeepN-JPEG: A Deep Neural Network Favorable JPEG-based Image Compression Framework

High efficiency lossless image recompression algorithm with asymmetric numeral systems for real-time mobile application

Neural Network Assisted Lifting Steps For Improved Fully Scalable Lossy Image Compression in JPEG 2000

Unified learning-based lossy and lossless JPEG recompression

A LowPower, Fully Pipelined JPEG-LSEncoder Forlossless ImageCompression

Asymmetric Learned Image Compression with Multi-Scale Residual Block, Importance Scaling, and Post-Quantization Filtering

JPEG Image Compression using the Discrete Cosine Transform: An Overview, Applications, and Hardware Implementation

A High Throughput and Energy Efficient Lepton Hardware Encoder with Hash-based Memory Optimization

A low power JPEG image compression IC for wireless ingestible endoscopy

Lossless Recompression of JPEG Images Using Transform Domain Intra Prediction