Abstract:Although deep convolutional neural network has been proved to efficiently eliminate coding artifacts caused by the coarse quantization of traditional codec, it's difficult to train any neural network in front of the encoder for gradient's back-propagation. In this paper, we propose an end-to-end image compression framework based on convolutional neural network to resolve the problem of non-differentiability of the quantization function in the standard codec. First, the feature description neural network is used to get a valid description in the low-dimension space with respect to the ground-truth image so that the amount of image data is greatly reduced for storage or transmission. After image's valid description, standard image codec such as JPEG is leveraged to further compress image, which leads to image's great distortion and compression artifacts, especially blocking artifacts, detail missing, blurring, and ringing artifacts. Then, we use a post-processing neural network to remove these artifacts. Due to the challenge of directly learning a non-linear function for a standard codec based on convolutional neural network, we propose to learn a virtual codec neural network to approximate the projection from the valid description image to the post-processed compressed image, so that the gradient could be efficiently back-propagated from the post-processing neural network to the feature description neural network during training. Meanwhile, an advanced learning algorithm is proposed to train our deep neural networks for compression. Obviously, the priority of the proposed method is compatible with standard existing codecs and our learning strategy can be easily extended into these codecs based on convolutional neural network. Experimental results have demonstrated the advances of the proposed method as compared to several state-of-the-art approaches, especially at very low bit-rate.

Interpretable Image/Video Compression by Extracting the Least Context Map

Foreground-Background Parallel Compression with Residual Encoding for Surveillance Video

Interpretable Learned Image Compression: A Frequency Transform Decomposition Perspective

Exploring Compressed Image Representation as a Perceptual Proxy: A Study

A Unified End-to-End Framework for Efficient Deep Image Compression

Latent-Separated Global Prediction for Learned Image Compression.

An End-to-End Learning Framework for Video Compression.

Learning-Based Video Compression Framework With Implicit Spatial Transform for Applications in the Internet of Things

Learned Image Compression With Gaussian-Laplacian-Logistic Mixture Model and Concatenated Residual Modules

Efficient Learned Lossless JPEG Recompression

DeepCoder: A Deep Neural Network Based Video Compression

Exploiting Kernel Sparsity and Entropy for Interpretable CNN Compression

Asymmetric Learned Image Compression with Multi-Scale Residual Block, Importance Scaling, and Post-Quantization Filtering

Efficient Learned Image Compression with Selective Kernel Residual Module and Channel-Wise Causal Context Model.

Improved Deep Image Compression with Joint Optimization of Cross Channel Context Model and Generalized Loop Filter

Efficient Learning Based Sub-pixel Image Compression.

Learning a Virtual Codec Based on Deep Convolutional Neural Network to Compress Image

An End-to-End Compression Framework Based on Convolutional Neural Networks

A Learning-Based Framework for Low Bit-Rate Image and Video Coding

Fast and High-Performance Learned Image Compression With Improved Checkerboard Context Model, Deformable Residual Module, and Knowledge Distillation

Conditional Entropy Coding for Efficient Video Compression