Abstract:We propose a learning-based compression scheme that envelopes a standard codec between pre and post-processing deep CNNs. Specifically, we demonstrate improvements over prior approaches utilizing a compression-decompression network by introducing: (a) an edge-aware loss function to prevent blurring that is commonly occurred in prior works & (b) a super-resolution convolutional neural network (CNN) for post-processing along with a corresponding pre-processing network for improved rate-distortion performance in the low rate regime. The algorithm is assessed on a variety of datasets varying from low to high resolution namely Set 5, Set 7, Classic 5, Set 14, Live 1, Kodak, General 100, CLIC 2019. When compared to JPEG, JPEG2000, BPG, and recent CNN approach, the proposed algorithm contributes significant improvement in PSNR with an approximate gain of 20.75%, 8.47%, 3.22%, 3.23% and 24.59%, 14.46%, 10.14%, 8.57% at low and high bit-rates respectively. Similarly, this improvement in MS-SSIM is approximately 71.43%, 50%, 36.36%, 23.08%, 64.70% and 64.47%, 61.29%, 47.06%, 51.52%, 16.28% at low and high bit-rates respectively. With CLIC 2019 dataset, PSNR is found to be superior with approximately 16.67%, 10.53%, 6.78%, and 24.62%, 17.39%, 14.08% at low and high bit-rates respectively, over JPEG2000, BPG, and recent CNN approach. Similarly, the MS-SSIM is found to be superior with approximately 72%, 45.45%, 39.13%, 18.52%, and 71.43%, 50%, 41.18%, 17.07% at low and high bit-rates respectively, compared to the same approaches. A similar type of improvement is achieved with other datasets also.

What problem does this paper attempt to address?

The problem that this paper attempts to solve is to improve the quality of JPEG - compressed images, especially the compression performance at low bit rates. Specifically, the author proposes a pre - processing and post - processing method based on deep learning, aiming to improve the image blurring and other artifacts problems caused by the traditional JPEG compression algorithm during the compression process. By introducing the edge - aware loss function and the super - resolution convolutional neural network (CNN), the paper optimizes the processing before and after image compression, thereby achieving a higher compression ratio while maintaining better image quality. ### Main Contributions 1. **Edge - Aware Loss Function**: In order to prevent the common image blurring phenomenon during the compression process, the author proposes an edge - aware loss function. This loss function can pay more attention to preserving the edge information in the image during the training process, thereby reducing the impact of compression on the structural features of the image. 2. **Super - Resolution Convolutional Neural Network**: At low bit rates, the author uses a super - resolution convolutional neural network for post - processing to improve the quality of the decompressed image. This network can effectively reduce the blocking artifacts and restore the details of the image. 3. **End - to - End Deep Compression Framework**: The proposed framework combines the traditional JPEG codec with the deep - learning model to form an end - to - end system. In this way, the compression performance can be significantly improved while maintaining compatibility with the existing JPEG standards. ### Experimental Results The paper conducted experiments on multiple datasets, including Set 5, Set 7, Classic 5, Set 14, Live 1, Kodak, General 100 and CLIC 2019. The experimental results show that compared with the traditional JPEG, JPEG2000, BPG and the recent CNN methods, the proposed algorithm has achieved significant performance improvements at both low and high bit rates. This is specifically manifested in a substantial increase in PSNR and MS - SSIM indicators. ### Summary By introducing the edge - aware loss function and the super - resolution convolutional neural network, this paper has successfully solved the common image blurring and blocking artifacts problems in JPEG compression. The proposed end - to - end deep compression framework not only improves the compression performance but also maintains compatibility with the existing JPEG standards, which has important practical application value.

Deep learning-based Edge-aware pre and post-processing methods for JPEG compressed images

Deep Image Compression via End-to-End Learning

DPW-SDNet: Dual Pixel-Wavelet Domain Deep CNNs for Soft Decoding of JPEG-Compressed Images

Improved deep learning image compression model: performance optimization based on convolutional modules and local attention mechanism

JPEG Inspired Deep Learning

Remote Sensing Image Scene Classification with Deep Neural Networks in JPEG 2000 Compressed Domain

Asymmetric Learned Image Compression with Multi-Scale Residual Block, Importance Scaling, and Post-Quantization Filtering

DCT-domain deep convolutional neural networks for multiple JPEG compression classification

CNNs for JPEGs: A Study in Computational Cost

On the Impact of Lossy Image and Video Compression on the Performance of Deep Convolutional Neural Network Architectures

Soft Decoding of JPEG 2000 Compressed Images Using Bit-Rate-driven Deep Convolutional Neural Networks

CAS-CNN: A Deep Convolutional Neural Network for Image Compression Artifact Suppression

DNN-Compressed Domain Visual Recognition with Feature Adaptation

Joint Graph Attention and Asymmetric Convolutional Neural Network for Deep Image Compression

A Unified End-to-End Framework for Efficient Deep Image Compression

DeepN-JPEG: A Deep Neural Network Favorable JPEG-based Image Compression Framework

Deep Image Compression with Residual Learning

Learned Image Compression with Inception Residual Blocks and Multi-Scale Attention Module.

Deep Perceptual Compression

An End-to-End Compression Framework Based on Convolutional Neural Networks

Adaptive Image Coding Efficiency Enhancement Using Deep Convolutional Neural Networks