Abstract:Image compression is a key problem in this age of information explosion. With the help of machine learning, recent studies have shown that learning-based image compression methods tend to surpass traditional codecs. Image compression can be split into three steps: transform, quantization, and entropy estimation. However, the transform step in traditional codecs lacks flexibility because of the strict mathematical premise while the transform in most learning-based codecs neglects its intrinsic interpretation. After observing compression degradation degree varies on different frequency bands as illustrated as Fig. 1(a), we propose an end-to-end compression model from the frequency perspective with a frequency-pyramid transform and a frequency-aware fusion module. The right of the Fig. 1(a) displays each frequency layer's component of the proposed model from low to high-frequency splits. Intuitively, we can infer that the low-frequency part contains the global structure while the high-frequency part gets finer details, satisfying the feature of human visual system (HVS). The proposed model are detailedly shown in Fig. 1(b) that independent probability estimation models are set for each frequency split. Extensive experiments are conducted to demonstrate that our model outperforms all traditional codecs (e.g., JPEG, JPEG2000, HEVC, and VVC) on MS-SSIM metric on both Kodak and CLIC2020 professional test datasets. Taking BPG-4:4:4 as the anchor, our proposed model achieves 11.6% BD-rate reduction under PSNR measurement, which is evaluated on the Kodak dataset.

A Frequency Sensitivity-Based Quality Prediction Model for JPEG Images

A New Objective Assessment Method for Image Coding Quality

A New Image Coding Quality Assessment.

Human Visual Perception Based Image Quality Assessment for Video Prediction

Image Quality Assessment Based on Frequency Domain of Structural Similarities

Quality Adaptive Low-Rank Based JPEG Decoding with Applications

Learned Lossless Compression for JPEG via Frequency-Domain Prediction

Reference-Free Image Quality Metric for Degradation and Reconstruction Artifacts

Fuzzy Neural Network Based Prediction Coding for Bayer Pattern Image

No-reference Quality Assessment for JPEG Compressed Images.

Prediction Method For Image Coding Quality Based On Differential Information Entropy

Video Quality Assessment Based on Frequency Domain of Structural Similarity

Interpretable Learned Image Compression: A Frequency Transform Decomposition Perspective

Using JPEG and JPEG2000 Compressions for Fast Image Quality Metrics Based on Free Energy Theory.

Perceptual Quality Metric For Compressed Videos

On Blind Quality Assessment of JPEG Images.

A Psychovisually Tuned Image Codec

A novel color image compression algorithm using the human visual contrast sensitivity characteristics

Perceptual Quality Assessment of Video Considering Both Frame Rate and Quantization Artifacts

No-reference Quality Assessment Metric for JPEG2000 Based on OLS-RBF Network

Frequency Structure Analysis for IQA.