Abstract:Just noticeable difference (JND) of natural images refers to the maximum pixel intensity change magnitude that typical human visual system (HVS) cannot perceive. Existing efforts on JND estimation mainly dedicate to modeling the diverse masking effects in either/both spatial or/and frequency domains, and then fusing them into an overall JND estimate. In this work, we turn to a dramatically different way to address this problem with a top-down design philosophy. Instead of explicitly formulating and fusing different masking effects in a bottom-up way, the proposed JND estimation model dedicates to first predicting a critical perceptual lossless (CPL) counterpart of the original image and then calculating the difference map between the original image and the predicted CPL image as the JND map. We conduct subjective experiments to determine the critical points of 500 images and find that the distribution of cumulative normalized KLT coefficient energy values over all 500 images at these critical points can be well characterized by a Weibull distribution. Given a testing image, its corresponding critical point is determined by a simple weighted average scheme where the weights are determined by a fitted Weibull distribution function. The performance of the proposed JND model is evaluated explicitly with direct JND prediction and implicitly with two applications including JND-guided noise injection and JND-guided image compression. Experimental results have demonstrated that our proposed JND model can achieve better performance than several latest JND models. In addition, we also compare the proposed JND model with existing visual difference predicator (VDP) metrics in terms of the capability in distortion detection and discrimination. The results indicate that our JND model also has a good performance in this task. The code of this work are available at https://github.com/Zhentao-Liu/KLT-JND.

An improved model of pixel adaptive just-noticeable difference estimation

Visual Attention Guided Pixel-Wise Just Noticeable Difference Model

Improved Pixel-Based JND Model with the Hybrid Approach

Enhanced Just Noticeable Difference Model with Visual Regularity Consideration.

Just-noticeable Difference Estimation with Pixels in Images

Unified Spatial Masking for Just-Noticeable Difference Estimation

Improved estimation for just-noticeable visual distortion

Enhanced Just Noticeable Difference Model for Images With Pattern Complexity

Just-Noticeable Distortion Estimation for Image Pixels

Feedforward and Feedback Modulations Based Foveated JND Estimation for Images

Survey of Visual Just Noticeable Difference Estimation

Structural uncertainty based just noticeable difference estimation

An Improved DCT-Based JND Model Based on Textural Feature.

Just-Noticeable-Distortion Profile With Nonlinear Additivity Model For Perceptual Masking In Color Images

Content complexity based just noticeable difference estimation in DCT domain.

Rethinking and Conceptualizing Just Noticeable Difference Estimation by Residual Learning

Toward Top-Down Just Noticeable Difference Estimation of Natural Images.

A JND Profile Based on Hierarchically Selective Attention for Images

Just Noticeable Difference for Natural Images Using RMS Contrast and Feed-Back Mechanism

A DCT-Domain Multi-channel CM-JND Model in YCbCr Space

Enhanced subband JND model with textural image