Abstract:The human visual system (HVS) is a hierarchical system, in which visual signals are processed hierarchically. In this paper, the HVS is modeled as a three-level communication system and visual perception is divided into three stages according to the hierarchical predictive coding theory. Then, a novel just noticeable distortion (JND) estimation scheme is proposed. In visual perception, the input signals are predicted constantly and spontaneously in each hierarchy, and neural response is evoked by the central residue and inhibited by surrounding residues. These two types' residues are regarded as the positive and negative visual incentives which cause positive and negative perception effects, respectively. In neuroscience, the effect of incentive on observer is measured by the surprise of this incentive. Thus, we propose a surprise-based measurement method to measure both perception effects. Specifically, considering the biased competition of visual attention, we define the product of the residue self-information (i.e., surprise) and the competition biases as the perceptual surprise to measure the positive perception effect. As for the negative perception effect, it is measured by the average surprise (i.e., the local Shannon entropy). The JND threshold of each stage is estimated individually by considering both perception effects. The total JND threshold is finally obtained by non-linear superposition of three stage thresholds. Furthermore, the proposed JND estimation scheme is incorporated into the codec of Versatile Video Coding for image compression. Experimental results show that the proposed JND model outperforms the relevant existing ones, and over 16% of bit rate can be reduced without jeopardizing the perceptual quality.

Joint Just Noticeable Difference Model Based on Depth Perception for Stereoscopic Images

Learning Stereoscopic Visual Attention Model for 3d Video

Foveated JND Model Based on Stereo Vision and Its Application in Image Compression with Hardware Implementation

Binocular Stereoscopic Video Just Noticeable Distortion Model and Its Application to Quality Assessment

Multiple Just-Noticeable-difference-based No-Reference Stereoscopic Image Quality Assessment.

Applications of just-noticeable depth difference model in joint multiview video plus depth coding

A New Just-Noticeable-Distortion Model Combined with the Depth Information and Its Application in Multi-view Video Coding

Depth Map Optimization Based on Just Noticeable Depth Difference Model

Assessment of Perceptual Depth Intensity on Source Stereoscopic Images

Just noticeable disparity error-based depth coding for three-dimensional video

Just Noticeable Difference for Deep Machine Vision

Asymmetric Foveated Just-Noticeable-Difference Model for Images With Visual Field Inhomogeneities

Geometry-based spherical JND modeling for 360$^\circ$ display

Picture-level just noticeable difference for symmetrically and asymmetrically compressed stereoscopic images: Subjective quality assessment study and datasets

On just noticeable difference for bionic eye

Hierarchical Predictive Coding-Based JND Estimation for Image Compression

A survey on just noticeable distortion estimation and its applications in video coding

A New Virtual View Rendering Method Based on Depth Image

Perceptual Multiview Video Coding Based On Foveated Just Noticeable Distortion Profile In Dct Domain

Feedforward and Feedback Modulations Based Foveated JND Estimation for Images

Models of Monocular and Binocular Visual Perception in Quality Assessment of Stereoscopic Images