Abstract:Objective quality assessment of stereoscopic omnidirectional images is a challenging problem since it is influenced by multiple aspects such as projection deformation, field of view (FoV) range, binocular vision, visual comfort, etc. Existing studies show that classic 2D or 3D image quality assessment (IQA) metrics are not able to perform well for stereoscopic omnidirectional images. However, very few research works have focused on evaluating the perceptual visual quality of omnidirectional images, especially for stereoscopic omnidirectional images. In this paper, based on the predictive coding theory of the human vision system (HVS), we propose a stereoscopic omnidirectional image quality evaluator (SOIQE) to cope with the characteristics of 3D 360-degree images. Two modules are involved in SOIQE: predictive coding theory based binocular rivalry module and multi-view fusion module. In the binocular rivalry module, we introduce predictive coding theory to simulate the competition between high-level patterns and calculate the similarity and rivalry dominance to obtain the quality scores of viewport images. Moreover, we develop the multi-view fusion module to aggregate the quality scores of viewport images with the help of both content weight and location weight. The proposed SOIQE is a parametric model without necessary of regression learning, which ensures its interpretability and generalization performance. Experimental results on our published stereoscopic omnidirectional image quality assessment database (SOLID) demonstrate that our proposed SOIQE method outperforms state-of-the-art metrics. Furthermore, we also verify the effectiveness of each proposed module on both public stereoscopic image datasets and panoramic image datasets.

Asymmetrically Distorted Stereoscopic Image Quality Assessment Based on Ocular Dominance

Stereoscopic Image Quality Assessment by Analysing Visual Hierarchical Structures and Binocular Effects.

Reduced-Reference Stereoscopic Image Quality Assessment Based on Entropy of Gradient Primitives

Toward a Quality Predictor for Stereoscopic Images via Analysis of Human Binocular Visual Perception

Stereoscopic Omnidirectional Image Quality Assessment Based on Predictive Coding Theory

Fluoride has a beneficial effect on root caries

No-Reference Stereoscopic Image Quality Assessment Using Convolutional Neural Network for Adaptive Feature Extraction

Quality Assessment Metric of Stereo Images Considering Cyclopean Integration and Visual Saliency.

Models of Monocular and Binocular Visual Perception in Quality Assessment of Stereoscopic Images

Reduced Reference Stereoscopic Image Quality Assessment Based on Binocular Perceptual Information

Blind stereoscopic image quality assessment using 3D saliency selected binocular perception and 3D convolutional neural network

Stereoscopic Image Quality Assessment Method Based on Binocular Combination Saliency Model

Stereoscopic Image Quality Assessment By Cons Ring Binocular Visual Mechanisms

Quality Index for Stereoscopic Images by Jointly Evaluating Cyclopean Amplitude and Cyclopean Phase

Multiple Just-Noticeable-difference-based No-Reference Stereoscopic Image Quality Assessment.

Stereoscopic image quality assessment based on the binocular properties of the human visual system

Stereoscopic Video Quality Assessment Based on Visual Attention and Just-Noticeable Difference Models.

A Blind Stereoscopic Image Quality Evaluator with Segmented Stacked Autoencoders Considering the Whole Visual Perception Route

Monocular and Binocular Interactions Oriented Deformable Convolutional Networks for Blind Quality Assessment of Stereoscopic Omnidirectional Images

Projection Invariant Feature and Visual Saliency-Based Stereoscopic Omnidirectional Image Quality Assessment

Stereo image quality assessment based on visual attention