Abstract:Stereoscopic/3D image quality measurement (SIQM) has emerged as an active and important research branch in image processing/computer vision field. Existing methods for blind/no-reference SIQM often train machine-learning models on degraded stereoscopic images for which human subjective quality ratings have been obtained, and they are thus constrained by the fact that only a limited number of 3D image quality datasets currently exist. Although methods have been proposed to overcome this restriction by predicting distortion parameters rather than quality scores, the approach is still limited to the time-consuming, hand-crafted features extracted to train the corresponding classification/regression models as well as the rather complicated binocular fusion/rivalry models used to predict the cyclopean view. In this paper, we explore the use of deep learning to predict distortion parameters, giving rise to a more efficient opinion-unaware SIQM technique. Specifically, a deep fusion-and-excitation network which takes into account the multiple-distortion interactions is proposed to perform distortion parameter estimation, thus avoiding hand-crafted features by using convolution layers while simultaneously accelerating the algorithm by using the GPU. Moreover, we measure distortion parameter values of the cyclopean view by using support vector regression models which are trained on the data obtained from a newly-designed subjective test. In this way, the potential errors in computing the disparity map and cyclopean view can be prevented, leading to a more rapid and precise 3D-vision distortion parameter estimation. Experimental results tested on various 3D image quality datasets demonstrate that our proposed method, in most cases, offers improved predictive performance over existing state-of-the-art methods.

A 3D Subjective Quality Prediction Model Based on Depth Distortion.

A SVR Based Quality Metric for Depth Quality Assessment

Assessment of Perceptual Depth Intensity on Source Stereoscopic Images

Deep neural network based distortion parameter estimation for blind quality measurement of stereoscopic images

From Stereo Pair to 3D Face Model

Binocular Stereoscopic Video Just Noticeable Distortion Model and Its Application to Quality Assessment

Toward a Quality Predictor for Stereoscopic Images via Analysis of Human Binocular Visual Perception

3DV Quality Model Based Depth Maps for View Synthesis in FTV System

Efficient rendering distortion estimation for depth map compression

Depth Map Intra Coding Based on Virtual View Rendering Distortion Estimation

A Novel Virtual View Distortion Estimation for Depth Maps Coding

Non-reference Virtual View Quality Evaluation of MVD

An Analytical Model for Synthesis Distortion Estimation in 3D Video.

A novel distortion model for depth coding in 3D-HEVC

Efficient Depth Map Compression For View Rendering In 3d Video

Predicting the Perceptual Quality of Point Cloud: A 3D-to-2D Projection-Based Exploration

Depth Error Induced Virtual View Synthesis Distortion Estimation for 3d Video Coding

Models of Monocular and Binocular Visual Perception in Quality Assessment of Stereoscopic Images

Synthesis distortion estimation in 3D video using frequency and spatial analysis

Objective Quality Assessment of Depth Image Based Rendering in 3DTV System

Perceptual quality prediction on authentically distorted images using a bag of features approach