Abstract:Stereoscopic/3D image quality measurement (SIQM) has emerged as an active and important research branch in image processing/computer vision field. Existing methods for blind/no-reference SIQM often train machine-learning models on degraded stereoscopic images for which human subjective quality ratings have been obtained, and they are thus constrained by the fact that only a limited number of 3D image quality datasets currently exist. Although methods have been proposed to overcome this restriction by predicting distortion parameters rather than quality scores, the approach is still limited to the time-consuming, hand-crafted features extracted to train the corresponding classification/regression models as well as the rather complicated binocular fusion/rivalry models used to predict the cyclopean view. In this paper, we explore the use of deep learning to predict distortion parameters, giving rise to a more efficient opinion-unaware SIQM technique. Specifically, a deep fusion-and-excitation network which takes into account the multiple-distortion interactions is proposed to perform distortion parameter estimation, thus avoiding hand-crafted features by using convolution layers while simultaneously accelerating the algorithm by using the GPU. Moreover, we measure distortion parameter values of the cyclopean view by using support vector regression models which are trained on the data obtained from a newly-designed subjective test. In this way, the potential errors in computing the disparity map and cyclopean view can be prevented, leading to a more rapid and precise 3D-vision distortion parameter estimation. Experimental results tested on various 3D image quality datasets demonstrate that our proposed method, in most cases, offers improved predictive performance over existing state-of-the-art methods.

Blind stereoscopic image quality assessment using 3D saliency selected binocular perception and 3D convolutional neural network

No-reference stereoscopic image quality assessment using 3D visual saliency maps fused with three-channel convolutional neural network

No-Reference Stereoscopic Image Quality Assessment Using Convolutional Neural Network for Adaptive Feature Extraction

No-reference stereoscopic image quality assessment based on binocular collaboration

SCVS: Blind Image Quality Assessment Based on Spatial Correlation and Visual Saliency

Learning Local Quality-Aware Structures of Salient Regions for Stereoscopic Images Via Deep Neural Networks.

Stereoscopic Video Quality Assessment Based on 3D Convolutional Neural Networks

Stereoscopic Image Quality Assessment by Analysing Visual Hierarchical Structures and Binocular Effects.

No-reference stereoscopic image quality assessment based on global and local content characteristics

Monocular and Binocular Interactions Oriented Deformable Convolutional Networks for Blind Quality Assessment of Stereoscopic Omnidirectional Images

3D No-Reference Image Quality Assessment Via Transfer Learning and Saliency-Guided Feature Consolidation.

Toward A Blind Deep Quality Evaluator For Stereoscopic Images Based On Monocular And Binocular Interactions

Learning Receptive Fields and Quality Lookups for Blind Quality Assessment of Stereoscopic Images

Learning Blind Quality Evaluator for Stereoscopic Images Using Joint Sparse Representation

Blind 3D Image Quality Assessment Based on Multi-scale Feature Learning

A Blind Stereoscopic Image Quality Evaluator with Segmented Stacked Autoencoders Considering the Whole Visual Perception Route

Stereoscopic Image Quality Assessment Method Based on Binocular Combination Saliency Model

Deep neural network based distortion parameter estimation for blind quality measurement of stereoscopic images

Quality Assessment Metric of Stereo Images Considering Cyclopean Integration and Visual Saliency.

Quality Index for Stereoscopic Images by Jointly Evaluating Cyclopean Amplitude and Cyclopean Phase

Reduced-Reference Stereoscopic Image Quality Assessment Based on Entropy of Gradient Primitives