Abstract:Stereoscopic omnidirectional content, as a novel visual media, has drawn wide attention in recent years due to its ability in providing strong immersive experience. Since Stereoscopic Omnidirectional Images (SOIs) involve the properties from panoramic and stereoscopic visual perception, it is very challenging to establish an efficient and effective visual quality evaluation model for SOIs. To better measure the user's experience in virtual reality, we put forward a novel deep learning framework to assess the quality of SOIs in this paper. Firstly, the deformable convolutions instead of standard convolutions are adopted to ensure the invariant receptive fields of convolutional kernels on Equi-Rectangular Projection (ERP). Secondly, according to the stereoscopic property, we use binocular-difference information and a coarse-to-fine mechanism to construct the binocular feature extraction network. Thirdly, a three-channel network involving left-view, right-view and binocular-difference channels is presented to simulate the process of monocular and binocular interactions, in which independent quality labels are provided for each channel to reflect the individual effect of monocular and binocular visions on the whole visual quality. Finally, experimental results on two available benchmark databases demonstrate the superiority of the proposed metric over the state-of-the-art blind quality assessment models in predicting the quality of SOIs. Moreover, our model is efficient in computational cost as the feature extraction is directly applied on ERP images.

Blind Quality Assessment of Stereoscopic Images Considering Binocular Perception Based on Shearlet Decomposition.

Stereoscopic Image Quality Assessment Based on Binocular Adding and Subtracting.

Stereoscopic Image Quality Assessment Combining Statistical Features and Binocular Theory

Stereoscopic Image Quality Assessment by Analysing Visual Hierarchical Structures and Binocular Effects.

Blind Stereoscopic 3D Image Quality Assessment Via Analysis of Naturalness, Structure, and Binocular Asymmetry

Blind Stereoscopic Image Quality Assessment Accounting for Human Monocular Visual Properties and Binocular Interactions

Full-reference Quality Assessment of Stereoscopic Images by Learning Binocular Visual Properties

Monocular and Binocular Interactions Oriented Deformable Convolutional Networks for Blind Quality Assessment of Stereoscopic Omnidirectional Images

Learning Blind Quality Evaluator for Stereoscopic Images Using Joint Sparse Representation

Blind Image Quality Assessment for Stereoscopic Images Using Binocular Guided Quality Lookup and Visual Codebook

Blind Stereoscopic Image Quality Evaluator Based on Binocular Semantic and Quality Channels

Blind stereoscopic image quality assessment using 3D saliency selected binocular perception and 3D convolutional neural network

No-reference Stereoscopic Image Quality Assessment Based on Hue Summation-Difference Mapping Image and Binocular Joint Mutual Filtering

Using Binocular Feature Combination for Blind Quality Assessment of Stereoscopic Images

No-reference Stereoscopic Image Quality Evaluator Based on Human Visual Characteristics and Relative Gradient Orientation.

SSIM-based Binocular Perceptual Model for Quality Assessment of Stereoscopic Images.

Blind quality assessment for multiply distorted stereoscopic images towards IoT-based 3D capture systems

Complex singular value decomposition based stereoscopic image quality assessment

Toward A Blind Deep Quality Evaluator For Stereoscopic Images Based On Monocular And Binocular Interactions

Quality of experience assessment for stereoscopic images.

Quality Index for Stereoscopic Images by Separately Evaluating Adding and Subtracting