Abstract:Stereoscopic omnidirectional content, as a novel visual media, has drawn wide attention in recent years due to its ability in providing strong immersive experience. Since Stereoscopic Omnidirectional Images (SOIs) involve the properties from panoramic and stereoscopic visual perception, it is very challenging to establish an efficient and effective visual quality evaluation model for SOIs. To better measure the user's experience in virtual reality, we put forward a novel deep learning framework to assess the quality of SOIs in this paper. Firstly, the deformable convolutions instead of standard convolutions are adopted to ensure the invariant receptive fields of convolutional kernels on Equi-Rectangular Projection (ERP). Secondly, according to the stereoscopic property, we use binocular-difference information and a coarse-to-fine mechanism to construct the binocular feature extraction network. Thirdly, a three-channel network involving left-view, right-view and binocular-difference channels is presented to simulate the process of monocular and binocular interactions, in which independent quality labels are provided for each channel to reflect the individual effect of monocular and binocular visions on the whole visual quality. Finally, experimental results on two available benchmark databases demonstrate the superiority of the proposed metric over the state-of-the-art blind quality assessment models in predicting the quality of SOIs. Moreover, our model is efficient in computational cost as the feature extraction is directly applied on ERP images.

Blind Stereoscopic Image Quality Evaluator Based on Binocular Semantic and Quality Channels

Blind Quality Assessment of Stereoscopic Images Considering Binocular Perception Based on Shearlet Decomposition.

A Blind Stereoscopic Image Quality Evaluator with Segmented Stacked Autoencoders Considering the Whole Visual Perception Route

Blind stereoscopic image quality assessment using 3D saliency selected binocular perception and 3D convolutional neural network

Stereoscopic Image Quality Assessment Combining Statistical Features and Binocular Theory

Stereoscopic Image Quality Assessment Based on Binocular Adding and Subtracting.

Monocular and Binocular Interactions Oriented Deformable Convolutional Networks for Blind Quality Assessment of Stereoscopic Omnidirectional Images

Binocular Rivalry Oriented Predictive Autoencoding Network for Blind Stereoscopic Image Quality Measurement

Predictive Auto-Encoding Network for Blind Stereoscopic Image Quality Assessment

Binocular Rivalry Oriented Predictive Auto-Encoding Network for Blind Stereoscopic Image Quality Measurement

Blind Stereoscopic Image Quality Assessment Accounting for Human Monocular Visual Properties and Binocular Interactions

Learning Blind Quality Evaluator for Stereoscopic Images Using Joint Sparse Representation

No-Reference Stereoscopic Image Quality Assessment Using Convolutional Neural Network for Adaptive Feature Extraction

Blind Quality Assessment for Screen Content Images by Combining Local and Global Features

No-reference Stereoscopic Image Quality Evaluator Based on Human Visual Characteristics and Relative Gradient Orientation.

Stereoscopic Image Quality Assessment by Analysing Visual Hierarchical Structures and Binocular Effects.

Blind S3D Image Quality Prediction Using Classical and Non-Classical Receptive Field Models

Deep Network Based Stereoscopic Image Quality Assessment Via Binocular Summing and Differencing

Using Binocular Feature Combination for Blind Quality Assessment of Stereoscopic Images

No-reference Stereoscopic Image Quality Assessment Using Binocular Self-similarity and Deep Neural Network

Toward A Blind Deep Quality Evaluator For Stereoscopic Images Based On Monocular And Binocular Interactions