Abstract:In this paper, we propose to learn the structures of stereoscopic image based on convolutional neural network (CNN) for no-reference quality assessment. Taking image patches from the stereoscopic images as inputs, the proposed CNN can learn the local structures which are sensitive to human perception and representative for perceptual quality evaluation. By stacking multiple convolution and max-pooling layers together, the learned structures in lower convolution layers can be composed and convolved to higher levels to form a fixed-length representation. Multilayer perceptron (MLP) is further employed to summarize the learned representation to a final value to indicate the perceptual quality of the stereo image patch pair. With different inputs, two different CNNs are designed, namely one-column CNN with only the image patch from the difference image as input, and three-column CNN with the image patches from left-view image, right-view image, and difference image as the input. The CNN parameters for stereoscopic images are learned and transferred based on the large number of 2D natural images. With the evaluation on public LIVE phase-I, LIVE phase-II, and IVC stereoscopic image databases, the proposed no-reference metric achieves the state-of-the-art performance for quality assessment of stereoscopic images, and is even competitive to existing full-reference quality metrics. HighlightsCNNs are employed to learn the local structures for stereoscopic image quality assessment.Two CNNs are designed to learn the image local structures based on different inputs.CNN parameters are pretrained on 2D images and transferred to stereoscopic images.The performances on public databases demonstrate the superiority of proposed model.

Two-stream Interactive Network Based on Local and Global Information for No-Reference Stereoscopic Image Quality Assessment

Dual-Stream Interactive Networks for No-Reference Stereoscopic Image Quality Assessment

No-Reference Stereoscopic Image Quality Assessment Using Convolutional Neural Network for Adaptive Feature Extraction

Learning Local Quality-Aware Structures of Salient Regions for Stereoscopic Images Via Deep Neural Networks.

No-reference stereoscopic image quality assessment based on binocular collaboration

No-Reference Stereoscopic Image Quality Assessment Based On Shuffle-Convolutional Neural Network

No-reference stereoscopic image quality assessment based on global and local content characteristics

No-reference stereoscopic image quality assessment using 3D visual saliency maps fused with three-channel convolutional neural network

Blind stereoscopic image quality assessment using 3D saliency selected binocular perception and 3D convolutional neural network

No-reference Stereoscopic Image Quality Evaluator Based on Human Visual Characteristics and Relative Gradient Orientation.

A No-Reference Stereoscopic Image Quality Assessment Network Based on Binocular Interaction and Fusion Mechanisms

No-reference Stereoscopic Image Quality Evaluator with Segmented Monocular Features and Perceptual Binocular Features

Stereoscopic Video Quality Assessment Based on 3D Convolutional Neural Networks

Two-Stream Convolutional Networks for Blind Image Quality Assessment

Blind Quality Assessment for Screen Content Images by Combining Local and Global Features

Perceptual Quality Prediction on Stereoscopic Three-Dimensional Images Using Efficient Local Quality Algorithms

No-reference Stereoscopic Image Quality Assessment on Both Complex Contourlet and Spatial Domain Via Kernel ELM

Stereoscopic Image Quality Assessment Combining Statistical Features and Binocular Theory

Learning structure of stereoscopic image for no-reference quality assessment with convolutional neural network.

No-reference stereoscopic image quality assessment using a multi-task CNN and registered distortion representation

3D No-Reference Image Quality Assessment Via Transfer Learning and Saliency-Guided Feature Consolidation.