Abstract:In contemporary society full of stereoscopic images, how to assess visual quality of 3D images has attracted an increasing attention in field of Stereoscopic Image Quality Assessment (SIQA). Compared with 2D-IQA, SIQA is more challenging because some complicated features of Human Visual System (HVS), such as binocular interaction and binocular fusion, must be considered. In this paper, considering both binocular interaction and fusion mechanisms of the HVS, a hierarchical no-reference stereoscopic image quality assessment network (StereoIF-Net) is proposed to simulate the whole quality perception of 3D visual signals in human cortex, including two key modules: BIM and BFM. In particular, Binocular Interaction Modules (BIMs) are constructed to simulate binocular interaction in V2-V5 visual cortex regions, in which a novel cross convolution is designed to explore the interaction details in each region. In the BIMs, different output channel numbers are designed to imitate various receptive fields in V2-V5. Furthermore, a Binocular Fusion Module (BFM) with automatic learned weights is proposed to model binocular fusion of the HVS in higher cortex layers. The verification experiments are conducted on the LIVE 3D, IVC and Waterloo-IVC SIQA databases and three indices including PLCC, SROCC and RMSE are employed to evaluate the assessment consistency between StereoIF-Net and the HVS. The proposed StereoIF-Net achieves almost the best results compared with advanced SIQA methods. Specifically, the metric values on LIVE 3D, IVC and WIVC-I are the best, and are the second-best on the WIVC-II.

No-reference stereoscopic image quality assessment using 3D visual saliency maps fused with three-channel convolutional neural network

Blind stereoscopic image quality assessment using 3D saliency selected binocular perception and 3D convolutional neural network

No-Reference Stereoscopic Image Quality Assessment Using Convolutional Neural Network for Adaptive Feature Extraction

No-reference stereoscopic image quality assessment based on binocular collaboration

No-reference stereoscopic image quality assessment based on global and local content characteristics

3D No-Reference Image Quality Assessment Via Transfer Learning and Saliency-Guided Feature Consolidation.

Learning Local Quality-Aware Structures of Salient Regions for Stereoscopic Images Via Deep Neural Networks.

No-reference Stereoscopic Image Quality Evaluator with Segmented Monocular Features and Perceptual Binocular Features

No-Reference Stereoscopic Image Quality Assessment Based on Binocular Visual Saliency Weighting.

Dual-Stream Interactive Networks for No-Reference Stereoscopic Image Quality Assessment

Stereoscopic Video Quality Assessment Based on 3D Convolutional Neural Networks

No-reference Stereoscopic Image Quality Assessment Using Binocular Self-similarity and Deep Neural Network

No-reference Stereoscopic Image Quality Assessment Based on Hue Summation-Difference Mapping Image and Binocular Joint Mutual Filtering

Two-stream Interactive Network Based on Local and Global Information for No-Reference Stereoscopic Image Quality Assessment

No-Reference Stereoscopic Image Quality Assessment Based On Contourlet Transform

A No-Reference Stereoscopic Image Quality Assessment Network Based on Binocular Interaction and Fusion Mechanisms

No-Reference Stereoscopic Image Quality Assessment Based On Shuffle-Convolutional Neural Network

No-reference Stereoscopic Image Quality Evaluator Based on Human Visual Characteristics and Relative Gradient Orientation.

No-reference stereoscopic image quality assessment using a multi-task CNN and registered distortion representation

No-reference Stereoscopic Image Quality Assessment Using Quaternion Wavelet Transform and Heterogeneous Ensemble Learning.

No-reference Stereoscopic Image Quality Assessment on Both Complex Contourlet and Spatial Domain Via Kernel ELM