Abstract:In contemporary society full of stereoscopic images, how to assess visual quality of 3D images has attracted an increasing attention in field of Stereoscopic Image Quality Assessment (SIQA). Compared with 2D-IQA, SIQA is more challenging because some complicated features of Human Visual System (HVS), such as binocular interaction and binocular fusion, must be considered. In this paper, considering both binocular interaction and fusion mechanisms of the HVS, a hierarchical no-reference stereoscopic image quality assessment network (StereoIF-Net) is proposed to simulate the whole quality perception of 3D visual signals in human cortex, including two key modules: BIM and BFM. In particular, Binocular Interaction Modules (BIMs) are constructed to simulate binocular interaction in V2-V5 visual cortex regions, in which a novel cross convolution is designed to explore the interaction details in each region. In the BIMs, different output channel numbers are designed to imitate various receptive fields in V2-V5. Furthermore, a Binocular Fusion Module (BFM) with automatic learned weights is proposed to model binocular fusion of the HVS in higher cortex layers. The verification experiments are conducted on the LIVE 3D, IVC and Waterloo-IVC SIQA databases and three indices including PLCC, SROCC and RMSE are employed to evaluate the assessment consistency between StereoIF-Net and the HVS. The proposed StereoIF-Net achieves almost the best results compared with advanced SIQA methods. Specifically, the metric values on LIVE 3D, IVC and WIVC-I are the best, and are the second-best on the WIVC-II.

Deep Network Based Stereoscopic Image Quality Assessment Via Binocular Summing and Differencing

Binocular Depth Estimation Using Convolutional Neural Network With Siamese Branches.

No-reference Stereoscopic Image Quality Assessment Using Binocular Self-similarity and Deep Neural Network

Monocular and Binocular Interactions Oriented Deformable Convolutional Networks for Blind Quality Assessment of Stereoscopic Omnidirectional Images

No-Reference Stereoscopic Image Quality Assessment Based on Binocular Visual Saliency Weighting.

Binocular Rivalry Oriented Predictive Auto-Encoding Network for Blind Stereoscopic Image Quality Measurement

Binocular Rivalry Oriented Predictive Autoencoding Network for Blind Stereoscopic Image Quality Measurement

Stereoscopic Image Quality Assessment Combining Statistical Features and Binocular Theory

Using Binocular Feature Combination for Blind Quality Assessment of Stereoscopic Images

Toward A Blind Deep Quality Evaluator For Stereoscopic Images Based On Monocular And Binocular Interactions

A Full-Reference Stereoscopic Image Quality Measurement Via Hierarchical Deep Feature Degradation Fusion.

Blind Stereoscopic Image Quality Evaluator Based on Binocular Semantic and Quality Channels

Blind Assessment for Stereo Images Considering Binocular Characteristics and Deep Perception Map Based on Deep Belief Network

Stereoscopic Image Quality Assessment By Cons Ring Binocular Visual Mechanisms

Blind Stereoscopic Image Quality Assessment by Deep Neural Network of Multi-Level Feature Fusion.

Predictive Auto-Encoding Network for Blind Stereoscopic Image Quality Assessment

Blind Symmetrically Distorted Stereoscopic Images Quality Assessment Based on Weighted Ensemble Learning

Learning Local Quality-Aware Structures of Salient Regions for Stereoscopic Images Via Deep Neural Networks.

A No-Reference Stereoscopic Image Quality Assessment Network Based on Binocular Interaction and Fusion Mechanisms

Stereoscopic Image Quality Assessment Based on Binocular Adding and Subtracting.

Full-Reference Quality Assessment of Stereoscopic Images by Learning Binocular Receptive Field Properties