Abstract:The emergence of virtual reality technology has made stereoscopic omnidirectional images (SOI) easily accessible and prompted the need to evaluate their perceptual quality. At present, most stereoscopic omnidirectional image quality assessment (SOIQA) methods rely on one of the projection formats, i.e., Equirectangular Projection (ERP) or CubeMap Projection (CMP). However, while ERP provides global information and the less distorted CMP complements it by providing local structural guidance, research on leveraging both ERP and CMP in SOIQA remains limited, hindering a comprehensive understanding of both global and local visual cues. Motivated by this gap, our study introduces a novel dual-stream perception-driven network for blind quality assessment of stereoscopic omnidirectional images. By integrating both ERP and CMP, our method effectively captures both global and local information, marking the first attempt to bridge this gap in SOIQA, particularly through deep learning methodologies. We employ an inter-intra feature fusion module, which considers both the inter-complementarity between ERP and CMP and the intra-relationships within CMP images. This module dynamically and complementarily adjusts the contributions of features from both projections and effectively integrates them to achieve a more comprehensive perception. Besides, deformable convolution is employed to extract the local region of interest, simulating the orientation selectivity of the primary visual cortex. Finally, with the features of left and right views of SOI, a stereo cross attention module that simulates the binocular fusion mechanism is proposed to predict the quality score. Extensive experiments are conducted to evaluate our model and the state-of-the-art competitors, demonstrating that our model has achieved the best performance on the databases of LIVE 3D VR, SOLID, and NBU.

Stereoscopic Video Quality Prediction Based on End-to-End Dual Stream Deep Neural Networks.

Dual-Stream Interactive Networks for No-Reference Stereoscopic Image Quality Assessment

Predictive Auto-Encoding Network for Blind Stereoscopic Image Quality Assessment

No-reference stereoscopic image quality assessment based on binocular collaboration

Stereoscopic Video Quality Assessment Based on 3D Convolutional Neural Networks

No-reference stereoscopic image quality assessment based on global and local content characteristics

Deep Neural Networks for End-to-End Spatiotemporal Video Quality Prediction and Aggregation

No-Reference Stereoscopic Image Quality Assessment Using Convolutional Neural Network for Adaptive Feature Extraction

An End-to-End No-Reference Video Quality Assessment Method with Hierarchical Spatiotemporal Feature Representation

No-Reference Stereoscopic Video Quality Assessment Based On Spatial-Temporal Statistics

Learning Blind Quality Evaluator for Stereoscopic Images Using Joint Sparse Representation

Dual-stream Perception-driven Blind Quality Assessment for Stereoscopic Omnidirectional Images

Deep Network Based Stereoscopic Image Quality Assessment Via Binocular Summing and Differencing

No-reference Stereoscopic Image Quality Assessment Using Binocular Self-similarity and Deep Neural Network

Learning Local Quality-Aware Structures of Salient Regions for Stereoscopic Images Via Deep Neural Networks.

No-Reference Quality Assessment of Stereoscopic Video Based on Deep Frequency Perception

Binocular Rivalry Oriented Predictive Autoencoding Network for Blind Stereoscopic Image Quality Measurement

Two-stream Interactive Network Based on Local and Global Information for No-Reference Stereoscopic Image Quality Assessment

Binocular Rivalry Oriented Predictive Auto-Encoding Network for Blind Stereoscopic Image Quality Measurement

No-reference Stereoscopic Image Quality Evaluator with Segmented Monocular Features and Perceptual Binocular Features

Weighted Ensemble Learning Prediction for Blind Symmetrically Distorted Stereoscopic Images.