Abstract:The emergence of virtual reality technology has made stereoscopic omnidirectional images (SOI) easily accessible and prompted the need to evaluate their perceptual quality. At present, most stereoscopic omnidirectional image quality assessment (SOIQA) methods rely on one of the projection formats, i.e., Equirectangular Projection (ERP) or CubeMap Projection (CMP). However, while ERP provides global information and the less distorted CMP complements it by providing local structural guidance, research on leveraging both ERP and CMP in SOIQA remains limited, hindering a comprehensive understanding of both global and local visual cues. Motivated by this gap, our study introduces a novel dual-stream perception-driven network for blind quality assessment of stereoscopic omnidirectional images. By integrating both ERP and CMP, our method effectively captures both global and local information, marking the first attempt to bridge this gap in SOIQA, particularly through deep learning methodologies. We employ an inter-intra feature fusion module, which considers both the inter-complementarity between ERP and CMP and the intra-relationships within CMP images. This module dynamically and complementarily adjusts the contributions of features from both projections and effectively integrates them to achieve a more comprehensive perception. Besides, deformable convolution is employed to extract the local region of interest, simulating the orientation selectivity of the primary visual cortex. Finally, with the features of left and right views of SOI, a stereo cross attention module that simulates the binocular fusion mechanism is proposed to predict the quality score. Extensive experiments are conducted to evaluate our model and the state-of-the-art competitors, demonstrating that our model has achieved the best performance on the databases of LIVE 3D VR, SOLID, and NBU.

Toward A Blind Deep Quality Evaluator For Stereoscopic Images Based On Monocular And Binocular Interactions

Assessment of Perceptual Depth Intensity on Source Stereoscopic Images

Blind Assessment for Stereo Images Considering Binocular Characteristics and Deep Perception Map Based on Deep Belief Network

No-reference Stereoscopic Image Quality Assessment Using Binocular Self-similarity and Deep Neural Network

Learning Blind Quality Evaluator for Stereoscopic Images Using Joint Sparse Representation

Stereoscopic Images Quality Assessment Based On Deep Learning

Learning Receptive Fields and Quality Lookups for Blind Quality Assessment of Stereoscopic Images

Monocular and Binocular Interactions Oriented Deformable Convolutional Networks for Blind Quality Assessment of Stereoscopic Omnidirectional Images

Blind Image Quality Assessment for Stereoscopic Images Using Binocular Guided Quality Lookup and Visual Codebook

Models of Monocular and Binocular Visual Perception in Quality Assessment of Stereoscopic Images

Blind Quality Assessment of Stereoscopic Images Considering Binocular Perception Based on Shearlet Decomposition.

Quality of experience assessment for stereoscopic images.

Blind Stereoscopic Image Quality Assessment Accounting for Human Monocular Visual Properties and Binocular Interactions

Blindly Evaluating Stereoscopic Image Quality with Free-Energy Principle.

Using Binocular Feature Combination for Blind Quality Assessment of Stereoscopic Images

Blind Stereoscopic Image Quality Assessment by Deep Neural Network of Multi-Level Feature Fusion.

Blind S3D Image Quality Prediction Using Classical and Non-Classical Receptive Field Models

Blind Stereoscopic 3D Image Quality Assessment Via Analysis of Naturalness, Structure, and Binocular Asymmetry

Dual-stream Perception-driven Blind Quality Assessment for Stereoscopic Omnidirectional Images

Full-Reference Quality Assessment of Stereoscopic Images by Learning Binocular Receptive Field Properties

Stereoscopic Image Quality Assessment Based on Binocular Adding and Subtracting.