Abstract:The emergence of virtual reality technology has made stereoscopic omnidirectional images (SOI) easily accessible and prompted the need to evaluate their perceptual quality. At present, most stereoscopic omnidirectional image quality assessment (SOIQA) methods rely on one of the projection formats, i.e., Equirectangular Projection (ERP) or CubeMap Projection (CMP). However, while ERP provides global information and the less distorted CMP complements it by providing local structural guidance, research on leveraging both ERP and CMP in SOIQA remains limited, hindering a comprehensive understanding of both global and local visual cues. Motivated by this gap, our study introduces a novel dual-stream perception-driven network for blind quality assessment of stereoscopic omnidirectional images. By integrating both ERP and CMP, our method effectively captures both global and local information, marking the first attempt to bridge this gap in SOIQA, particularly through deep learning methodologies. We employ an inter-intra feature fusion module, which considers both the inter-complementarity between ERP and CMP and the intra-relationships within CMP images. This module dynamically and complementarily adjusts the contributions of features from both projections and effectively integrates them to achieve a more comprehensive perception. Besides, deformable convolution is employed to extract the local region of interest, simulating the orientation selectivity of the primary visual cortex. Finally, with the features of left and right views of SOI, a stereo cross attention module that simulates the binocular fusion mechanism is proposed to predict the quality score. Extensive experiments are conducted to evaluate our model and the state-of-the-art competitors, demonstrating that our model has achieved the best performance on the databases of LIVE 3D VR, SOLID, and NBU.

Blind Omnidirectional Image Quality Assessment Based on Semantic Information Replenishment

Blind Omnidirectional Image Quality Assessment with Representative Features and Viewport Oriented Statistical Features

Assessor360: Multi-sequence Network for Blind Omnidirectional Image Quality Assessment

Dual-Level Blind Omnidirectional Image Quality Assessment Network Based on Human Visual Perception

Blind Omnidirectional Image Quality Assessment: Integrating Local Statistics and Global Semantics

Blind Omnidirectional Image Quality Assessment Based on Structure and Natural Features

Multifaceted Perception-Based Blind Omnidirectional Image Quality Assessment

A Feature-Enriched Completely Blind Image Quality Evaluator

Toward A No-reference Omnidirectional Image Quality Evaluation by Using Multi-perceptual Features

Dual-stream Perception-driven Blind Quality Assessment for Stereoscopic Omnidirectional Images

Perceptual Information Completion-Based Siamese Omnidirectional Image Quality Assessment Network

No-reference Image Quality Assessment with Center-Surround Based Natural Scene Statistics

Blind Image Quality Assessment Using Multi-Stream Architecture with Spatial and Channel Attention

Blind Image Quality Assessment Via Cross-View Consistency

Blind Image Quality Assessment With Active Inference

Stereoscopic Omnidirectional Image Quality Assessment Based on Predictive Coding Theory

Viewport Perception Based Blind Stereoscopic Omnidirectional Image Quality Assessment

Blind Image Quality Assessment by Natural Scene Statistics and Perceptual Characteristics

Bag-of-words Feature Representation for Blind Image Quality Assessment with Local Quantized Pattern.

Completely Blind Image Quality Assessment Using Latent Quality Factor From Image Local Structure Representation

Blind Image Quality Index with High-Level Semantic Guidance and Low-Level Fine-Grained Representation