Abstract:Stereo image quality assessment (SIQA) plays a crucial role in evaluating and improving the visual experience of 3D content. Existing visual properties-based methods for SIQA have achieved promising performance. However, these approaches ignore the top-down philosophy, leading to a lack of a comprehensive grasp of the human visual system (HVS) and SIQA. This paper presents a novel Stereo AttenTion Network (SATNet), which employs a top-down perspective to guide the quality assessment process. Specifically, our generalized Stereo AttenTion (SAT) structure adapts components and input/output for stereo scenarios. It leverages the fusion-generated attention map as a higher-level binocular modulator to influence two lower-level monocular features, allowing progressive recalibration of both throughout the pipeline. Additionally, we introduce an Energy Coefficient (EC) to flexibly tune the magnitude of binocular response, accounting for the fact that binocular responses in the primate primary visual cortex are less than the sum of monocular responses. To extract the most discriminative quality information from the summation and subtraction of the two branches of monocular features, we utilize a dual-pooling strategy that applies min-pooling and max-pooling operations to the respective branches. Experimental results highlight the superiority of our top-down method in advancing the state-of-the-art in the SIQA field. The code is available at <a class="link-external link-https" href="https://github.com/Fanning-Zhang/SATNet" rel="external noopener nofollow">this https URL</a>.

New Metric for Stereo Image Quality Assessment Based on HVS

Stereo image quality assessment based on visual attention

A New Image Coding Quality Assessment.

Assessment of Perceptual Depth Intensity on Source Stereoscopic Images

Quality Assessment Metric of Stereo Images Considering Cyclopean Integration and Visual Saliency.

Image quality assessment incorporating the interaction of spatial and spectral sensitivities of HVS

A multiview video quality assessment method based on disparity and SSIM

Models of Monocular and Binocular Visual Perception in Quality Assessment of Stereoscopic Images

Towards Top-Down Stereo Image Quality Assessment via Stereo Attention

Quality of experience assessment for stereoscopic images.

Multiple Just-Noticeable-difference-based No-Reference Stereoscopic Image Quality Assessment.

Stereoscopic Image Quality Assessment Based on Depth and Texture Information

An Efficient Human Visual System Based Quality Metric for 3D Video

Quality Assessment for Stereoscopic Image Based on DCT Frequency Information

Binocular Stereoscopic Video Just Noticeable Distortion Model and Its Application to Quality Assessment

Sparse Representation Based Stereoscopic Image Quality Assessment Accounting for Perceptual Cognitive Process

A Video Quality Assessment Metric Based on Human Visual System

DCT-based objective quality assessment metric of 2D/3D image

Stereoscopic Image Quality Assessment Method Based on Binocular Combination Saliency Model

Toward a Quality Predictor for Stereoscopic Images via Analysis of Human Binocular Visual Perception

Subjective quality assessment of stereo image compression based on stereoscopic fusion in binocular vision