Abstract:Stereo image quality assessment (SIQA) plays a crucial role in evaluating and improving the visual experience of 3D content. Existing visual properties-based methods for SIQA have achieved promising performance. However, these approaches ignore the top-down philosophy, leading to a lack of a comprehensive grasp of the human visual system (HVS) and SIQA. This paper presents a novel Stereo AttenTion Network (SATNet), which employs a top-down perspective to guide the quality assessment process. Specifically, our generalized Stereo AttenTion (SAT) structure adapts components and input/output for stereo scenarios. It leverages the fusion-generated attention map as a higher-level binocular modulator to influence two lower-level monocular features, allowing progressive recalibration of both throughout the pipeline. Additionally, we introduce an Energy Coefficient (EC) to flexibly tune the magnitude of binocular response, accounting for the fact that binocular responses in the primate primary visual cortex are less than the sum of monocular responses. To extract the most discriminative quality information from the summation and subtraction of the two branches of monocular features, we utilize a dual-pooling strategy that applies min-pooling and max-pooling operations to the respective branches. Experimental results highlight the superiority of our top-down method in advancing the state-of-the-art in the SIQA field. The code is available at <a class="link-external link-https" href="https://github.com/Fanning-Zhang/SATNet" rel="external noopener nofollow">this https URL</a>.

Research on binocular stereo video attention model based on human visual system

Learning Stereoscopic Visual Attention Model for 3d Video

Human-Computer Interaction System Based on Binocular Stereo Vision

Stereo image quality assessment based on visual attention

Binocular Stereoscopic Video Just Noticeable Distortion Model and Its Application to Quality Assessment

Subjective quality assessment of stereo image compression based on stereoscopic fusion in binocular vision

Binocular Stereo Vision Technology Based on Human Visual Characteristics

A novel H.264 rate control algorithm with consideration of visual attention

Stereoscopic Video Synthesis from A Monocular Video

Visually Imbalanced Stereo Matching

Video segmentation based motion estimation for stereoscopic video

Binocular-Combination-Oriented Perceptual Rate-Distortion Optimization for Stereoscopic Video Coding

A Computational Model for Stereoscopic Visual Saliency Prediction

Stereoscopic Video Quality Assessment Based on Visual Attention and Just-Noticeable Difference Models.

A Robust 3D Visual Saliency Computation Model for Human Fixation Prediction of Stereoscopic Videos

Toward a Quality Predictor for Stereoscopic Images via Analysis of Human Binocular Visual Perception

Stereoscopic Visual Attention-Based Regional Bit Allocation Optimization for Multiview Video Coding

Surveillance Source Compression with Background Modeling for Video Big Data

A Compact Representation for Compressing Converted Stereo Videos

Towards Top-Down Stereo Image Quality Assessment via Stereo Attention

Research situation and development trend of the binocular stereo vision system