No-Reference Stereoscopic Image Quality Assessment Based on Binocular Visual Saliency Weighting.

Yurui Xie,Lei Chen,Xianye Ben,Mingqiang Yang
DOI: https://doi.org/10.1145/3582649.3582650
2023-01-01
Abstract:Deep learning is widely used in the field of image quality assessment. The complex binocular vision mechanism and the multidimensional characteristics make the quality assessment of stereoscopic images more challenging. In this paper, a new no-reference quality assessment method based on binocular visual saliency weighting for stereoscopic images is proposed. Firstly, considering the depth information, the 2D saliency map and the depth saliency map of the left and right views are fused in a linear weighting way to obtain the 3D saliency map. Next, in order to train the feature map, a four-channel convolutional neural network is built and the human vision characteristics are taken into account. Finally, the mappings of features are fine-tuned to quality scores, and the weights in accordance with 3D salient information are assigned to acquire the final predicted scores. The performance of the proposed metric has been evaluated on two extensively used databases. The experimental results show the effectiveness of our proposed method and the superiority over other related methods.
What problem does this paper attempt to address?