Saliency detection based on manifold learning

Zhi Yang,Dehua Li,Jie Wang,Xuan Li

DOI: https://doi.org/10.1117/12.2030837

2013-01-01

Abstract:Visual saliency has recently attracted lots of research interest in the computer vision community. In this paper, we propose a novel computational model for bottom-up saliency detection based on manifold learning. A typical graph-based manifold learning algorithm, namely the diffusion map, is adopted for establishing our saliency model. In the proposed method, firstly, a graph is constructed using low-level image features. Then, the diffusion map algorithm is performed to learn the diffusion distances, which are utilized to derive the saliency measure. Compared to existing saliency models, our method has the advantage of being able to capture the intrinsic nonlinear structures in the original feature space. Moreover, due to the inherent characteristics of the diffusion map algorithm, our method can deal with the multi-scale issue effectively, which is crucial to any saliency model. Experimental results on publicly available data demonstrate that our method outperforms the state-of-the-art saliency models, both qualitatively and quantitatively.