Salient object detection of social images based on semantic tag context.

Ye Liang,Congyan Lang,Jian Yu,Hongzhe Liu
DOI: https://doi.org/10.1504/ijsnet.2017.10004217
2017-01-01
Abstract:Salient object detection is an important process for machines to understand visual contents as humans. Typically, most previous studies on salient object detection infer salient map by only using the visual features. In this paper, we propose a new paradigm on salient object detection, which aims at producing more reliable results by mining the context information from user's annotated tags. To address this problem, we firstly construct a large scale salient object dataset, which includes 5429 images from the NUSWIDE dataset a real world web image database from National University of Singapore with tag information and accurate human-labeled masks. Moreover, a specialised conditional random field CRF model is also proposed which takes account of both tag contexts and appearance cues. Extensive experiments show the effectiveness and superiority of our model which can accurately locate the salient objects.
What problem does this paper attempt to address?