Deep Group-wise Fully Convolutional Network for Co-saliency Detection with Graph Propagation.

Lina Wei,Shanshan Zhao,Omar El Farouk Bourahla,Xi Li,Fei Wu,Yueting Zhuang
DOI: https://doi.org/10.1109/tip.2019.2909649
IF: 10.6
2019-01-01
IEEE Transactions on Image Processing
Abstract:A key problem in co-saliency detection is how to effectively model the interactive relationship of a whole image group and the individual perspective of each image in a united data-driven manner. In this paper, we propose a group-wise deep co-saliency detection approach to address the co-saliency object discovery problem based on the fully convolutional network (FCN). The proposed approach captures the group-wise interaction information for group images by learning a semantics-aware image representation based on a convolutional neural network, which adaptively learns the group-wise features for co-saliency detection. Furthermore, the proposed approach discovers the collaborative and interactive relationships between group-wise feature representation and single-image individual feature representation and models this in a collaborative learning framework. Then, we set up a unified deep learning scheme to jointly optimize the process of group-wise feature representation learning and collaborative learning, leading to more reliable and robust co-saliency detection results. Finally, we present a graph Laplacian regularized nonlinear regression model for saliency refinement. The experimental results demonstrate the effectiveness of our approach in comparison with the state-of-the-art approaches.
What problem does this paper attempt to address?