Abstract:This paper presents a novel model in the field of image co-saliency detection. Previous works simply design low level handcrafted features or extract deep features based on image patches for co-saliency calculation, which neglect the entire object perception properties. Besides, they also neglect the problem of visual similar region's mismatching when designing co-saliency calculation model. To solve these problems, we propose a novel strategy by considering both local prediction and global refinement (LPGR). In the local prediction stage, we train a deep convolutional saliency detection network in an end-to-end manner which only use the fully convolutional layers for saliency map prediction to capture the entire object perception properties and reduce feature redundancy. In the global refinement stage, we construct a unified co-saliency refinement model by integrating global appearance similarity into a co-saliency diffusion function, realizing the propagation and optimization of local saliency values in the context of entire image group. To overcome the adverse effects of visual similar regions' mismatching, we innovatively incorporates the inter-images saliency spread constraint (ISC) term into our co-saliency calculation function. Experimental results on public datasets demonstrate consistent performance gains of the proposed model over the state-of-the-art methods.

Consistent Video Saliency Using Local Gradient Flow Optimization and Global Refinement

Video Saliency Detection Using Motion Saliency Filter

Saliency Detection Via Local Single Gaussian Model

Region-based Saliency Estimation for 3D Shape Analysis and Understanding

Salient Region Detection Algorithm Via KL Divergence and Multi-scale Merging

Color boosted visual saliency detection and its application to image classification

Color and motion information fusion based saliency filter for video

Nonlocal Feature Transform with Iterative Refinement for Video Saliency Detection

Motion-Aware Rapid Video Saliency Detection

Video saliency detection based on robust seeds generation and spatio-temporal propagation

Co-Saliency Detection Via Local Prediction and Global Refinement.

Video Saliency Detection Using Object Proposals

Predictive Video Saliency Detection.

A New Method For Spatiotemporal Textual Saliency Detection In Video

Saliency-Aware Geodesic Video Object Segmentation

Saliency-Aware Video Object Segmentation.

Global and Local Sensitivity Guided Key Salient Object Re-augmentation for Video Saliency Detection

Global Contrast Based Salient Region Detection

Video Saliency Detection via Dynamic Consistent Spatio-Temporal Attention Modelling.

Video Co-Saliency Guided Co-Segmentation

Deep Learning for Video Saliency Detection.