Abstract:This paper advocates a novel video saliency detection method based on the spatial-temporal saliency fusion and low-rank coherency guided saliency diffusion. In sharp contrast to the conventional methods, which conduct saliency detection locally in a frame-by-frame way and could easily give rise to incorrect low-level saliency map, in order to overcome the existing difficulties, this paper proposes to fuse the color saliency based on global motion clues in a batch-wise fashion. And we also propose low-rank coherency guided spatial-temporal saliency diffusion to guarantee the temporal smoothness of saliency maps. Meanwhile, a series of saliency boosting strategies are designed to further improve the saliency accuracy. First, the original long-term video sequence is equally segmented into many short-term frame batches, and the motion clues of the individual video batch are integrated and diffused temporally to facilitate the computation of color saliency. Then, based on the obtained saliency clues, inter-batch saliency priors are modeled to guide the low-level saliency fusion. After that, both the raw color information and the fused low-level saliency are regarded as the low-rank coherency clues, which are employed to guide the spatial-temporal saliency diffusion with the help of an additional permutation matrix serving as the alternative rank selection strategy. Thus, it could guarantee the robustness of the saliency map's temporal consistence, and further boost the accuracy of the computed saliency map. Moreover, we conduct extensive experiments on five public available benchmarks, and make comprehensive, quantitative evaluations between our method and 16 state-of-the-art techniques. All the results demonstrate the superiority of our method in accuracy, reliability, robustness, and versatility.

Self-Adaptively Weighted Co-Saliency Detection Via Rank Constraint

Saliency map fusion based on rank-one constraint

Image Saliency and Co-Saliency Detection by Low-Rank Multiscale Fusion

Saliency and Co-Saliency Detection by Low-Rank Multiscale Fusion

Saliency Detection Via Coarse-to-fine Diffusion-Based Compactness with Weighted Learning Affinity Matrix

Co-Saliency Detection via Hierarchical Consistency Measure

Co-saliency Detection Based on Hierarchical Consistency.

Video Saliency Detection Via Spatial-Temporal Fusion and Low-Rank Coherency Diffusion

Double Low Rank Matrix Recovery for Saliency Fusion.

Co-saliency Detection Via Similarity-Based Saliency Propagation

Co-saliency Detection Via Cluster-Based Structured Matrix Decomposition

Salient Region Detection by Fusing Foreground and Background Cues Extracted from Single Image

Salient object detection with low-rank approximation and ℓ2,1-norm minimization

Cluster-Based Co-Saliency Detection.

A New Method and Benchmark for Detecting Co-Saliency Within a Single Image

Self-supervised image co-saliency detection

A Feature-Adaptive Semi-Supervised Framework for Co-saliency Detection.

A Saliency-Fusion-Based Framework for Co-localization.

Co-Saliency Detection Within a Single Image

Co-saliency Detection via Sparse Reconstruction and Co-salient Object Discovery.

Co-saliency detection via inter and intra saliency propagation.