Abstract:Salient object detection is aimed at detecting and segmenting objects that human eyes are most focused on when viewing a scene. Recently, conditional random field (CRF) is drawn renewed interest, and is exploited in this field. However, when utilizing a CRF with unary and pairwise potentials having essential parameters, most existing methods only employ manually designed parameters, or learn parameters partly for the unary potentials. Observing that the saliency estimation is a continuous labeling issue, this paper proposes a novel data-driven scheme based on a special CRF framework, the so-called continuous CRF (C-CRF), where parameters for both unary and pairwise potentials are jointly learned. The proposed C-CRF learning provides an optimal way to integrate various unary saliency features with pairwise cues to discover salient objects. To the best of our knowledge, the proposed scheme is the first to completely learn a C-CRF for saliency detection. In addition, we propose a novel formulation of pairwise potentials that enables learning weights for different spatial ranges on a superpixel graph. The proposed C-CRF learning-based saliency model is tested on 6 benchmark datasets and compared with 11 existing methods. Our results and comparisons have provided further support to the proposed method in terms of precision-recall and F-measure. Furthermore, incorporating existing saliency models with pairwise cues through the C-CRF are shown to provide marked boosting performance over individual models.

Computing Object-Based Saliency Via Locality-Constrained Linear Coding and Conditional Random Fields

CRF with Locality-Consistent Dictionary Learning for Semantic Segmentation

Joint CRF and Locality-Consistent Dictionary Learning for Semantic Segmentation.

Saliency Detection Via Local Single Gaussian Model

Combining Background Information and A Top-Down Model for Computing Salient Objects

Hierarchical Saliency Mapping for Weakly Supervised Object Localization Based on Class Activation Mapping

Saliency Detection by Fully Learning a Continuous Conditional Random Field

A Superpixel-Based CRF Saliency Detection Approach

Extended Locality-Constrained Linear Self-Coding for Saliency Detection

Salient object detection via global and local cues

Salient Region Detection by Fusing Foreground and Background Cues Extracted from Single Image

Locality and Context-Aware Top-Down Saliency

Locality-constrained linear coding combined with saliency similarity

Saliency Detection Via Joint Modeling Global Shape and Local Consistency.

Hybrid of Extended Locality-Constrained Linear Coding and Manifold Ranking for Salient Object Detection.

A new visual saliency model based on Tobii eye tracking and multiscale conditional random fields

Two-Stage Saliency Detection Based on Continuous CRF and Sparse Coding.

A Local Texture-Based Superpixel Feature Coding for Saliency Detection Combined with Global Saliency

Structured Modeling of Joint Deep Feature and Prediction Refinement for Salient Object Detection.

An Object-Oriented Visual Saliency Detection Framework Based on Sparse Coding Representations

Salient Object Detection With Cnns And Multi-Scale Crfs