Abstract:Instance segmentation can detect where the objects are in an image, but hard to understand the relationship between them. We pay attention to a typical relationship, relative saliency. A closely related task, salient object detection, predicts a binary map highlighting a visually salient region while hard to distinguish multiple objects. Directly combining two tasks by post-processing also leads to poor performance. There is a lack of research on relative saliency at present, limiting the practical applications such as content-aware image cropping, video summary, and image labeling. In this paper, we study the Salient Object Ranking (SOR) task, which manages to assign a ranking order of each detected object according to its visual saliency. We propose the first end-to-end framework of the SOR task and solve it in a multi-task learning fashion. The framework handles instance segmentation and salient object ranking simultaneously. In this framework, the SOR branch is independent and flexible to cooperate with different detection methods, so that easy to use as a plugin. We also introduce a Position-Preserved Attention (PPA) module tailored for the SOR branch. It consists of the position embedding stage and feature interaction stage. Considering the importance of position in saliency comparison, we preserve absolute coordinates of objects in ROI pooling operation and then fuse positional information with semantic features in the first stage. In the feature interaction stage, we apply the attention mechanism to obtain proposals' contextualized representations to predict their relative ranking orders. Extensive experiments have been conducted on the ASR dataset. Without bells and whistles, our proposed method outperforms the former state-of-the-art method significantly. The code will be released publicly available on https://github.com/EricFH/SOR.

Saliency Based Opportunistic Search For Object Part Extraction And Labeling

Salient Object Segmentation Based on Automatic Labeling.

Salient Object Extraction Based on Region Saliency Ratio

Unsupervised Part Segmentation through Disentangling Appearance and Shape

Automatic interesting object extraction from images using complementary saliency maps.

Salient Object Detection Using Coarse-to-fine Processing.

Fine-Grained Image Classification Via Spatial Saliency Extraction.

Automatic salient object extraction with contextual cue

Salient Object Detection and Segmentation

Saliency-Based Localising Active Contour for Automatic Natural Object Segmentation

Saliency Detection Via Objectness Transferring

Saliency Detection by Selective Strategy for Salient Object Segmentation.

Automatic Salient Object Segmentation Based on Context and Shape Prior

Exemplar based image salient object detection

Perceptual Object Extraction Based on Saliency and Clustering.

Salient Object Detection Via Region Shape Feature Contrast and Saliency Fusion.

Exploiting Multiple Contexts for Saliency Detection.

Salient Object Detection Based on Regions

Salient Object Ranking with Position-Preserved Attention

Saliency Detection Via Sparse Reconstruction and Joint Label Inference in Multiple Features

Saliency-seeded Localizing Region-Based Active Contour for Automatic Natural Object Segmentation