Abstract:With the rapid development of Internet, the amounts of images and videos are now growing explosively, leading to many new challenges on image/video processing. On one hand, the processing capability of computer is limited and the computational resource should be allocated to the important visual information with high priorities. On the other hand, the analysis results given by computer should be consistent with human cognition. To solve these two problems, this thesis will focus on learning-based visual saliency computation and the main objective can be described as predicting, locating and mining the important visual information that is consistent with human cognition. The main contributions of this thesis can be summarized as follows: Firstly, this thesis presents a probabilistic multi-task learning approach for computing visual saliency by simultaneously integrating the bottom-up and topdown factors. To the best of our knowledge, it is the first approach that explores the problem of visual saliency computation with the multi-task learning algorithm. In our approach, the bottom-up and the top-down factors are considered simultaneously in a probabilistic framework. In this framework, a bottom-up component simulates the low-level processes in human vision system using multi-scale wavelet decomposition; while a top-down component simulates the high-level processes to bias the competition of the input visual stimuli. Moreover, we propose a multi-task learning algorithm to optimize the models and model fusion strategies for various scenes. Extensive experiments on several datasets show that this approach demonstrates high robustness and effectiveness in computing visual saliency.

Modern Learning Methodologies for Co-Saliency Detection

Detect saliency to understand a photo

Cluster-Based Co-Saliency Detection.

A Unified Metric Learning-Based Framework for Co-Saliency Detection.

Saliency Detection by Multiple-Instance Learning

A Review of Co-Saliency Detection Algorithms

Learning-based Visual Saliency Computation

Self-supervised image co-saliency detection

Co-saliency Detection Based on Hierarchical Consistency.

A Review of Co-saliency Detection Technique: Fundamentals, Applications, and Challenges

A Review of Co-Saliency Detection Algorithms: Fundamentals, Applications, and Challenges.

A New Method and Benchmark for Detecting Co-Saliency Within a Single Image

An Object-Oriented Visual Saliency Detection Framework Based on Sparse Coding Representations

Co-saliency Detection Via Looking Deep and Wide

Co-saliency detection via inter and intra saliency propagation.

Co-learning Saliency Detection with Coupled Channels and Low-Rank Factorization

Saliency Detection Based on Multiple-Level Feature Learning

Co-Saliency Detection Within a Single Image

GreenSaliency: A Lightweight and Efficient Image Saliency Detection Method

Co-saliency Detection Based on Siamese Network

Co-saliency Detection Via Similarity-Based Saliency Propagation