Abstract:Most existing salient object detection (SOD) methods are designed for RGB images and do not take advantage of the abundant information provided by light fields. Hence, they may fail to detect salient objects of complex structures and delineate their boundaries. Although some methods have explored multi-view information of light field images for saliency detection, they require tedious pixel-level manual annotations of ground truths. In this paper, we propose a novel weakly-supervised learning framework for salient object detection on light field images based on bounding box annotations. Our method has two major novelties. First, given an input light field image and a bounding-box annotation indicating the salient object, we propose a ground truth label hallucination method to generate a pixel-level pseudo saliency map, to avoid heavy cost of pixel-level annotations. This method generates high quality pseudo ground truth saliency maps to help supervise the training, by exploiting information obtained from the light field (including depths and RGB images). Second, to exploit the multi-view nature of the light field data in learning, we propose a fusion attention module to calibrate the spatial and channel-wise light field representations. It learns to focus on informative features and suppress redundant information from the multi-view inputs. Based on these two novelties, we are able to train a new salient object detector with two branches in a weakly-supervised manner. While the RGB branch focuses on modeling the color contrast in the all-in-focus image for locating the salient objects, the Focal branch exploits the depth and the background spatial redundancy of focal slices for eliminating background distractions. Extensive experiments show that our method outperforms existing weakly-supervised methods and most fully supervised methods.

Saliency Detection on Light Field

Saliency Detection on Light Field: A Multi-Cue Approach

Salient Object Detection with High-Level Prior Based on Bayesian Fusion.

Saliency Detection with A Deeper Investigation of Light Field

Region-based Depth Feature Descriptor for Saliency Detection on Light Field.

A Learning-Based Method Using Data Augmentation for Light Field Salient Object Detection

Light Field Saliency Detection Based on Multi-modal Fusion

Exploring Focus and Depth-Induced Saliency Detection for Light Field

A Thorough Benchmark and a New Model for Light Field Saliency Detection

DUT-LFSaliency: Versatile Dataset and Light Field-to-RGB Saliency Detection

Deep Learning for Light Field Saliency Detection.

Light Field Saliency Detection With Deep Convolutional Networks

Deep Light-field-driven Saliency Detection from a Single View.

Saliency Detection Via Depth-induced Cellular Automata on Light Field.

Light field saliency object detection based on self-selected multimodal fusion

Learning from Pixel-Level Noisy Label : A New Perspective for Light Field Saliency Detection.

Light field salient object detection: A review and benchmark

Exploring Spatial Correlation for Light Field Saliency Detection: Expansion from a Single View.

Relative Location For Light Field Saliency Detection

Weakly-Supervised Salient Object Detection on Light Fields.