Abstract:Most existing salient object detection (SOD) methods are designed for RGB images and do not take advantage of the abundant information provided by light fields. Hence, they may fail to detect salient objects of complex structures and delineate their boundaries. Although some methods have explored multi-view information of light field images for saliency detection, they require tedious pixel-level manual annotations of ground truths. In this paper, we propose a novel weakly-supervised learning framework for salient object detection on light field images based on bounding box annotations. Our method has two major novelties. First, given an input light field image and a bounding-box annotation indicating the salient object, we propose a ground truth label hallucination method to generate a pixel-level pseudo saliency map, to avoid heavy cost of pixel-level annotations. This method generates high quality pseudo ground truth saliency maps to help supervise the training, by exploiting information obtained from the light field (including depths and RGB images). Second, to exploit the multi-view nature of the light field data in learning, we propose a fusion attention module to calibrate the spatial and channel-wise light field representations. It learns to focus on informative features and suppress redundant information from the multi-view inputs. Based on these two novelties, we are able to train a new salient object detector with two branches in a weakly-supervised manner. While the RGB branch focuses on modeling the color contrast in the all-in-focus image for locating the salient objects, the Focal branch exploits the depth and the background spatial redundancy of focal slices for eliminating background distractions. Extensive experiments show that our method outperforms existing weakly-supervised methods and most fully supervised methods.

Light field saliency object detection based on self-selected multimodal fusion

Salient Object Detection with High-Level Prior Based on Bayesian Fusion.

Light Field Saliency Detection Based on Multi-modal Fusion

A Learning-Based Method Using Data Augmentation for Light Field Salient Object Detection

Multi-Frame Image Fusion Method Combining Spatial-Temporal Saliency Detection and Nsct

Saliency Detection on Light Field: A Multi-Cue Approach

Cross-level Feature Aggregation and Fusion Network for Light Field Salient Object Detection.

Fusion-Embedding Siamese Network for Light Field Salient Object Detection

Saliency Detection on Light Field

LRNet: lightweight attention-oriented residual fusion network for light field salient object detection

ARFNet: Attention-Oriented Refinement and Fusion Network for Light Field Salient Object Detection

Learning Synergistic Attention for Light Field Salient Object Detection

LFNet: Light Field Fusion Network for Salient Object Detection.

Region-based Depth Feature Descriptor for Saliency Detection on Light Field.

Light Field Saliency Detection with Dual Local Graph Learning and Reciprocative Guidance

Multi-Path Feature Fusion Network for Saliency Detection.

Light Field Saliency Detection with Dual Local Graph Learning andReciprocative Guidance

Two-way Focal Stack Fusion for Light Field Saliency Detection

Weakly-Supervised Salient Object Detection on Light Fields.

PANet: Patch-Aware Network for Light Field Salient Object Detection.

Saliency Detection with A Deeper Investigation of Light Field