Abstract:Saliency detection based on the complementary information from RGB images and depth maps has recently gained great popularity. In this paper, we propose Complementary Attention and Adaptive Integration Network (CAAI-Net), a novel RGB-D saliency detection model that integrates complementary attention based feature concentration and adaptive cross-modal feature fusion into a unified framework for accurate saliency detection. Specifically, we propose a context-aware complementary attention (CCA) module, which consists of a feature interaction component, a complementary attention component, and a global-context component. The CCA module first utilizes the feature interaction component to extract rich local context features. The resulting features are then fed into the complementary attention component, which employs the complementary attention generated from adjacent levels to guide the attention at the current layer so that the mutual background disturbances are suppressed and the network focuses more on the areas with salient objects. Finally, we utilize a specially-designed adaptive feature integration (AFI) module, which sufficiently considers the low-quality issue of depth maps, to aggregate the RGB and depth features in an adaptive manner. Extensive experiments on six challenging benchmark datasets demonstrate that CAAI-Net is an effective saliency detection model and outperforms nine state-of-the-art models in terms of four widely-used metrics. In addition, extensive ablation studies confirm the effectiveness of the proposed CCA and AFI modules.

Review of Visual Saliency Detection with Comprehensive Information

A Brief Survey of Visual Saliency Detection

Detect saliency to understand a photo

A Review of Co-Saliency Detection Algorithms

A Review of Co-Saliency Detection Algorithms: Fundamentals, Applications, and Challenges.

A Review of Co-saliency Detection Technique: Fundamentals, Applications, and Challenges

Visual Saliency Detection Based on Region Descriptors and Prior Knowledge

Salient object detection in image sequences via spatial-temporal cue

RGB-D Visual Saliency Detection Algorithm Based on Information Guided and Multimodal Feature Fusion

RGB-D salient object detection: A survey

Rgbd Salient Object Detection: A Benchmark And Algorithms

Visual Saliency by Selective Contrast

Review of Visual Saliency Prediction: Development Process from Neurobiological Basis to Deep Models

Bio-driven visual saliency detection with color factor

A Survey of Visual Attention and Saliency Computation

Towards accurate RGB-D saliency detection with complementary attention and adaptive integration

Saliency Detection in Complex Scenes.

A biologically inspired computational model for image saliency detection.

RGB-D Saliency Detection: Dataset and Algorithm for Robot Vision

SAMM: Surroundedness and Absorption Markov Model Based Visual Saliency Detection in Images.

AN IMPROVED SALIENCY DETECTION ALGORITHM BASED ON ITTI'S MODEL