Abstract:RGB-D salient object detection (SOD) usually describes two modes' classification or regression problem, namely RGB and depth. The existing RGB-D SOD methods use depth hints to increase the detection performance, meanwhile they focus on the quality of little depth maps. In practical application, the interference of various problems in the acquisition process affects the depth map quality, which dramatically reduces the detection effect. In this paper, to minimize interference in depth mapping and emphasize prominent objects in RGB images, we put forward a layered interactive attention network (LIANet). The whole network model adopts the idea of double branch structure to integrate RGB information and Depth information. The network has three parts: feature coding, layered fusion mechanism, and feature decoding. In the feature coding stage, a simple attention module (SAM) is added, which defines the energy function considering the weights of channel and space dimensions. This module enables the network to learn more discriminating neurons without adding parameters. By refining these neurons, the high-level semantic features of images can be fully mined. The layered interactive fusion module (LIFM) is the most critical part of this paper. This module effectively enhances the cross-modal interaction between RGB features and depth features. The RGB-depth-RGB modulation feedback mechanism successfully eliminates interference in the depth map and accurately highlights the features of salient objects. In addition, we also used mixed losses to optimize further and train our model. Finally, a mass of experiments on six standard datasets demonstrated the importance of the method, and a timely detection speed reaches 30 fps on every dataset.

Asymmetric deep interaction network for RGB-D salient object detection

Cross-modality Discrepant Interaction Network for RGB-D Salient Object Detection

Attention-Guided Multi-Modality Interaction Network for RGB-D Salient Object Detection

Feature interaction and two-stage cross-modal fusion for RGB-D salient object detection

Depth Cue Enhancement and Guidance Network for RGB-D Salient Object Detection

CFIDNet: cascaded feature interaction decoder for RGB-D salient object detection

HODINet: High-Order Discrepant Interaction Network for RGB-D Salient Object Detection

Absolute and Relative Depth-Induced Network for RGB-D Salient Object Detection

Hierarchical Alternate Interaction Network for RGB-D Salient Object Detection.

LIANet: Layer Interactive Attention Network for RGB-D Salient Object Detection

TANet: Transformer-based Asymmetric Network for RGB-D Salient Object Detection

ADNet: An Asymmetric Dual-Stream Network for RGB-T Salient Object Detection.

Deep Feature Filtering and Contextual Information Gathering Network for RGB-D Salient Object Detection

DPANet: Depth Potentiality-Aware Gated Attention Network for RGB-D Salient Object Detection

CDNet: Complementary Depth Network for RGB-D Salient Object Detection.

Compensated Attention Feature Fusion and Hierarchical Multiplication Decoder Network for RGB-D Salient Object Detection

Encoder Deep Interleaved Network with Multi-Scale Aggregation for RGB-D Salient Object Detection

Depth-Induced Gap-Reducing Network for RGB-D Salient Object Detection: an Interaction, Guidance and Refinement Approach

Dual Mutual Learning Network with Global-local Awareness for RGB-D Salient Object Detection

Multi-level cross-modal interaction network for RGB-D salient object detection

Attention-guided cross-modal multiple feature aggregation network for RGB-D salient object detection