Abstract:RGB-D salient object detection (SOD) has gained more and more research interest in recent years. Due to various imaging mechanisms of RGB and depth modalities, RGB-D images contain different information. Thus, how to effectively fuse multi-modality features and aggregate multi-scale features to generate accurate saliency prediction are still the problems. In this article, we present a Multi-Modality Information Refinement Fusion Network (MIRFNet) for RGB-D SOD to solve the problems. Specifically, a Feature-Enhancement and Cross-Refinement Module (FCM) is proposed to reduce redundant features and the gap between cross-modality data to achieve multi-modality feature fusion effectively. In FCM, the Feature-Enhancement step utilizes attention mechanisms to obtain enhanced features which contain less redundant information and more common salient information, and the Cross-Refinement step employs the enhanced features to reduce the gap between cross-modality features and achieve effective feature fusion. Then, we propose an Edge Guidance Module (EGM) to extract edge information from RGB features. Finally, to effectively aggregate multi-level features and achieve accurate saliency prediction, a Feature-Aggregation and Edge-Refinement Module (FEM) is designed, which introduces specific-modality information and edge information to conduct sufficient information interaction. In FEM, the Feature-Aggregation step aggregates multi-scale features with specific-modality information, and the Edge-Refinement step uses edge information to refine the aggregation features. Extensive experiments demonstrate that MIRFNet can achieve comparable performance against the other 12 SOTA methods on five datasets.

ARFNet: Attention-Oriented Refinement and Fusion Network for Light Field Salient Object Detection

LRNet: lightweight attention-oriented residual fusion network for light field salient object detection

Salient Object Detection with High-Level Prior Based on Bayesian Fusion.

A Learning-Based Method Using Data Augmentation for Light Field Salient Object Detection

Dual-Branch Feature Fusion Network for Salient Object Detection

Guided Focal Stack Refinement Network for Light Field Salient Object Detection

Learning Synergistic Attention for Light Field Salient Object Detection

Light field saliency object detection based on self-selected multimodal fusion

Rethinking Feature Mining for Light Field Salient Object Detection

MAFNet: Multi-style attention fusion network for salient object detection

Spatial Attention-Guided Light Field Salient Object Detection Network with Implicit Neural Representation

AMDFNet: Adaptive multi-level deformable fusion network for RGB-D saliency detection

Multi-branch feature fusion and refinement network for salient object detection

MFUR-Net

CFRNet: Cross-Attention-Based Fusion and Refinement Network for Enhanced RGB-T Salient Object Detection

Multi-modality information refinement fusion network for RGB-D salient object detection

Light field super-resolution using complementary-view feature attention

Exploring Focus and Depth-Induced Saliency Detection for Light Field

Light Field Saliency Detection with Dual Local Graph Learning and Reciprocative Guidance

Attentive feature integration network for detecting salient objects in images

Gated multi-modal edge refinement network for light field salient object detection