Abstract:Multi-modal salient object detection (MSOD) aims to boost saliency detection performance by integrating visible sources with depth or thermal infrared ones. Existing methods generally design different fusion schemes to handle certain issues or challenges. Although these fusion schemes are effective at addressing specific issues or challenges, they may struggle to handle multiple complex challenges simultaneously. To solve this problem, we propose a novel adaptive fusion bank that makes full use of the complementary benefits from a set of basic fusion schemes to handle different challenges simultaneously for robust MSOD. We focus on handling five major challenges in MSOD, namely center bias, scale variation, image clutter, low illumination, and thermal crossover or depth ambiguity. The fusion bank proposed consists of five representative fusion schemes, which are specifically designed based on the characteristics of each challenge, respectively. The bank is scalable, and more fusion schemes could be incorporated into the bank for more challenges. To adaptively select the appropriate fusion scheme for multi-modal input, we introduce an adaptive ensemble module that forms the adaptive fusion bank, which is embedded into hierarchical layers for sufficient fusion of different source data. Moreover, we design an indirect interactive guidance module to accurately detect salient hollow objects via the skip integration of high-level semantic information and low-level spatial details. Extensive experiments on three RGBT datasets and seven RGBD datasets demonstrate that the proposed method achieves the outstanding performance compared to the state-of-the-art methods. The code and results are available at <a class="link-external link-https" href="https://github.com/Angknpng/LAFB" rel="external noopener nofollow">this https URL</a>.

Auto-MSFNet: Search Multi-scale Fusion Network for Salient Object Detection

Dual-Branch Feature Fusion Network for Salient Object Detection

MFC-Net : Multi-feature fusion cross neural network for salient object detection

Multi-attention Guided Feature Fusion Network for Salient Object Detection

MAFNet: Multi-style attention fusion network for salient object detection

Selective Feature Fusion Network for Salient Object Detection

SLMSF-Net: A Semantic Localization and Multi-Scale Fusion Network for RGB-D Salient Object Detection

Rich‐scale Feature Fusion Network for Salient Object Detection

Exploring Multi-scale Deep Feature Fusion for Object Detection.

Multi-Scale Feature Fusion Network for Object Detection in VHR Optical Remote Sensing Images

Multi-branch feature fusion and refinement network for salient object detection

MMNet: Multi-Stage and Multi-Scale Fusion Network for RGB-D Salient Object Detection

A Saliency Enhanced Feature Fusion based multiscale RGB-D Salient Object Detection Network

Multi-scale Fusion with Context-aware Network for Object Detection

Multi-level and multi-scale deep saliency network for salient object detection

A Multi-Feature Fusion and Attention Network for Multi-Scale Object Detection in Remote Sensing Images

Learning Adaptive Fusion Bank for Multi-modal Salient Object Detection

CSFFNet: Lightweight cross-scale feature fusion network for salient object detection in remote sensing images

Frustum FusionNet: Amodal 3D Object Detection with Multi-Modal Feature Fusion

NLFFTNet: A non-local feature fusion transformer network for multi-scale object detection

MFFNet: Multi-modal Feature Fusion Network for V-D-T Salient Object Detection