Abstract:Multi-modal salient object detection (MSOD) aims to boost saliency detection performance by integrating visible sources with depth or thermal infrared ones. Existing methods generally design different fusion schemes to handle certain issues or challenges. Although these fusion schemes are effective at addressing specific issues or challenges, they may struggle to handle multiple complex challenges simultaneously. To solve this problem, we propose a novel adaptive fusion bank that makes full use of the complementary benefits from a set of basic fusion schemes to handle different challenges simultaneously for robust MSOD. We focus on handling five major challenges in MSOD, namely center bias, scale variation, image clutter, low illumination, and thermal crossover or depth ambiguity. The fusion bank proposed consists of five representative fusion schemes, which are specifically designed based on the characteristics of each challenge, respectively. The bank is scalable, and more fusion schemes could be incorporated into the bank for more challenges. To adaptively select the appropriate fusion scheme for multi-modal input, we introduce an adaptive ensemble module that forms the adaptive fusion bank, which is embedded into hierarchical layers for sufficient fusion of different source data. Moreover, we design an indirect interactive guidance module to accurately detect salient hollow objects via the skip integration of high-level semantic information and low-level spatial details. Extensive experiments on three RGBT datasets and seven RGBD datasets demonstrate that the proposed method achieves the outstanding performance compared to the state-of-the-art methods. The code and results are available at <a class="link-external link-https" href="https://github.com/Angknpng/LAFB" rel="external noopener nofollow">this https URL</a>.

Weighted boxes fusion: Ensembling boxes from different object detection models

Object Tracking Model Based on Fusing Multiple Weighted Distribution Field Features

MoreFusion: Multi-object Reasoning for 6D Pose Estimation from Volumetric Fusion

Weighted Circle Fusion: Ensembling Circle Representation from Different Object Detection Results

Multi-Modal 3D Object Detection by Box Matching

Multi-model tree detection in satellite images with weighted boxes fusion

A fused score computation approach to reflect the overlap between the predicted box and the ground truth in pedestrian detection

Consensus Focus for Object Detection and minority classes

MixedFusion: 6D Object Pose Estimation from Decoupled RGB-Depth Features.

TDFSSD: Top-Down Feature Fusion Single Shot MultiBox Detector

ObjectBox: From Centers to Boxes for Anchor-Free Object Detection

Candidate box fusion based approach to adjust position of the candidate box for object detection

Weakly Aligned Feature Fusion for Multimodal Object Detection

A Pose Estimation Algorithm for Multimodal Data Fusion

Dynamic Belief Fusion for Object Detection

Fusion-Mamba for Cross-modality Object Detection

Multi-Modal Fusion Based on Depth Adaptive Mechanism for 3D Object Detection

Learning Adaptive Fusion Bank for Multi-modal Salient Object Detection

Multi-Source Features Fusion Single Stage 3D Object Detection with Transformer.