Abstract:RGB-Thermal Salient Object Detection aims to pinpoint prominent objects within aligned pairs of visible and thermal infrared images. Traditional encoder-decoder architectures, while designed for cross-modality feature interactions, may not have adequately considered the robustness against noise originating from defective modalities. Inspired by hierarchical human visual systems, we propose the ConTriNet, a robust Confluent Triple-Flow Network employing a Divide-and-Conquer strategy. Specifically, ConTriNet comprises three flows: two modality-specific flows explore cues from RGB and Thermal modalities, and a third modality-complementary flow integrates cues from both modalities. ConTriNet presents several notable advantages. It incorporates a Modality-induced Feature Modulator in the modality-shared union encoder to minimize inter-modality discrepancies and mitigate the impact of defective samples. Additionally, a foundational Residual Atrous Spatial Pyramid Module in the separated flows enlarges the receptive field, allowing for the capture of multi-scale contextual information. Furthermore, a Modality-aware Dynamic Aggregation Module in the modality-complementary flow dynamically aggregates saliency-related cues from both modality-specific flows. Leveraging the proposed parallel triple-flow framework, we further refine saliency maps derived from different flows through a flow-cooperative fusion strategy, yielding a high-quality, full-resolution saliency map for the final prediction. To evaluate the robustness and stability of our approach, we collect a comprehensive RGB-T SOD benchmark, VT-IMAG, covering various real-world challenging scenarios. Extensive experiments on public benchmarks and our VT-IMAG dataset demonstrate that ConTriNet consistently outperforms state-of-the-art competitors in both common and challenging scenarios.

RGB-T Image Saliency Detection via Collaborative Graph Learning

A Unified RGB-T Saliency Detection Benchmark: Dataset, Baselines, Analysis and A Novel Approach

Salient Object Detection via Multi-spectral Co-connectivity and Collaborative Graph Ranking

RGB-T salient object detection via CNN feature and result saliency map fusion

A joint similarity matrix learning of multi-view data for RGB-T saliency detection

Specificity-preserving RGB-D Saliency Detection

RGB-T Salient Object Detection Via Fusing Multi-level CNN Features.

Graph-based Saliency Detection Using a Learning Joint Affinity Matrix

Revisiting Feature Fusion for RGB-T Salient Object Detection

Synergistic Saliency and Depth Prediction for RGB-D Saliency Detection

Triple-Complementary Network for RGB-D Salient Object Detection

Transformer-based Network for RGB-D Saliency Detection

RGB-D Visual Saliency Detection Algorithm Based on Information Guided and Multimodal Feature Fusion

Transformer-Based Cross-Modal Integration Network for RGB-T Salient Object Detection

RGB-D Saliency Detection Via Cascaded Mutual Information Minimization

CNNs-Based RGB-D Saliency Detection Via Cross-View Transfer and Multiview Fusion.

Alignment-Free RGBT Salient Object Detection: Semantics-guided Asymmetric Correlation Network and A Unified Benchmark

Alignment-Free RGB-T Salient Object Detection: A Large-scale Dataset and Progressive Correlation Network

CGFNet: Cross-Guided Fusion Network for RGB-T Salient Object Detection

EF-Net: A Novel Enhancement and Fusion Network for RGB-D Saliency Detection

Divide-and-Conquer: Confluent Triple-Flow Network for RGB-T Salient Object Detection