Abstract:With the prevalence of thermal cameras, RGB-T multi-modal data have become more available for salient object detection (SOD) in complex scenes. Most RGB-T SOD works first individually extract RGB and thermal features from two separate encoders and directly integrate them, which pay less attention to the issue of defective modalities. However, such an indiscriminate feature extraction strategy may produce contaminated features and thus lead to poor SOD performance. To address this issue, we propose a novel CCFENet for a perspective to perform robust and accurate multi-modal expression encoding. First, we propose an essential cross-collaboration enhancement strategy (CCE), which concentrates on facilitating the interactions across the encoders and encouraging different modalities to complement each other during encoding. Such a cross-collaborative-encoder paradigm induces our network to collaboratively suppress the negative feature responses of defective modality data and effectively exploit modality-informative features. Moreover, as the network goes deeper, we embed several CCEs into the encoder, further enabling more representative and robust feature generation. Second, benefiting from the proposed robust encoding paradigm, a simple yet effective cross-scale cross-modal decoder (CCD) is designed to aggregate multi-level complementary multi-modal features, and thus encourages efficient and accurate RGB-T SOD. Extensive experiments reveal that our CCFENet outperforms the state-of-the-art models on three RGB-T datasets with a fast inference speed of 62 FPS. In addition, the advantages of our approach in complex scenarios (e.g., bad weather, motion blur, etc.) and RGB-D SOD further verify its robustness and generality. The source code will be publicly available via our project page: https://git.openi.org.cn/OpenVision/CCFENet .

Cross-Collaborative Fusion-Encoder Network for Robust RGB-Thermal Salient Object Detection.

Cross-Modal Fusion and Progressive Decoding Network for RGB-D Salient Object Detection

CAE-Net: Cross-Modal Attention Enhancement Network for RGB-T Salient Object Detection

CGFNet: Cross-Guided Fusion Network for RGB-T Salient Object Detection

CCAFNet: Crossflow and Cross-Scale Adaptive Fusion Network for Detecting Salient Objects in RGB-D Images.

CAFCNet: Cross-modality asymmetric feature complement network for RGB-T salient object detection

CFRNet: Cross-Attention-Based Fusion and Refinement Network for Enhanced RGB-T Salient Object Detection

Transformer-Based Cross-Modal Integration Network for RGB-T Salient Object Detection

Unified Information Fusion Network for Multi-Modal RGB-D and RGB-T Salient Object Detection

CFIDNet: cascaded feature interaction decoder for RGB-D salient object detection

Cross-Modality Double Bidirectional Interaction and Fusion Network for RGB-T Salient Object Detection

Interactive Context-Aware Network for RGB-T Salient Object Detection

Multi-enhanced Adaptive Attention Network for RGB- T Salient Object Detection

An adaptive guidance fusion network for RGB-D salient object detection

Modal Complementary Fusion Network for RGB-T Salient Object Detection

Efficient Context-Guided Stacked Refinement Network for RGB-T Salient Object Detection

CIR-Net: Cross-Modality Interaction and Refinement for RGB-D Salient Object Detection

C $^{2}$ DFNet: Criss-Cross Dynamic Filter Network for RGB-D Salient Object Detection

HFENet: Hybrid feature encoder network for detecting salient objects in RGB-thermal images

Lightweight Cross-Modal Information Mutual Reinforcement Network for RGB-T Salient Object Detection

Double Cross-Modality Progressively Guided Network for RGB-D Salient Object Detection