Abstract:Salient object detection (SOD) is an important preprocessing operation for various computer vision tasks. Most of existing RGB-D SOD models employ additive or connected strategies to directly aggregate and decode multi-scale features to predict salient maps. However, due to the large differences between the features of different scales, these aggregation strategies adopted may lead to information loss or redundancy, and few methods explicitly consider how to establish connections between features at different scales in the decoding process, which consequently deteriorates the detection performance of the models. To this end, we propose a cascaded and aggregated Transformer Network (CATNet) which consists of three key modules, i.e., attention feature enhancement module (AFEM), cross-modal fusion module (CMFM) and cascaded correction decoder (CCD). Specifically, the AFEM is designed on the basis of atrous spatial pyramid pooling to obtain multi-scale semantic information and global context information in high-level features through dilated convolution and multi-head self-attention mechanism, enhancing high-level features. The role of the CMFM is to enhance and thereafter fuse the RGB features and depth features, alleviating the problem of poor-quality depth maps. The CCD is composed of two subdecoders in a cascading fashion. It is designed to suppress noise in low-level features and mitigate the differences between features at different scales. Moreover, the CCD uses a feedback mechanism to correct and repair the output of the subdecoder by exploiting supervised features, so that the problem of information loss caused by the upsampling operation during the multi-scale features aggregation process can be mitigated. Extensive experimental results demonstrate that the proposed CATNet achieves superior performance over 14 state-of-the-art RGB-D methods on 7 challenging benchmarks. The codes are released at https://github.com/ROC-Star/CATNet/ .

Boosting RGB-D Salient Object Detection with Adaptively Cooperative Dynamic Fusion Network

An adaptive guidance fusion network for RGB-D salient object detection

Adaptive Fusion for RGB-D Salient Object Detection.

Dual Attention Guided Multi-Scale Fusion Network for RGB-D Salient Object Detection

Attention-guided cross-modal multiple feature aggregation network for RGB-D salient object detection

Depth Cue Enhancement and Guidance Network for RGB-D Salient Object Detection

Progressive multi-scale fusion network for RGB-D salient object detection

Compensated Attention Feature Fusion and Hierarchical Multiplication Decoder Network for RGB-D Salient Object Detection

JL-DCF: Joint Learning and Densely-Cooperative Fusion Framework for RGB-D Salient Object Detection

Feature interaction and two-stage cross-modal fusion for RGB-D salient object detection

MFCINet: multi-level feature and context information fusion network for RGB-D salient object detection

Discriminative feature fusion for RGB-D salient object detection

A Cross-Modal Adaptive Gated Fusion Generative Adversarial Network for RGB-D Salient Object Detection

Lightweight Multi-Level Feature Difference Fusion Network for RGB-D-T Salient Object Detection

MTFNet: Mutual-Transformer Fusion Network for RGB-D Salient Object Detection

CCAFNet: Crossflow and Cross-Scale Adaptive Fusion Network for Detecting Salient Objects in RGB-D Images.

AMDFNet: Adaptive multi-level deformable fusion network for RGB-D saliency detection

RGB-D Salient Object Detection Method Based on Multi-Modal Fusion and Contour Guidance

Cross-Modal Fusion and Progressive Decoding Network for RGB-D Salient Object Detection

CATNet: A Cascaded and Aggregated Transformer Network for RGB-D Salient Object Detection

Dual Mutual Learning Network with Global-local Awareness for RGB-D Salient Object Detection