Abstract:Salient object detection (SOD) is an important preprocessing operation for various computer vision tasks. Most of existing RGB-D SOD models employ additive or connected strategies to directly aggregate and decode multi-scale features to predict salient maps. However, due to the large differences between the features of different scales, these aggregation strategies adopted may lead to information loss or redundancy, and few methods explicitly consider how to establish connections between features at different scales in the decoding process, which consequently deteriorates the detection performance of the models. To this end, we propose a cascaded and aggregated Transformer Network (CATNet) which consists of three key modules, i.e., attention feature enhancement module (AFEM), cross-modal fusion module (CMFM) and cascaded correction decoder (CCD). Specifically, the AFEM is designed on the basis of atrous spatial pyramid pooling to obtain multi-scale semantic information and global context information in high-level features through dilated convolution and multi-head self-attention mechanism, enhancing high-level features. The role of the CMFM is to enhance and thereafter fuse the RGB features and depth features, alleviating the problem of poor-quality depth maps. The CCD is composed of two subdecoders in a cascading fashion. It is designed to suppress noise in low-level features and mitigate the differences between features at different scales. Moreover, the CCD uses a feedback mechanism to correct and repair the output of the subdecoder by exploiting supervised features, so that the problem of information loss caused by the upsampling operation during the multi-scale features aggregation process can be mitigated. Extensive experimental results demonstrate that the proposed CATNet achieves superior performance over 14 state-of-the-art RGB-D methods on 7 challenging benchmarks. The codes are released at https://github.com/ROC-Star/CATNet/ .

TOD-Net: An end-to-end transformer-based object detection network

A Transformer-Based Object Detector with Coarse-Fine Crossing Representations

Transformer Union Convolution Network for Visual Object Tracking

Transformer Transforms Salient Object Detection and Camouflaged Object Detection

CNN-transformer mixed model for object detection

CTIF-Net: A CNN-Transformer Iterative Fusion Network for Salient Object Detection

TF-SOD: a Novel Transformer Framework for Salient Object Detection

SA-P2T: Sparse Attention-based Pyramid Pooling Transformer Network for Object Detection

A Simple yet Effective Network based on Vision Transformer for Camouflaged Object and Salient Object Detection

Transformer guidance dual-stream network for salient object detection in optical remote sensing images

Fully Transformer Detector with Multiscale Encoder and Dynamic Decoder

CATNet: A Cascaded and Aggregated Transformer Network for RGB-D Salient Object Detection

Adaptive Dual-Stream Sparse Transformer Network for Salient Object Detection in Optical Remote Sensing Images

SSTNet: Saliency sparse transformers network with tokenized dilation for salient object detection

Unifying convolution and transformer: a dual stage network equipped with cross-interactive multi-modal feature fusion and edge guidance for RGB-D salient object detection

End-to-End Object Detection with Transformers

Transformer with large convolution kernel decoder network for salient object detection in optical remote sensing images

Transformer-based Hierarchical Dynamic Decoders for Salient Object Detection

Tiny Object Detection Model Based on Competitive Multi-Layer Neural Network (TOD-CMLNN)

Transformer-Based Cross-Modal Integration Network for RGB-T Salient Object Detection

Feature Shrinkage Pyramid for Camouflaged Object Detection with Transformers.