Abstract:In recent years, Transformers have been gradually applied in salient object detection tasks with good results. However, the Transformer’s global modeling capabilities can lead to the loss of local details that are important in salient object detection tasks. A feature extraction backbone based on a convolutional neural network (CNN) is good at extracting local detail features due to the gradual expansion of the receptive field but is limited by the size of the receptive field, resulting in an insufficient ability to extract global semantic features. Therefore, this paper combines the Transformer with a CNN and presents a dual-branch encoder to ensure that the features extracted contain rich global semantic information as well as local detail features. In addition, due to the different features extracted by the Transformer and CNN, noise may be introduced in the fusion of the two features, so different features need to be processed correspondingly during fusion. The fusion enhancement module (FEM) we propose fuses the features of the two branches step by step. A hybrid attention mechanism is used to carry out weighted fusion of different features. This progressive approach minimizes the differences between the features of the two branches so that the merged features retain the semantic and detail features extracted by the two branches to the greatest extent. Considering the loss of detailed information caused by repeated downsampling, we propose an edge refinement module (ERM) to address the need for accurate outline prediction. This module leverages salient features to obtain edge features and gradually refines the prediction results by incorporating these edge features. It makes full use of the connection between salient features and edge features and does not introduce additional edges to extract branches. Extensive experimental evaluations conducted on five benchmark tests demonstrate the superior performance of our method compared to other existing approaches. Code can be found at https://github.com/gfq1605694825/DSRNet-main.

Bidirectional Mutual Guidance Transformer for Salient Object Detection in Optical Remote Sensing Images

Receptive Field Broadening and Boosting for Salient Object Detection

Salient Object Detection in Optical Remote Sensing Images Driven by Transformer

Transformers and CNNs Fusion Network for Salient Object Detection

Boosting Camouflaged Object Detection with Dual-Task Interactive Transformer

Transformer with large convolution kernel decoder network for salient object detection in optical remote sensing images

Boosting Salient Object Detection with Transformer-based Asymmetric Bilateral U-Net

Dual-Stream Feature Collaboration Perception Network for Salient Object Detection in Remote Sensing Images

Multimodal Transformer Using Cross-Channel attention for Object Detection in Remote Sensing Images

Unifying Global-Local Representations in Salient Object Detection with Transformer

GroupTransNet: Group transformer network for RGB-D salient object detection

HFSI-TF: Hierarchical Full-Scale Interactive Transformer Model for Object Detection in Remote Sensing Image

Global and Multiscale Aggregate Network for Saliency Object Detection in Optical Remote Sensing Images

Dynamic multi-headed self-attention and multiscale enhancement vision transformer for object detection

Boundary-semantic collaborative guidance network with dual-stream feedback mechanism for salient object detection in optical remote sensing imagery

Multitask learning for image translation and salient object detection from multimodal remote sensing images

Unifying convolution and transformer: a dual stage network equipped with cross-interactive multi-modal feature fusion and edge guidance for RGB-D salient object detection

Recurrent Adaptive Graph Reasoning Network With Region and Boundary Interaction for Salient Object Detection in Optical Remote Sensing Images

Salient Object Detection in Optical Remote Sensing Images Based on Global Context Mixed Attention

Salient object detection with dual-branch stepwise feature fusion and edge refinement

Discriminative Co-Saliency and Background Mining Transformer for Co-Salient Object Detection