Abstract:Most current salient object detection (SOD) methods employ an encoder-decoder architecture based on fully convolutional neural networks. However, the subjective nature of the saliency object detection task and the local nature of convolutional processing may result in missing global contextual information. In addition, feature fusion without information filtering may introduce more noise and thus weaken the localization ability of prominent objects. Therefore, we propose a transformer-based semantic feature-guided and correlation-aggregated salient object detection (SFC-SOD) method. Specifically, the method takes a pyramid vision transformer (PVT) as the encoder backbone to extract features and designs a top-level feature guidance (TFG) module in the decoder to explore the correlation between the highest-level features and the low-level features. The low-level features are guided in the channel dimension to enhance the expression of the low-level features. Based on the features obtained from TFG, the adaptive feature fusion (AFF) module is designed to efficiently utilize the essential features of different layers for fusion to obtain salient critical information while reducing redundant features. After feature fusion, the top-down correlation-aggregation (TCA) module is introduced to further enhance and refine the salient features by using the high-level output results to guide the lower-level features to establish global dependencies, thus achieving better saliency results. The results of extensive experiments conducted on six widely used datasets show the superior performance of the proposed SFC-SOD by comparing it with several state-of-the-art methods.

Cross-stage Feature Fusion and Efficient Self-Attention for Salient Object Detection

CSFFNet: Lightweight cross-scale feature fusion network for salient object detection in remote sensing images

Selective Feature Fusion Network for Salient Object Detection

CCAFNet: Crossflow and Cross-Scale Adaptive Fusion Network for Detecting Salient Objects in RGB-D Images.

Semantic feature-guided and correlation-aggregated salient object detection

Complementary characteristics fusion network for weakly supervised salient object detection

Cross-Modal Fusion and Progressive Decoding Network for RGB-D Salient Object Detection

MFCINet: multi-level feature and context information fusion network for RGB-D salient object detection

Rich‐scale Feature Fusion Network for Salient Object Detection

Multi-attention Guided Feature Fusion Network for Salient Object Detection

Feature interaction and two-stage cross-modal fusion for RGB-D salient object detection

Spatial Frequency Enhanced Salient Object Detection

Hybrid Attention Mechanism and Forward Feedback Unit for RGB-D Salient Object Detection

Effective full-scale detection for salient object based on condensing-and-filtering network

Cascaded feature fusion with multi-level self-attention mechanism for object detection

An adaptive guidance fusion network for RGB-D salient object detection

A Multi-Source Feature Extraction Network for Salient Object Detection

Hierarchical Feature Fusion Network for Salient Object Detection

Auto-MSFNet: Search Multi-scale Fusion Network for Salient Object Detection

MFFNet: Multi-modal Feature Fusion Network for V-D-T Salient Object Detection

Compensated Attention Feature Fusion and Hierarchical Multiplication Decoder Network for RGB-D Salient Object Detection