Abstract:Most of existing salient object detection models have achieved great progress by aggregating multi-level features extracted from convolutional neural networks. However, because of the different receptive fields of different convolutional layers, there exists big differences between features generated by these layers. Common feature fusion strategies (addition or concatenation) ignore these differences and may cause suboptimal solutions. In this paper, we propose the F3Net to solve above problem, which mainly consists of cross feature module (CFM) and cascaded feedback decoder (CFD) trained by minimizing a new pixel position aware loss (PPA). Specifically, CFM aims to selectively aggregate multi-level features. Different from addition and concatenation, CFM adaptively selects complementary components from input features before fusion, which can effectively avoid introducing too much redundant information that may destroy the original features. Besides, CFD adopts a multi-stage feedback mechanism, where features closed to supervision will be introduced to the output of previous layers to supplement them and eliminate the differences between features. These refined features will go through multiple similar iterations before generating the final saliency maps. Furthermore, different from binary cross entropy, the proposed PPA loss doesn't treat pixels equally, which can synthesize the local structure information of a pixel to guide the network to focus more on local details. Hard pixels from boundaries or error-prone parts will be given more attention to emphasize their importance. F3Net is able to segment salient object regions accurately and provide clear local details. Comprehensive experiments on five benchmark datasets demonstrate that F3Net outperforms state-of-the-art approaches on six evaluation metrics.

Hyperfusion-Net: Hyper-densely Reflective Feature Fusion for Salient Object Detection

Dual-Branch Feature Fusion Network for Salient Object Detection

Salient Object Detection with High-Level Prior Based on Bayesian Fusion.

F3Net: Fusion, Feedback and Focus for Salient Object Detection

MFUR-Net

Salient Object Detection via Bilateral Feature Fusion and Score Sorting Attention Mechanism

Revisiting Feature Fusion for RGB-T Salient Object Detection

Adaptive Fusion for RGB-D Salient Object Detection.

MFC-Net : Multi-feature fusion cross neural network for salient object detection

ℱ3-Net: Feature Fusion and Filtration Network for Object Detection in Optical Remote Sensing Images

A Saliency Enhanced Feature Fusion based multiscale RGB-D Salient Object Detection Network

Salient Object Detection by Lossless Feature Reflection

Spatial attention-guided deformable fusion network for salient object detection

GLFuse: A Global and Local Four-Branch Feature Extraction Network for Infrared and Visible Image Fusion

Multi-branch feature fusion and refinement network for salient object detection

Discriminative feature fusion for RGB-D salient object detection

Attentive feature integration network for detecting salient objects in images

RGB-D salient object detection via cross-modal joint feature extraction and low-bound fusion loss

Feature interaction and two-stage cross-modal fusion for RGB-D salient object detection

AMDFNet: Adaptive multi-level deformable fusion network for RGB-D saliency detection

CFRNet: Cross-Attention-Based Fusion and Refinement Network for Enhanced RGB-T Salient Object Detection