Abstract:Deep convolutional neural networks have pushed the resulting performances of salient object detection to the new state-of-the-art. However, most of the existing methods mainly focus on the calibration of the encoder and decoder but ignore the complementarity between them, which may lose some vital saliency areas or produce noises. Moreover, the research on the saliency structure-level loss function remains scarce. To address the above issues, we propose a network that BRIdgEs the Feature complementarity gap (BriefNet), which consists of a common encoder-decoder structure, a collaborative complementarity module (CCM), an encoder clustering module (ECM), and a feature aggregation module (FAM) optimized by a novel hybrid loss. Specifically, CCM and ECM are embedded after the encoder-decoder structure to recalibrate the features of the encoder and decoder, and FCM aggregates them. Firstly, CCM includes a feature supplement operation (FSO) and a feature generality extraction (FGE). FSO makes up the lost features of the decoder. FGE aims at exploring the generality features between encoder and decoder, aiming to constrain the saliency. Secondly, by clustering the local and global features of encoders, ECM enhances the connectivity and aggregates the relevancy semantics information. Thirdly, CCM and ECM are aggregated by FAM to predict the final results. Finally, we propose a structure recalibration loss (SRL) to further recalibrate the fuzzy structure features. The hybrid loss that consists of the pixel-level binary cross entropy loss (BCE), the structure-level loss SRL, and the map-level Dice loss is used to optimize the network. Experimental results on five prevailing datasets show that the proposed BriefNet achieves consistently superior performances under various evaluation metrics. In addition, we put forward a simplified BriefNet, which also achieves competitive results by only increasing a few parameters (10 M) compared with the baseline.

Feature Recalibration Network for Salient Object Detection

Feature Calibrating and Fusing Network for RGB-D Salient Object Detection

Salient Object Detection with Edge Recalibration.

R2Net: Residual refinement network for salient object detection

Accurate salient object detection via dense recurrent connections and residual-based hierarchical feature integration.

Edge-Aware Multiscale Feature Integration Network for Salient Object Detection in Optical Remote Sensing Images

Residual Refinement Network with Attribute Guidance for Precise Saliency Detection

Residual attentive feature learning network for salient object detection

Bridging Feature Complementarity Gap Between Encoder and Decoder for Salient Object Detection

F3Net: Fusion, Feedback and Focus for Salient Object Detection

AWANet: Attentive-Aware Wide-Kernels Asymmetrical Network with Blended Contour Information for Salient Object Detection

Multi-modality information refinement fusion network for RGB-D salient object detection

RMFDNet: Redundant and Missing Feature Decoupling Network for salient object detection

A cascaded refined rgb-d salient object detection network based on the attention mechanism

CFIDNet: cascaded feature interaction decoder for RGB-D salient object detection

A Saliency Enhanced Feature Fusion based multiscale RGB-D Salient Object Detection Network

Revisiting Feature Fusion for RGB-T Salient Object Detection

CIR-Net: Cross-Modality Interaction and Refinement for RGB-D Salient Object Detection

Attentive feature integration network for detecting salient objects in images

CRNet: Channel-Enhanced Remodeling-Based Network for Salient Object Detection in Optical Remote Sensing Images

Residual Learning for Salient Object Detection