Abstract:Deep convolutional neural networks have pushed the resulting performances of salient object detection to the new state-of-the-art. However, most of the existing methods mainly focus on the calibration of the encoder and decoder but ignore the complementarity between them, which may lose some vital saliency areas or produce noises. Moreover, the research on the saliency structure-level loss function remains scarce. To address the above issues, we propose a network that BRIdgEs the Feature complementarity gap (BriefNet), which consists of a common encoder-decoder structure, a collaborative complementarity module (CCM), an encoder clustering module (ECM), and a feature aggregation module (FAM) optimized by a novel hybrid loss. Specifically, CCM and ECM are embedded after the encoder-decoder structure to recalibrate the features of the encoder and decoder, and FCM aggregates them. Firstly, CCM includes a feature supplement operation (FSO) and a feature generality extraction (FGE). FSO makes up the lost features of the decoder. FGE aims at exploring the generality features between encoder and decoder, aiming to constrain the saliency. Secondly, by clustering the local and global features of encoders, ECM enhances the connectivity and aggregates the relevancy semantics information. Thirdly, CCM and ECM are aggregated by FAM to predict the final results. Finally, we propose a structure recalibration loss (SRL) to further recalibrate the fuzzy structure features. The hybrid loss that consists of the pixel-level binary cross entropy loss (BCE), the structure-level loss SRL, and the map-level Dice loss is used to optimize the network. Experimental results on five prevailing datasets show that the proposed BriefNet achieves consistently superior performances under various evaluation metrics. In addition, we put forward a simplified BriefNet, which also achieves competitive results by only increasing a few parameters (10 M) compared with the baseline.

Salient Object Detection Based on Backbone Enhanced Network

Background-aware Siamese Network Tracking Based on Salient Feature Fusion

PUB-SalNet: A Pre-Trained Unsupervised Self-Aware Backpropagation Network for Biomedical Salient Segmentation

Dual-Branch Feature Fusion Network for Salient Object Detection

AWANet: Attentive-Aware Wide-Kernels Asymmetrical Network with Blended Contour Information for Salient Object Detection

Accurate salient object detection via dense recurrent connections and residual-based hierarchical feature integration.

Bridging Feature Complementarity Gap Between Encoder and Decoder for Salient Object Detection

Bi-Connect Net for Salient Object Detection

Receptive Field Broadening and Boosting for Salient Object Detection

Salient Object Detection Based on Visual Perceptual Saturation and Two-Stream Hybrid Networks.

Depth Scale Balance Saliency Detection with Connective Feature Pyramid and Edge Guidance.

BASNet: Boundary-Aware Salient Object Detection

A Multistage Refinement Network for Salient Object Detection

Bi-Directional Features Reuse Network For Salient Object Detection

Residual attentive feature learning network for salient object detection

DeepSaliency: Multi-Task Deep Neural Network Model for Salient Object Detection

CBNet: A Composite Backbone Network Architecture for Object Detection

BBS-Net: RGB-D Salient Object Detection with a Bifurcated Backbone Strategy Network

Contrast-Oriented Deep Neural Networks for Salient Object Detection

Saliency Detection by Forward and Backward Cues in Deep-Cnn

PDNet: Prior-model Guided Depth-enhanced Network for Salient Object Detection