Abstract:Feature pyramid network (FPN) based models, which fuse the semantics and salient details in a progressive manner, have been proven highly effective in salient object detection. However, it is observed that these models often generate saliency maps with incomplete object structures or unclear object boundaries, due to the indirect information propagation among distant layers that makes such fusion structure less effective. In this work, we propose a novel Cross-layer Feature Pyramid Network (CFPN), in which direct cross-layer communication is enabled to improve the progressive fusion in salient object detection. Specifically, the proposed network first aggregates multi-scale features from different layers into feature maps that have access to both the high- and low- level information. Then, it distributes the aggregated features to all the involved layers to gain access to richer context. In this way, the distributed features per layer own both semantics and salient details from all other layers simultaneously, and suffer reduced loss of important information during the progressive feature fusion. At last, CFPN fuses the distributed features of each layer stage-by-stage. This way, the high-level features that contain context useful for locating complete objects are preserved until the final output layer, and the low-level features that contain spatial structure details are embedded into each layer to preserve spatial structural details. Extensive experimental results over six widely used salient object detection benchmarks and with three popular backbones clearly demonstrate that CFPN can accurately locate fairly complete salient regions and effectively segment the object boundaries.

Dense Residual Pyramid Networks for Salient Object Detection

SAFPN: a Full Semantic Feature Pyramid Network for Object Detection

Residual Dense Collaborative Network for Salient Object Detection

Residual Learning for Salient Object Detection

Accurate salient object detection via dense recurrent connections and residual-based hierarchical feature integration.

Multi-scale Pyramid Pooling Network for Salient Object Detection.

Annular Feature Pyramid Network for Salient Object Detection

Progressive Dual-Attention Residual Network for Salient Object Detection

Cross-Layer Feature Pyramid Network for Salient Object Detection

Residual attentive feature learning network for salient object detection

A Multistage Refinement Network for Salient Object Detection

A Pooling-Based Feature Pyramid Network for Salient Object Detection

Reverse Attention Based Residual Network for Salient Object Detection.

Aggregated Residual Dilation-Based Feature Pyramid Network for Object Detection

Dual Refinement Feature Pyramid Networks for Object Detection

R2Net: Residual refinement network for salient object detection

Regularized Densely-Connected Pyramid Network for Salient Instance Segmentation

Dual Pyramid Network for Salient Object Detection

Deep Embedding Features for Salient Object Detection

A Stagewise Refinement Model for Detecting Salient Objects in Images.

SA-DPNet: Structure-aware dual pyramid network for salient object detection