Abstract:Feature pyramid network (FPN) based models, which fuse the semantics and salient details in a progressive manner, have been proven highly effective in salient object detection. However, it is observed that these models often generate saliency maps with incomplete object structures or unclear object boundaries, due to the indirect information propagation among distant layers that makes such fusion structure less effective. In this work, we propose a novel Cross-layer Feature Pyramid Network (CFPN), in which direct cross-layer communication is enabled to improve the progressive fusion in salient object detection. Specifically, the proposed network first aggregates multi-scale features from different layers into feature maps that have access to both the high- and low- level information. Then, it distributes the aggregated features to all the involved layers to gain access to richer context. In this way, the distributed features per layer own both semantics and salient details from all other layers simultaneously, and suffer reduced loss of important information during the progressive feature fusion. At last, CFPN fuses the distributed features of each layer stage-by-stage. This way, the high-level features that contain context useful for locating complete objects are preserved until the final output layer, and the low-level features that contain spatial structure details are embedded into each layer to preserve spatial structural details. Extensive experimental results over six widely used salient object detection benchmarks and with three popular backbones clearly demonstrate that CFPN can accurately locate fairly complete salient regions and effectively segment the object boundaries.

Annular Feature Pyramid Network for Salient Object Detection

SAFPN: a Full Semantic Feature Pyramid Network for Object Detection

Multi-scale Pyramid Pooling Network for Salient Object Detection.

EBiDA-FPN: Enhanced Bi-Directional Attention Feature Pyramid Network for Object Detection

MLA-Net: Feature Pyramid Network with Multi-Level Local Attention for Object Detection

A Pooling-Based Feature Pyramid Network for Salient Object Detection

Dual Pyramid Network for Salient Object Detection

Cross-Layer Feature Pyramid Network for Salient Object Detection

Deep Salient Object Detection by Integrating Multi-level Cues

Dense Residual Pyramid Networks for Salient Object Detection

Complementary Feature Pyramid Network for Object Detection

SA-DPNet: Structure-aware dual pyramid network for salient object detection

Deep Layer Guided Network for Salient Object Detection

Multi-scale Object Detection by Top-Down and Bottom-Up Feature Pyramid Network

LHRNet: Lateral Hierarchically Refining Network for Salient Object Detection

A Multistage Refinement Network for Salient Object Detection

Integrated Deep and Shallow Networks for Salient Object Detection

Enhanced semantic feature pyramid network for small object detection

MM-FPN: Multi-path and Multi-scale Feature Pyramid Network for Object Detection

Salient object detection by aggregating contextual information

Enhanced Feature Pyramidal Network for Object Detection