Abstract:Learning pyramidal feature representations is crucial for recognizing object instances at different scales. Feature Pyramid Network (FPN) is the classic architecture to build a feature pyramid with high-level semantics throughout. However, intrinsic defects in feature extraction and fusion inhibit FPN from further aggregating more discriminative features. In this work, we propose Attention Aggregation based Feature Pyramid Network (A 2 -FPN), to improve multi-scale feature learning through attention-guided feature aggregation. In feature extraction, it extracts discriminative features by collecting-distributing multi-level global context features, and mitigates the semantic information loss due to drastically reduced channels. In feature fusion, it aggregates complementary information from adjacent features to generate location-wise reassembly kernels for content-aware sampling, and employs channel-wise reweighting to enhance the semantic consistency before element-wise addition. A 2 -FPN shows consistent gains on different instance segmentation frameworks. By replacing FPN with A 2 -FPN in Mask R-CNN, our model boosts the performance by 2.1% and 1.6% mask AP when using ResNet-50 and ResNet-101 as backbone, respectively. Moreover, A 2 -FPN achieves an improvement of 2.0% and 1.4% mask AP when integrated into the strong baselines such as Cascade Mask R-CNN and Hybrid Task Cascade.

A<sup>2</sup>-FPN: Attention Aggregation based Feature Pyramid Network for Instance Segmentation

A^2-FPN: Attention Aggregation based Feature Pyramid Network for Instance Segmentation

SAFPN: a Full Semantic Feature Pyramid Network for Object Detection

MAMask: Multi‐feature Aggregation Instance Segmentation with Pyramid Attention Mechanism

Dynamic Feature Pyramid Networks for Detection

Sfpn: Semantic Feature Pyramid Network For Object Detection

Panoptic Feature Pyramid Networks

A 2 -FPN for semantic segmentation of fine-resolution remotely sensed images

An Embedded Feature Pyramid Network Enables Bidirectional Information Flow for Object Detection and Instance Segmentation

Attention-based Fusion Factor in FPN for Object Detection

FPANet: Feature Pyramid Aggregation Network for Real-Time Semantic Segmentation

Mask R-Cnn With Feature Pyramid Attention For Instance Segmentation

A2-FPN for Semantic Segmentation of Fine-Resolution Remotely Sensed Images

FAPN: Feature Augmented Pyramid Network for Polyp Segmentation

FaPN: Feature-aligned Pyramid Network for Dense Image Prediction

Attention-Based Feature Pyramid Network for Object Detection.

FCPFNet: Feature Complementation Network with Pyramid Fusion for Semantic Segmentation

AugFPN: Improving Multi-Scale Feature Learning for Object Detection.

SemSegFPA: Semantic Segmentation Feature Pyramid Network with Attention Module

A-FPN: Attention Aggregation based Feature Pyramid Network for Instance Segmentation — Supplementary Material

BPN: Bidirectional Path Network for Instance Segmentation