Abstract:Feature pyramids are widely used to improve scale invariance for object detection. Most methods just map the objects to feature maps with relevant square receptive fields, but rarely pay attention to the aspect ratio variation, which is also an important property of object instances. It will lead to a poor match between rectangular objects and assigned features with square receptive fields, thus preventing from accurate recognition and location. Besides, the information propagation among feature layers is sparse, namely, each feature in the pyramid may mainly or only contain single-level information, which is not representative enough for classification and localization sub-tasks. In this paper, Bidirectional Matrix Feature Pyramid Network (BMFPN) is proposed to address these issues. It consists of three modules: Diagonal Layer Generation Module (DLGM), Top-down Module (TDM) and Bottom-up Module (BUM). First, multi-level features extracted by backbone are fed into DLGM to produce the base features. Then these base features are utilized to construct the final feature pyramid through TDM and BUM in series. The receptive fields of the designed feature layers in BMFPN have various scales and aspect ratios. Objects can be correctly assigned to appropriate and representative feature maps with relevant receptive fields depending on its scale and aspect ratio properties. Moreover, TDM and BUM form bidirectional and reticular information flow, which effectively fuses multi-level information in top-down and bottom-up manner respectively. To evaluate the effectiveness of our proposed architecture, an end-to-end anchor-free detector is designed and trained by integrating BMFPN into FCOS. And the center-ness branch in FCOS is modified with our Gaussian center-ness branch (GCB), which brings another slight improvement. Without bells and whistles, our method gains +3.3%, +2.4% and +2.6% AP on MS COCO dataset from baselines with ResNet-50, ResNet-101 and ResNeXt-101 backbones, respectively.

Bidirectional Matrix Feature Pyramid Network for Object Detection

EBiDA-FPN: Enhanced Bi-Directional Attention Feature Pyramid Network for Object Detection

Bidirectional Parallel Feature Pyramid Network for Object Detection

Single-Shot Bidirectional Pyramid Networks for High-Quality Object Detection.

MM-FPN: Multi-path and Multi-scale Feature Pyramid Network for Object Detection

Dynamic Feature Pyramid Networks for Detection

Complementary Feature Pyramid Network for Object Detection

MLA-Net: Feature Pyramid Network with Multi-Level Local Attention for Object Detection

Dual Attention Based Image Pyramid Network for Object Detection.

A New Feature Pyramid Network for Object Detection

MGFPN: Enhancing Multi-Scale Feature for Object Detection

Multi-scale Object Detection by Top-Down and Bottom-Up Feature Pyramid Network

MFPN: A Novel Mixture Feature Pyramid Network of Multiple Architectures for Object Detection

Parallel Residual Bi-Fusion Feature Pyramid Network for Accurate Single-Shot Object Detection

Feature Combination Based On Receptive Fields And Cross-Fusion Feature Pyramid For Object Detection

Multi-Scale Residual Aggregation Feature Pyramid Network for Object Detection

Multi-scale Global Context Feature Pyramid Network for Object Detector

TFPN: Twin Feature Pyramid Networks for Object Detection.

Multi-level Feature Fusion Pyramid Network for Object Detection

Dual Refinement Feature Pyramid Networks for Object Detection

Attention-Based Feature Pyramid Network for Object Detection.