Abstract:Feature pyramids are widely exploited by both the state-of-the-art one-stage object detectors (e.g., DSSD, RetinaNet, RefineDet) and the two-stage object detectors (e.g., Mask R-CNN, DetNet) to alleviate the problem arising from scale variation across object instances. Although these object detectors with feature pyramids achieve encouraging results, they have some limitations due to that they only simply construct the feature pyramid according to the inherent multi-scale, pyramidal architecture of the backbones which are originally designed for object classification task. Newly, in this work, we present Multi-Level Feature Pyramid Network (MLFPN) to construct more effective feature pyramids for detecting objects of different scales. First, we fuse multi-level features (i.e. multiple layers) extracted by backbone as the base feature. Second, we feed the base feature into a block of alternating joint Thinned U-shape Modules and Feature Fusion Modules and exploit the decoder layers of each U-shape module as the features for detecting objects. Finally, we gather up the decoder layers with equivalent scales (sizes) to construct a feature pyramid for object detection, in which every feature map consists of the layers (features) from multiple levels. To evaluate the effectiveness of the proposed MLFPN, we design and train a powerful end-to-end one-stage object detector we call M2Det by integrating it into the architecture of SSD, and achieve better detection performance than state-of-the-art one-stage detectors. Specifically, on MS-COCO benchmark, M2Det achieves AP of 41.0 at speed of 11.8 FPS with single-scale inference strategy and AP of 44.2 with multi-scale inference strategy, which are the new state-of-the-art results among one-stage detectors. The code will be made available on https://github.com/qijiezhao/M2Det.

A Rich Feature Fusion Single-Stage Object Detector.

Feature Combination Based On Receptive Fields And Cross-Fusion Feature Pyramid For Object Detection

TDFSSD: Top-Down Feature Fusion Single Shot MultiBox Detector

Residual Bi-Fusion Feature Pyramid Network for Accurate Single-shot Object Detection

Enhancement-fusion Feature Pyramid Network for Object Detection

FSSD: Feature Fusion Single Shot Multibox Detector

FESSD:SSD target detection based on feature fusion and feature enhancement

Comprehensive Feature Enhancement Module For Single-Shot Object Detector

Afmf: Adaptive Fusion of Multi-Scale Features for Pixel-Level Object Detection

Attention-based Fusion Factor in FPN for Object Detection

Parallel Residual Bi-Fusion Feature Pyramid Network for Accurate Single-Shot Object Detection

FFR-SSD: feature fusion and reconstruction single shot detector for multi-scale object detection

Single-Shot Object Detection via Feature Enhancement and Channel Attention

An attention-based feature pyramid network for single-stage small object detection

MFPN: A Novel Mixture Feature Pyramid Network of Multiple Architectures for Object Detection

Cascaded Multi-Channel Feature Fusion for Object Detection.

Exploring Context Information for Accurate and Fast Object Detection

Small Object Detection Algorithm Based on Feature Pyramid-Enhanced Fusion SSD

DPSSD: Dual-Path Single-Shot Detector

A feature pyramid network with adaptive fusion strategy and enhanced semantic information

M2Det: A Single-Shot Object Detector Based on Multi-Level Feature Pyramid Network.