Abstract:Compared with two-stage object detection algorithms, one-stage algorithms provide a better trade-off between real-time performance and accuracy. However, these methods treat the intermediate features equally, which lacks the flexibility to emphasize meaningful information for classification and location. Besides, they ignore the interaction of contextual information from different scales, which is important for medium and small objects detection. To tackle these problems, we propose an image pyramid network based on dual attention mechanism (DAIPNet), which builds an image pyramid to enrich the spatial information while emphasizing multi-scale informative features based on dual attention mechanisms for one stage object detection. Our framework utilizes a pre-trained backbone as standard detection network, where the designed image pyramid network (IPN) is used as auxiliary network to provide complementary information. Here, the dual attention mechanism is composed of the adaptive feature fusion module (AFFM) and the progressive attention fusion module (PAFM). AFFM is designed to automatically pay attention to the feature maps with different importance from the backbone and auxiliary network, while PAFM is utilized to adaptively learn the channel attentive information in the context transfer process. Furthermore, in the IPN, we build an image pyramid to extract scale-wise features from downsampled images of different scales, where the features are further fused at different states to enrich scale-wise information and learn more comprehensive feature representations. Experimental results are shown on MS COCO dataset. Our proposed detector with a 300 x 300 input achieves superior performance of 32.6% mAP on the MS COCO test-dev compared with state-of-the-art methods.

Object Detection With Extended Attention And Spatial Information

EBiDA-FPN: Enhanced Bi-Directional Attention Feature Pyramid Network for Object Detection

MLA-Net: Feature Pyramid Network with Multi-Level Local Attention for Object Detection

Pyramid attention object detection network with multi-scale feature fusion

Multi-scale Vertical Cross-layer Feature Aggregation and Attention Fusion Network for Object Detection

Adaptive Spatial Perception Network

Fine Grained Dual Level Attention Mechanisms with Spacial Context Information Fusion for Object Detection

Multi-scale salient object detection with pyramid spatial pooling.

Spatial Attention for Multi-Scale Feature Refinement for Object Detection.

Multi-scale Global Context Feature Pyramid Network for Object Detector

Attention To The Scale : Deep Multi-Scale Salient Object Detection

Multi-scale Fusion with Context-aware Network for Object Detection

Joint-attention feature fusion network and dual-adaptive NMS for object detection

CA2Det: Cascaded Adaptive Fusion Pyramid Network Based on Attention Mechanism for Small Object Detection

Multi-Modal Object Detection Method Based on Dual-Branch Asymmetric Attention Backbone and Feature Fusion Pyramid Network

Fusing Context Features and Spatial Attention to Improve Object Detection

Toward Reliable Fusion Object Detection Based on Dilated Pyramid and Semantic Attention

Learning Discriminated Features Based on Feature Pyramid Networks and Attention for Multi-scale Object Detection

Stacked Pyramid Attention Network for Object Detection

Multi-level Feature Fusion Pyramid Network for Object Detection

Dual Attention Based Image Pyramid Network for Object Detection.