Abstract:The effective use of multi-scale features remains an open problem for object detection tasks. Recently, proposed object detectors have usually used Feature Pyramid Networks (FPN) to fuse multi-scale features. Since Feature Pyramid Networks use a relatively simple feature map fusion approach, it can lead to the loss or misalignment of semantic information in the fusion process. Several works have demonstrated that using a bottom-up structure in a Feature Pyramid Network can shorten the information path between lower layers and the topmost feature, allowing an adequate exchange of semantic information from different layers. We further enhance the bottom-up path by proposing a multi-scale residual aggregation Feature Pyramid Network (MSRA-FPN), which uses a unidirectional cross-layer residual module to aggregate features from multiple layers bottom-up in a triangular structure to the topmost layer. In addition, we introduce a Residual Squeeze and Excitation Module to mitigate the aliasing effects that occur when features from different layers are aggregated. MSRA-FPN enhances the semantic information of the high-level feature maps, mitigates the information decay during feature fusion, and enhances the detection capability of the model for large objects. It is experimentally demonstrated that our proposed MSRA-FPN improves the performance of the three baseline models by 0.5–1.9% on the PASCAL VOC dataset and is also quite competitive with other state-of-the-art FPN methods. On the MS COCO dataset, our proposed method can also improve the performance of the baseline model by 0.8% and the baseline model's performance for large object detection by 1.8%. To further validate the effectiveness of MSRA-FPN for large object detection, we constructed the Thangka Figure Dataset and conducted comparative experiments. It is experimentally demonstrated that our proposed method improves the performance of the baseline model by 2.9–4.7% on this dataset and can reach up to 71.2%.

Multiagent Detection System Based on Spatial Adaptive Feature Aggregation

Multilevel Spatial-Temporal Feature Aggregation for Video Object Detection

Adaptive Scale and Spatial Aggregation for Real-Time Object Detection

BCNet: Bidirectional Collaboration Network for Edge-Guided Salient Object Detection

MLA-Net: Feature Pyramid Network with Multi-Level Local Attention for Object Detection

GAB-Net: A Robust Detector for Remote Sensing Object Detection Under Dramatic Scale Variation and Complex Backgrounds

Adaptive Feature Separation Network for Remote Sensing Object Detection

AFANet: A Multibackbone Compatible Feature Fusion Framework for Effective Remote Sensing Object Detection

Adaptive feature aggregation network for object detection in remote sensing images

Multi-Scale Interactive Network for Salient Object Detection

Multi-Scale Residual Aggregation Feature Pyramid Network for Object Detection

A Novel Adaptive Edge Aggregation and Multiscale Feature Interaction Detector for Object Detection in Remote Sensing Images

Attention-guided cross-modal multiple feature aggregation network for RGB-D salient object detection

Semantic Information Feature Aggregation Network for Object Detection in Remote Sensing Images

MBAN: multi-branch attention network for small object detection

DSAFF-Net: A Backbone Network Based on Mask R-CNN for Small Object Detection

Spatial Information Enhancement with Multi-Scale Feature Aggregation for Long-Range Object and Small Reflective Area Object Detection from Point Cloud

Position-Aware Voxel Aggregate Network for Two-Stage 3-D Object Detector

Multi-scale Vertical Cross-layer Feature Aggregation and Attention Fusion Network for Object Detection

Efficient-Receptive Field Block with Group Spatial Attention Mechanism for Object Detection.

ABNet: Adaptive Balanced Network for Multiscale Object Detection in Remote Sensing Imagery