Abstract:In view of the small size and dense distribution of remote sensing image targets, this paper adds a detection head P2 specifically for small-scale targets on the basis of the three detection layers of the original YOLOv5 model, and involves the shallow high-resolution feature map in the subsequent multi-scale feature fusion module. The problem of losing the key feature information of the small-scale target in the process of multiple downsampling is effectively avoided. Firstly, an enhanced multi-scale feature fusion pyramid network DSI-FPN is designed. The FPN+PAN network is optimized by using DepthwiseSparable Convolution and Involution operators with fewer parameters and computations, as well as a spatial attention mechanism to generate feature graphs with richer information for network detection tasks. Secondly, we propose an adaptive channel spatial attention mechanism SCBAM, which introduces a self-attention mechanism into CBAM module to add non-local information to the interaction that originally had only local information, breaks the convolution kernel limit, expands the model receptive field, and improves the feature expression ability of the model. Thirdly, in order to solve the problem of insufficient computing power when deploying the target detector for equipment, we propose a network knowledge distillation framework for joint teachers based on the feature layer. The distillation loss of teacher is designed, and the trend of student online learning is adjusted dynamically by balancing the contributions of teacher network and truth value. The detection accuracy of the student network is obviously improved, and the parameters and model size of the network are effectively reduced. Finally, Comparing with other remote sensing image object detection methods, the experimental results show that the approach presented has better detection effect for small-scale targets of remote sensing images under different lighting conditions. The detection accuracy reached 43.9%, and 7.4% higher than that of the original model. After knowledge distillation, the model parameters are reduced to 1/3 of the original, and the detection accuracy is 40.2%.

Pyramid attention object detection network with multi-scale feature fusion

MLA-Net: Feature Pyramid Network with Multi-Level Local Attention for Object Detection

Small Object Detection using Multi-scale Feature Fusion and Attention

CA2Det: Cascaded Adaptive Fusion Pyramid Network Based on Attention Mechanism for Small Object Detection

EBiDA-FPN: Enhanced Bi-Directional Attention Feature Pyramid Network for Object Detection

Multi-level Feature Fusion Pyramid Network for Object Detection

MM-FPN: Multi-path and Multi-scale Feature Pyramid Network for Object Detection

Multi-Scale Object Detection Using Feature Fusion Recalibration Network

Enhanced semantic feature pyramid network for small object detection

Attention-based Fusion Factor in FPN for Object Detection

A multi-scale pyramid feature fusion-based object detection method for remote sensing images

Multi-scale salient object detection with pyramid spatial pooling.

Exploring Multi-scale Deep Feature Fusion for Object Detection.

Object Detection of Remote Sensing Image Based on Multi-Scale Feature Fusion and Attention Mechanism

Multi-scale Vertical Cross-layer Feature Aggregation and Attention Fusion Network for Object Detection

Dual Attention Based Image Pyramid Network for Object Detection.

Multi-scale Global Context Feature Pyramid Network for Object Detector

Multi-scale feature selection and fusion for object detection

Spatial Small Target Detection Method Based on Multi-Scale Feature Fusion Pyramid

Learning Discriminated Features Based on Feature Pyramid Networks and Attention for Multi-scale Object Detection

An attention-based feature pyramid network for single-stage small object detection