Abstract:Detecting small objects in drone imagery is challenging due to low resolution and background blending, leading to limited feature information. Multiscale feature fusion can enhance detection by capturing information at different scales, but traditional strategies fall short. Simple concatenation or addition operations do not fully utilize multiscale fusion advantages, resulting in insufficient correlation between features. This inadequacy hinders the detection of small objects, especially in complex backgrounds and densely populated areas. To address this issue and efficiently utilize the limited computational resources, we propose a lightweight fusion strategy based on enhanced interlayer feature correlation (EFC) to replace the traditional feature fusion strategy in feature pyramid network (FPN). The semantic expressions of different layers in the feature pyramid are inconsistent. In EFC, the grouped feature focus unit (GFF) enhances the feature correlation of each layer by focusing on the contextual information of different features. The multilevel feature reconstruction module (MFR) effectively reconstructs and transforms the strength and weakness information of each layer in the pyramid to reduce redundant feature fusion and retain more information about small targets in deep networks. It is noteworthy that the proposed method is plug-and-play and can be widely applied to various base networks. Extensive experiments and comprehensive evaluations on VisDrone, unmanned aerial vehicle benchmark object detection and tracking (UAVDT), and microsoft common objects in context (COCO) demonstrate the effectiveness. Using generalized focal loss (GFL) as the baseline on the VisDrone dataset with a large number of small targets, the proposed method improves the detection mean average precision (mAP) by 1.7%, surpassing many lightweight state-of-the-art methods and significantly reducing the Params and GFLOPs at the neck end. The code will be available at https://github.com/nuliweixiao/EFC.git.

End-to-End Fusion Network of Deep and Hand-Crafted Features for Small Object Detection

Small object detection using deep feature learning and feature fusion network

Small Object Detection Network Based on Feature Information Enhancement

ALFPN: Adaptive Learning Feature Pyramid Network for Small Object Detection

A Lightweight Fusion Strategy With Enhanced Interlayer Feature Correlation for Small Object Detection

CA2Det: Cascaded Adaptive Fusion Pyramid Network Based on Attention Mechanism for Small Object Detection

Small Object Detection Method Based on Adaptive Spatial Parallel Convolution and Fast Multi-Scale Fusion

Enhanced semantic feature pyramid network for small object detection

Small object detection based on attention mechanism and enhanced network

Extended Feature Pyramid Network for Small Object Detection

Feature Rescaling and Fusion for Tiny Object Detection

DFE-Net: detail feature extraction network for small object detection

Pyramid attention object detection network with multi-scale feature fusion

An attention-based feature pyramid network for single-stage small object detection

An efficient single shot detector with weight-based feature fusion for small object detection

Research on Feature Enhancement for Small Object Detection

FFEDet: Fine-Grained Feature Enhancement for Small Object Detection

A Small-Sized Object Detection Oriented Multi-Scale Feature Fusion Approach With Application to Defect Detection

Improving small object detection via context-aware and feature-enhanced plug-and-play modules

Small Object Detection Method Based on Weighted Feature Fusion and CSMA Attention Module

MDFN: Multi-scale deep feature learning network for object detection