Abstract:Detecting small objects in drone imagery is challenging due to low resolution and background blending, leading to limited feature information. Multiscale feature fusion can enhance detection by capturing information at different scales, but traditional strategies fall short. Simple concatenation or addition operations do not fully utilize multiscale fusion advantages, resulting in insufficient correlation between features. This inadequacy hinders the detection of small objects, especially in complex backgrounds and densely populated areas. To address this issue and efficiently utilize the limited computational resources, we propose a lightweight fusion strategy based on enhanced interlayer feature correlation (EFC) to replace the traditional feature fusion strategy in feature pyramid network (FPN). The semantic expressions of different layers in the feature pyramid are inconsistent. In EFC, the grouped feature focus unit (GFF) enhances the feature correlation of each layer by focusing on the contextual information of different features. The multilevel feature reconstruction module (MFR) effectively reconstructs and transforms the strength and weakness information of each layer in the pyramid to reduce redundant feature fusion and retain more information about small targets in deep networks. It is noteworthy that the proposed method is plug-and-play and can be widely applied to various base networks. Extensive experiments and comprehensive evaluations on VisDrone, unmanned aerial vehicle benchmark object detection and tracking (UAVDT), and microsoft common objects in context (COCO) demonstrate the effectiveness. Using generalized focal loss (GFL) as the baseline on the VisDrone dataset with a large number of small targets, the proposed method improves the detection mean average precision (mAP) by 1.7%, surpassing many lightweight state-of-the-art methods and significantly reducing the Params and GFLOPs at the neck end. The code will be available at https://github.com/nuliweixiao/EFC.git.

3DF-FCOS: Small object detection with 3D features based on FCOS

DroneNet: Rescue Drone-View Object Detection

DSE-FCOS: Dilated and SE Block-Reinforced FCOS for Detection of Marine Benthos

SODCNN: A Convolutional Neural Network Model for Small Object Detection in Drone-Captured Images

Dynamic Feature and Context Enhancement Network for Faster Detection of Small Objects

Detection Based on Semantics and a Detail Infusion Feature Pyramid Network and a Coordinate Adaptive Spatial Feature Fusion Mechanism Remote Sensing Small Object Detector

Single-Shot Object Detection via Feature Enhancement and Channel Attention

Tiny FCOS: a Lightweight Anchor-Free Object Detection Algorithm for Mobile Scenarios

CA2Det: Cascaded Adaptive Fusion Pyramid Network Based on Attention Mechanism for Small Object Detection

Small object detection using deep feature learning and feature fusion network

A Lightweight Fusion Strategy With Enhanced Interlayer Feature Correlation for Small Object Detection

Improving small object detection via context-aware and feature-enhanced plug-and-play modules

ESOD: Efficient Small Object Detection on High-Resolution Images

FCOS: Fully Convolutional One-Stage Object Detection

Small object detection leveraging density‐aware scale adaptation

DSAFF-Net: A Backbone Network Based on Mask R-CNN for Small Object Detection

Small object detection based on attention mechanism and enhanced network

An attention-based feature pyramid network for single-stage small object detection

CSSDet: small object detection via cross-scale feature enhancement on drone-view images

DFE-Net: detail feature extraction network for small object detection

An advanced YOLOv3 method for small object detection