Abstract:Detecting small objects in drone imagery is challenging due to low resolution and background blending, leading to limited feature information. Multiscale feature fusion can enhance detection by capturing information at different scales, but traditional strategies fall short. Simple concatenation or addition operations do not fully utilize multiscale fusion advantages, resulting in insufficient correlation between features. This inadequacy hinders the detection of small objects, especially in complex backgrounds and densely populated areas. To address this issue and efficiently utilize the limited computational resources, we propose a lightweight fusion strategy based on enhanced interlayer feature correlation (EFC) to replace the traditional feature fusion strategy in feature pyramid network (FPN). The semantic expressions of different layers in the feature pyramid are inconsistent. In EFC, the grouped feature focus unit (GFF) enhances the feature correlation of each layer by focusing on the contextual information of different features. The multilevel feature reconstruction module (MFR) effectively reconstructs and transforms the strength and weakness information of each layer in the pyramid to reduce redundant feature fusion and retain more information about small targets in deep networks. It is noteworthy that the proposed method is plug-and-play and can be widely applied to various base networks. Extensive experiments and comprehensive evaluations on VisDrone, unmanned aerial vehicle benchmark object detection and tracking (UAVDT), and microsoft common objects in context (COCO) demonstrate the effectiveness. Using generalized focal loss (GFL) as the baseline on the VisDrone dataset with a large number of small targets, the proposed method improves the detection mean average precision (mAP) by 1.7%, surpassing many lightweight state-of-the-art methods and significantly reducing the Params and GFLOPs at the neck end. The code will be available at https://github.com/nuliweixiao/EFC.git.

Multi-scale Fusion Based Multi-stage Small Object Detection in Aerial Images ∗

MFFSODNet: Multiscale Feature Fusion Small Object Detection Network for UAV Aerial Images

Aerial images object detection method based on cross-scale multi-feature fusion

Remote Sensing Small Object Detection Network Based on Attention Mechanism and Multi-Scale Feature Fusion

Scale Enhancement Network for Object Detection in Aerial Images

MFEFNet: A Multi-Scale Feature Information Extraction and Fusion Network for Multi-Scale Object Detection in UAV Aerial Images

Object Detection in Remote Sensing Images Based on Adaptive Multi-Scale Feature Fusion Method

A multi-scale pyramid feature fusion-based object detection method for remote sensing images

Extended Feature Pyramid Network with Adaptive Scale Training Strategy and Anchors for Object Detection in Aerial Images

Multi-Scale Geospatial Object Detection Based on Shallow-Deep Feature Extraction

Multiscale Semantic Fusion-Guided Fractal Convolutional Object Detection Network for Optical Remote Sensing Imagery

Scale Decoupled Pyramid for Object Detection in Aerial Images

Multi-Scale DenseNets-Based Aircraft Detection from Remote Sensing Images

A Lightweight Fusion Strategy With Enhanced Interlayer Feature Correlation for Small Object Detection

A Multiscale Information Fusion Network Based on PixelShuffle Integrated With YOLO for Aerial Remote Sensing Object Detection

Multi-scale object detection in UAV images based on adaptive feature fusion

AMFEF-DETR: An End-to-End Adaptive Multi-Scale Feature Extraction and Fusion Object Detection Network Based on UAV Aerial Images

Dense Multiscale Feature Fusion Pyramid Networks for Object Detection in UAV-Captured Images

Small Object Detection with Multiscale Features

Object Detection in Aerial Images Using Feature Fusion Deep Networks

A Task-Balanced Multiscale Adaptive Fusion Network for Object Detection in Remote Sensing Images