Abstract:(1) Background: Small objects in Unmanned Aerial Vehicle (UAV) images are often scattered throughout various regions of the image, such as the corners, and may be blocked by larger objects, as well as susceptible to image noise. Moreover, due to their small size, these objects occupy a limited area in the image, resulting in a scarcity of effective features for detection. (2) Methods: To address the detection of small objects in UAV imagery, we introduce a novel algorithm called High-Resolution Feature Pyramid Network Mamba-Based YOLO (HRMamba-YOLO). This algorithm leverages the strengths of a High-Resolution Network (HRNet), EfficientVMamba, and YOLOv8, integrating a Double Spatial Pyramid Pooling (Double SPP) module, an Efficient Mamba Module (EMM), and a Fusion Mamba Module (FMM) to enhance feature extraction and capture contextual information. Additionally, a new Multi-Scale Feature Fusion Network, High-Resolution Feature Pyramid Network (HRFPN), and FMM improved feature interactions and enhanced the performance of small object detection. (3) Results: For the VisDroneDET dataset, the proposed algorithm achieved a 4.4% higher Mean Average Precision (mAP) compared to YOLOv8-m. The experimental results showed that HRMamba achieved a mAP of 37.1%, surpassing YOLOv8-m by 3.8% (Dota1.5 dataset). For the UCAS_AOD dataset and the DIOR dataset, our model had a mAP 1.5% and 0.3% higher than the YOLOv8-m model, respectively. To be fair, all the models were trained without a pre-trained model. (4) Conclusions: This study not only highlights the exceptional performance and efficiency of HRMamba-YOLO in small object detection tasks but also provides innovative solutions and valuable insights for future research.

An Empirical Study of Multi-Scale Object Detection in High Resolution UAV Images

Learning-based Object Detection in High Resolution UAV Images - An Empirical Study.

The Unmanned Aerial Vehicle Benchmark: Object Detection and Tracking

A Novel Dataset and Detection Method for Unmanned Aerial Vehicles Using an Improved YOLOv9 Algorithm

The Unmanned Aerial Vehicle Benchmark: Object Detection, Tracking and Baseline

Efficient and Accurate Giraffe-Det for UAV Image Based Object Detection

HCD-Mask: a Multi-Task Model for Small Object Detection and Instance Segmentation in High-Resolution UAV Images.

A Multi-Scale Object Detector Based on Coordinate and Global Information Aggregation for UAV Aerial Images

Accurate UAV Small Object Detection Based on HRFPN and EfficentVMamba

Hierarchical Scale Awareness for Object Detection in Unmanned Aerial Vehicle Scenes

Self-Attention Guidance and Multiscale Feature Fusion-Based UAV Image Object Detection

UEMM-Air: A Synthetic Multi-modal Dataset for Unmanned Aerial Vehicle Object Detection

Multiclass Object Detection in UAV Images Based on Rotation Region Network

UAVData: A dataset for unmanned aerial vehicle detection

Small-Object Detection for UAV-Based Images Using a Distance Metric Method

Multi-Scale And Occlusion Aware Network For Vehicle Detection And Segmentation On Uav Aerial Images

UAVSwarm Dataset: An Unmanned Aerial Vehicle Swarm Dataset for Multiple Object Tracking

A Small-Object Detection Model Based on Improved YOLOv8s for UAV Image Scenarios

A context-scale-aware detector and a new benchmark for remote sensing small weak object detection in unmanned aerial vehicle images

Multi-Scale Vehicle Detection in High-Resolution Aerial Images with Context Information

Towards Better Small Object Detection in UAV Scenes