Performance Evaluation of Deep Learning-based Quadrotor UAV Detection and Tracking Methods

Mohssen E. Elshaar,Zeyad M. Manaa,Mohammed R. Elbalshy,Abdul Jabbar Siddiqui,Ayman M. Abdallah

2024-10-01

Abstract:Unmanned Aerial Vehicles (UAVs) are becoming more popular in various sectors, offering many benefits, yet introducing significant challenges to privacy and safety. This paper investigates state-of-the-art solutions for detecting and tracking quadrotor UAVs to address these concerns. Cutting-edge deep learning models, specifically the YOLOv5 and YOLOv8 series, are evaluated for their performance in identifying UAVs accurately and quickly. Additionally, robust tracking systems, BoT-SORT and Byte Track, are integrated to ensure reliable monitoring even under challenging conditions. Our tests on the DUT dataset reveal that while YOLOv5 models generally outperform YOLOv8 in detection accuracy, the YOLOv8 models excel in recognizing less distinct objects, demonstrating their adaptability and advanced capabilities. Furthermore, BoT-SORT demonstrated superior performance over Byte Track, achieving higher IoU and lower center error in most cases, indicating more accurate and stable tracking. Code: <a class="link-external link-https" href="https://github.com/zmanaa/UAV_detection_and_tracking" rel="external noopener nofollow">this https URL</a> Tracking demo: <a class="link-external link-https" href="https://drive.google.com/file/d/1pe6HC5kQrgTbA2QrjvMN-yjaZyWeAvDT/view?usp=sharing" rel="external noopener nofollow">this https URL</a>

Computer Vision and Pattern Recognition

What problem does this paper attempt to address?

### What problems does this paper attempt to solve?

This paper aims to solve the key challenges in the detection and tracking of unmanned aerial vehicles (UAVs). With the wide application of UAVs in various fields, although they bring many benefits, they also cause significant privacy and security issues. To meet these challenges, the author has studied the capabilities of the state - of - the - art deep - learning models in detecting and tracking quadrotor UAVs.

Specifically, the main objectives of the paper include:

1. **Evaluating state - of - the - art deep - learning models**: The paper focuses on evaluating the performance of the YOLOv5 and YOLOv8 series models in detecting UAVs and compares their accuracy and speed.
2. **Integrating a robust tracking system**: To ensure reliable monitoring in complex environments, the paper integrates two tracking systems, BoT - SORT and ByteTrack, and evaluates their performance.
3. **Establishing a comprehensive evaluation framework**: The author constructs a systematic evaluation framework for testing the performance of different detection and tracking models in various scenarios, especially those with complex backgrounds and occlusions.
4. **Providing public resources**: To promote the reproducibility of research, the author provides the trained model weights and demonstration code and hosts them on GitHub.
5. **Analyzing the advantages and limitations of the models**: Through in - depth analysis of the experimental results, the author points out the advantages and disadvantages of each model, providing valuable insights for practical applications.
6. **Proposing future research directions**: Based on the experimental results, the author proposes suggestions for improving UAV detection and tracking systems, including potential model improvements and integration strategies.

Through these efforts, the paper hopes to provide important references and support for the development of efficient and reliable anti - UAV detection and tracking systems.