Abstract:Intrusion detection is often used in scenarios such as airports and essential facilities. Based on UAVs equipped with optical payloads, intrusion detection from an aerial perspective can be realized. However, due to the limited field of view of the camera, it is difficult to achieve large-scale continuous tracking of intrusion targets. In this study, we proposed an intrusion target detection and tracking method based on the fusion of a 360° panoramic camera and a 3-axis gimbal, and designed a detection model covering five types of intrusion targets. During the research process, the multi-rotor UAV platform was built. Then, based on a field flight test, 3043 flight images taken by a 360° panoramic camera and a 3-axis gimbal in various environments were collected, and an intrusion data set was produced. Subsequently, considering the applicability of the YOLO model in intrusion target detection, this paper proposes an improved YOLOv5s-360ID model based on the original YOLOv5-s model. This model improved and optimized the anchor box of the YOLOv5-s model according to the characteristics of the intrusion target. It used the K-Means++ clustering algorithm to regain the anchor box that matches the small target detection task. It also introduced the EIoU loss function to replace the original CIoU loss function. The target bounding box regression loss function made the intrusion target detection model more efficient while ensuring high detection accuracy. The performance of the UAV platform was assessed using the detection model to complete the test flight verification in an actual scene. The experimental results showed that the mean average precision (mAP) of the YOLOv5s-360ID was 75.2%, which is better than the original YOLOv5-s model of 72.4%, and the real-time detection frame rate of the intrusion detection was 31 FPS, which validated the real-time performance of the detection model. The gimbal tracking control algorithm for intrusion targets is also validated. The experimental results demonstrate that the system can enhance intrusion targets’ detection and tracking range.

Dynamic Beehive Detection and Tracking System Based on YOLO V5 and Unmanned Aerial Vehicle

Individual honey bee tracking in a beehive environment using deep learning and Kalman filter

Target Detection Formulti-Uavs Via Digital Pheromones and Navigation Algorithm in Unknownenvironments

IntelliBeeHive: An Automated Honey Bee, Pollen, and Varroa Destructor Monitoring System

Beehive-Inspired Information Gathering with a Swarm of Autonomous Drones

Enhanced Small Drone Detection Using Optimized YOLOv8 With Attention Mechanisms

Real-time recognition application for UAV based on YOLOv5

Beehive Smart Detector Device for the Detection of Critical Conditions That Utilize Edge Device Computations and Deep Learning Inferences

REDBEE: A Visual-Inertial Drone System for Real-Time Moving Object Detection

Research on UAV Target Detection Algorithm Based on Improved Air-Borne-YOLOv3

UN-YOLOv5s: A UAV-Based Aerial Photography Detection Algorithm

Small Target Detection Algorithm for UAV Aerial Photography Based on Improved YOLOv5s

A Deep Learning Approach of Intrusion Detection and Tracking with UAV-Based 360° Camera and 3-Axis Gimbal

Innovative Research on Small Object Detection and Recognition in Remote Sensing Images Using YOLOv5

Unmanned Aerial Vehicle Perspective Small Target Recognition Algorithm Based on Improved YOLOv5

Intelligent UAV fire monitoring method based on improved YOLOv5 algorithm

YOLO-Drone:Airborne real-time detection of dense small objects from high-altitude perspective

OSDDY: embedded system-based object surveillance detection system with small drone using deep YOLO

A New Algorithm for Small Target Detection From the Perspective of Unmanned Aerial Vehicles

Detection and Assessment of White Flowering Nectar Source Trees and Location of Bee Colonies in Rural and Suburban Environments Using Deep Learning

Enhancing Pollinator Conservation towards Agriculture 4.0: Monitoring of Bees through Object Recognition