Abstract:The use of small and remotely controlled unmanned aerial vehicles (UAVs), referred to as drones, has increased dramatically in recent years, both for professional and recreative purposes. This goes in parallel with (intentional or unintentional) misuse episodes, with an evident threat to the safety of people or facilities [1]. As a result, the detection of UAV has also emerged as a research topic [2]. Most of the existing studies on drone detection fail to specify the type of acquisition device, the drone type, the detection range, or the employed dataset. The lack of proper UAV detection studies employing thermal infrared cameras is also acknowledged as an issue, despite its success in detecting other types of targets [2]. Beside, we have not found any previous study that addresses the detection task as a function of distance to the target. Sensor fusion is indicated as an open research issue as well to achieve better detection results in comparison to a single sensor, although research in this direction is scarce too [3], [4], [5], [6]. To help in counteracting the mentioned issues and allow fundamental studies with a common public benchmark, we contribute with an annotated multi-sensor database for drone detection that includes infrared and visible videos and audio files. The database includes three different drones, a small-sized model (Hubsan H107D+), a medium-sized drone (DJI Flame Wheel in quadcopter configuration), and a performance-grade model (DJI Phantom 4 Pro). It also includes other flying objects that can be mistakenly detected as drones, such as birds, airplanes or helicopters. In addition to using several different sensors, the number of classes is higher than in previous studies [4]. The video part contains 650 infrared and visible videos (365 IR and 285 visible) of drones, birds, airplanes and helicopters. Each clip is of ten seconds, resulting in a total of 203,328 annotated frames. The database is complemented with 90 audio files of the classes drones, helicopters and background noise. To allow studies as a function of the sensor-to-target distance, the dataset is divided into three categories (Close, Medium, Distant) according to the industry-standard Detect, Recognize and Identify (DRI) requirements [7], built on the Johnson criteria [8]. Given that the drones must be flown within visual range due to regulations, the largest sensor-to-target distance for a drone in the dataset is 200 m, and acquisitions are made in daylight. The data has been obtained at three airports in Sweden: Halmstad Airport (IATA code: HAD/ICAO code: ESMT), Gothenburg City Airport (GSE/ESGP) and Malmö Airport (MMX/ESMS). The acquisition sensors are mounted on a pan-tilt platform that steers the cameras to the objects of interest. All sensors and the platform are controlled with a standard laptop vis a USB hub.

Introducing AOD 4: A dataset for air borne object detection

YOLO-based Segmented Dataset for Drone vs. Bird Detection for Deep and Machine Learning Algorithms

Object Detection in Aerial Images: A Large-Scale Benchmark and Challenges

A dataset for multi-sensor drone detection

UAVData: A dataset for unmanned aerial vehicle detection

FOD-A: A Dataset for Foreign Object Debris in Airports

Analysis and Adaptation of YOLOv4 for Object Detection in Aerial Images

Aerial Data Exploration: An in-Depth Study From Horizontal to Oriented Viewpoint

A Dataset of Infrared Images for Deep Learning based Drone Detection

AIOD-YOLO: an algorithm for object detection in low-altitude aerial images

OLOD: a new UAV dataset and benchmark for single tiny object tracking

HIT-UAV: A high-altitude infrared thermal dataset for Unmanned Aerial Vehicle-based object detection

Toward Open Vocabulary Aerial Object Detection with CLIP-Activated Student-Teacher Learning

An improved deep learning method for flying object detection and recognition

RTDOD: A large-scale RGB-thermal domain-incremental object detection dataset for UAVs

Flying Objects Classification Based on Micro–Doppler Signature Data From UAV Borne Radar

Vision-Based Anti-UAV Detection and Tracking

MMAUD: A Comprehensive Multi-Modal Anti-UAV Dataset for Modern Miniature Drone Threats

AirTrack: Onboard Deep Learning Framework for Long-Range Aircraft Detection and Tracking