Abstract:There is an increasing demand for technology and solutions to counter commercial, off-the-shelf small unmanned aerial systems (sUAS). Advances in machine learning and deep neural networks for object detection, coupled with lower cost and power requirements of cameras, led to promising vision-based solutions for sUAS detection. However, solely relying on the visible spectrum has previously led to reliability issues in low contrast scenarios such as sUAS flying below the treeline and against bright sources of light. Alternatively, due to the relatively high heat signatures emitted from sUAS during ight, a long-wave infrared (LWIR) sensor is able to produce images that clearly contrast the sUAS from its background. However, compared to widely available visible spectrum sensors, LWIR sensors have lower resolution and may produce more false positives when exposed to birds or other heat sources. This research work proposes combining the advantages of the LWIR and visible spectrum sensors using machine learning for vision-based detection of sUAS. Utilizing the heightened background contrast from the LWIR sensor combined and synchronized with the relatively increased resolution of the visible spectrum sensor, a deep learning model was trained to detect the sUAS through previously difficult environments. More specifically, the approach demonstrated effective detection of multiple sUAS flying above and below the treeline, in the presence of heat sources, and glare from the sun. Our approach achieved a detection rate of 71.2 8.3%, improving by 69% when compared to LWIR and by 30.4% when visible spectrum alone, and achieved false alarm rate of 2.7 2.6%, decreasing by 74.1% and by 47.1% when compared to LWIR and visible spectrum alone, respectively, on average, for single and multiple drone scenarios, controlled for the same confidence metric of the machine learning object detector of at least 50%. With a network of these small and affordable sensors, one can accurately estimate the 3D position of the sUAS, which could then be used for elimination or further localization from more narrow sensors, like a fire-control radar (FCR). Videos of the solution's performance can be seen at https://sites.google.com/view/tamudrone-spie2020/.

Early Wildfire Detection and Distance Estimation Using Aerial Visible-Infrared Images

Wildland Fire Detection and Monitoring Using a Drone-Collected RGB/IR Image Dataset

A Vision-Based Detection and Spatial Localization Scheme for Forest Fire Inspection from UAV

Wildfire Detection Through Deep Learning Based on Himawari-8 Satellites Platform

A UAV Forest Fire Detection Method Based on Dual-Light Vision Images

Deep Learning Based Wildfire Event Object Detection from 4K Aerial Images Acquired by UAS

Applying deep learning to real-time UAV-based forest monitoring: Leveraging multi-sensor imagery for improved results

UAV-FDN: Forest-fire Detection Network for Unmanned Aerial Vehicle Perspective

Deep learning approach for uav-based wildfire detection and segmentation

Combining visible and infrared spectrum imagery using machine learning for small unmanned aerial system detection

A Wildfire Smoke Detection System Using Unmanned Aerial Vehicle Images Based on the Optimized YOLOv5

A YOLOv3-based Learning Strategy for Real-time UAV-based Forest Fire Detection

Preliminary Results from a Wildfire Detection System Using Deep Learning on Remote Camera Images

Early Detection of Forest Fire Based on Unmaned Aerial Vehicle Platform

AI Enabled Fire-Detecting Drone Using Deep Learning Model

Mapping of Potential Fuel Regions Using Uncrewed Aerial Vehicles for Wildfire Prevention

Obscured Wildfire Flame Detection By Temporal Analysis of Smoke Patterns Captured by Unmanned Aerial Systems

Detecting Wildfires on UAVs with Real-time Segmentation Trained by Larger Teacher Models

A Deep Learning Based Forest Fire Detection Approach Using UAV and YOLOv3

Active Wildfires Detection and Dynamic Escape Routes Planning for Humans through Information Fusion between Drones and Satellites

Forest Fire Detection with Color Features and Wavelet Analysis Based on Aerial Imagery