Distributed Wildfire Surveillance with Autonomous Aircraft Using Deep Reinforcement Learning

Kyle D. Julian,Mykel J. Kochenderfer

DOI: https://doi.org/10.2514/1.G004106

2019-10-07

Abstract:Journal of Guidance, Control, and Dynamics, Ahead of Print.

engineering, aerospace,instruments & instrumentation

What problem does this paper attempt to address?

A Reinforcement Learning Approach for Wildfire Tracking with UAV Swarms

Carles Diaz-Vilor,Angel Lozano,Hamid Jafarkhani

2024-07-08

Abstract:Suitably equipped with cameras and sensors, uncrewed aerial vehicles (UAVs) can be instrumental for wildfire prediction, tracking, and monitoring, provided that uninterrupted connectivity can be guaranteed even if some of the ground access points (APs) are damaged by the fire itself. A cell-free network structure, with UAVs connecting to a multiplicity of APs, is therefore ideal in terms of resilience. This work proposes a trajectory optimization framework for a UAV swarm tracking a wildfire while maintaining cell-free connectivity with ground APs. Such optimization entails a constant repositioning of the multiplicity of UAVs as the fire evolves to ensure that the best possible view is acquired and transmitted reliably, while respecting altitude limits, avoiding collisions, and proceeding to recharge batteries as needed. Given the complexity and time-varying nature of this multi-UAV trajectory optimization, reinforcement learning is leveraged, specifically the twin-delayed deep deterministic policy gradient algorithm. The approach is shown to be highly effective for wildfire tracking and coverage and could be likewise applicable to survey other natural and man-made phenomena, including weather events, earthquakes, or chemical spills.

Signal Processing
Image-based Guidance of Autonomous Aircraft for Wildfire Surveillance and Prediction

Kyle D. Julian,Mykel J. Kochenderfer

DOI: https://doi.org/10.48550/arXiv.1810.02455

2019-03-02

Abstract:Small unmanned aircraft can help firefighters combat wildfires by providing real-time surveillance of the growing fires. However, guiding the aircraft autonomously given only wildfire images is a challenging problem. This work models noisy images obtained from on-board cameras and proposes two approaches to filtering the wildfire images. The first approach uses a simple Kalman filter to reduce noise and update a belief map in observed areas. The second approach uses a particle filter to predict wildfire growth and uses observations to estimate uncertainties relating to wildfire expansion. The belief maps are used to train a deep reinforcement learning controller, which learns a policy to navigate the aircraft to survey the wildfire while avoiding flight directly over the fire. Simulation results show that the proposed controllers precisely guide the aircraft and accurately estimate wildfire growth, and a study of observation noise demonstrates the robustness of the particle filter approach.

Robotics,Artificial Intelligence
A Deep Reinforcement Learning Algorithm for Trajectory Planning of Swarm UAV Fulfilling Wildfire Reconnaissance

Kubilay Demir,Vedat Tumen,Selahattin Kosunalp,Teodor Iliev

DOI: https://doi.org/10.3390/electronics13132568

IF: 2.9

2024-06-30

Electronics

Abstract:Wildfires have long been one of the critical environmental disasters that require a careful monitoring system. An intelligent system has the potential to both prevent/extinguish the fire and deliver urgent requirements postfire. In recent years, unmanned aerial vehicles (UAVs), with the ability to detect missions in high-risk areas, have been gaining increasing interest, particularly in forest fire monitoring. Taking a large-scale area involved in a fire into consideration, a single UAV is often insufficient to accomplish the task of covering the whole disaster zone. This poses the challenge of multi-UAVs optimum path planning with a key focus on limitations such as energy constraints and connectivity. To narrow down this issue, this paper proposes a deep reinforcement learning-based trajectory planning approach for multi-UAVs that permits UAVs to extract the required information within the disaster area on time. A target area is partitioned into several identical subareas in terms of size to enable UAVs to perform their patrol duties over the subareas. This subarea-based arrangement converts the issue of trajectory planning into allowing UAVs to frequently visit each subarea. Each subarea is initiated with a risk level by creating a fire risk map optimizing the UAV patrol route more precisely. Through a set of simulations conducted with a real trace of the dataset, the performance outcomes confirmed the superiority of the proposed idea.

engineering, electrical & electronic,computer science, information systems,physics, applied
A Distributed Control Framework of Multiple Unmanned Aerial Vehicles for Dynamic Wildfire Tracking

Huy Xuan Pham,Hung Manh La,David Feil-Seifer,Matthew Dean

DOI: https://doi.org/10.48550/arXiv.1803.07926

2018-03-20

Abstract:Wild-land fire fighting is a hazardous job. A key task for firefighters is to observe the "fire front" to chart the progress of the fire and areas that will likely spread next. Lack of information of the fire front causes many accidents. Using Unmanned Aerial Vehicles (UAVs) to cover wildfire is promising because it can replace humans in hazardous fire tracking and significantly reduce operation costs. In this paper we propose a distributed control framework designed for a team of UAVs that can closely monitor a wildfire in open space, and precisely track its development. The UAV team, designed for flexible deployment, can effectively avoid in-flight collisions and cooperate well with neighbors. They can maintain a certain height level to the ground for safe flight above fire. Experimental results are conducted to demonstrate the capabilities of the UAV team in covering a spreading wildfire.

Robotics
PyroTrack: Belief-Based Deep Reinforcement Learning Path Planning for Aerial Wildfire Monitoring in Partially Observable Environments

Sahand Khoshdel,Qi Luo,Fatemeh Afghah

2024-03-17

Abstract:Motivated by agility, 3D mobility, and low-risk operation compared to human-operated management systems of autonomous unmanned aerial vehicles (UAVs), this work studies UAV-based active wildfire monitoring where a UAV detects fire incidents in remote areas and tracks the fire frontline. A UAV path planning solution is proposed considering realistic wildfire management missions, where a single low-altitude drone with limited power and flight time is available. Noting the limited field of view of commercial low-altitude UAVs, the problem formulates as a partially observable Markov decision process (POMDP), in which wildfire progression outside the field of view causes inaccurate state representation that prevents the UAV from finding the optimal path to track the fire front in limited time. Common deep reinforcement learning (DRL)-based trajectory planning solutions require diverse drone-recorded wildfire data to generalize pre-trained models to real-time systems, which is not currently available at a diverse and standard scale. To narrow down the gap caused by partial observability in the space of possible policies, a belief-based state representation with broad, extensive simulated data is proposed where the beliefs (i.e., ignition probabilities of different grid areas) are updated using a Bayesian framework for the cells within the field of view. The performance of the proposed solution in terms of the ratio of detected fire cells and monitored ignited area (MIA) is evaluated in a complex fire scenario with multiple rapidly growing fire batches, indicating that the belief state representation outperforms the observation state representation both in fire coverage and the distance to fire frontline.

Robotics,Systems and Control
Wildfire Monitoring in Remote Areas using Autonomous Unmanned Aerial Vehicles

Fatemeh Afghah,Abolfazl Razi,Jacob Chakareski,Jonathan Ashdown

DOI: https://doi.org/10.48550/arXiv.1905.00492

2019-04-15

Computers and Society

Abstract:In this paper, we propose a drone-based wildfire monitoring system for remote and hard-to-reach areas. This system utilizes autonomous unmanned aerial vehicles (UAVs) with the main advantage of providing on-demand monitoring service faster than the current approaches of using satellite images, manned aircraft and remotely controlled drones. Furthermore, using autonomous drones facilitates minimizing human intervention in risky wildfire zones. In particular, to develop a fully autonomous system, we propose a distributed leader-follower coalition formation model to cluster a set of drones into multiple coalitions that collectively cover the designated monitoring field. The coalition leader is a drone %with longer communication range that employs observer drones potentially with different sensing and imaging %actuation capabilities to hover in circular paths and collect imagery information from the impacted areas. The objectives of the proposed system include i) to cover the entire fire zone with a minimum number of drones, and ii) to minimize the energy consumption and latency of the available drones to fly to the fire zone. Simulation results confirm that the performance of the proposed system -- without the need for inter-coalition communications -- approaches that of a centrally-optimized system.
Learning-based Wildfire Tracking with Unmanned Aerial Vehicles

Qiong Jia,Ming Xin,Xiaolin Hu,Haiyang Chao

DOI: https://doi.org/10.23919/acc53348.2022.9867512

2022-01-01

Abstract:This paper designs a path planning algorithm for a group of unmanned aerial vehicles (UAVs) to track multiple spreading wildfire zones. Due to limited observable information, the fire evolution is hard to model. A regression neural network is online trained with real-time UAV observation data and applied for fire front prediction. To track fire fronts effectively, a UAV path planning algorithm is proposed by Q-learning. Various practical factors are taken into account by cost function designs such as moving target tracking, field of view of UAVs, spreading speed of fire zones, collision/obstacle avoidance, and maximum information collection. Simulation results validate the fire prediction accuracy and UAV tracking performance.
Safe Coordination of Human-Robot Firefighting Teams

Esmaeil Seraj,Andrew Silva,Matthew Gombolay

DOI: https://doi.org/10.48550/arXiv.1903.06847

2019-03-16

Abstract:Wildfires are destructive and inflict massive, irreversible harm to victims' lives and natural resources. Researchers have proposed commissioning unmanned aerial vehicles (UAVs) to provide firefighters with real-time tracking information; yet, these UAVs are not able to reason about a fire's track, including current location, measurement, and uncertainty, as well as propagation. We propose a model-predictive, probabilistically safe distributed control algorithm for human-robot collaboration in wildfire fighting. The proposed algorithm overcomes the limitations of prior work by explicitly estimating the latent fire propagation dynamics to enable intelligent, time-extended coordination of the UAVs in support of on-the-ground human firefighters. We derive a novel, analytical bound that enables UAVs to distribute their resources and provides a probabilistic guarantee of the humans' safety while preserving the UAVs' ability to cover an entire fire.

Robotics,Artificial Intelligence,Human-Computer Interaction,Multiagent Systems
Hierarchical Framework for Optimizing Wildfire Surveillance and Suppression using Human-Autonomous Teaming

Mahdi Al-Husseini,Kyle Wray,Mykel Kochenderfer

2024-06-25

Abstract:The integration of manned and unmanned aircraft can help improve wildfire response. Wildfire containment failures occur when resources available to first responders, who execute the initial stages of wildfire management referred to as the initial attack, are ineffective or insufficient. Initial attack surveillance and suppression models have linked action spaces and objectives, making their optimization computationally challenging. The initial attack may be formulated as a multi-agent partially observable Markov decision process (MPOMDP). We divide the initial attack MPOMDP into surveillance and suppression processes with their respective planners operating on different, but constant, time scales. A hierarchical framework iterates between surveillance and suppression planners while also providing collision avoidance. This framework is exemplified by a set of multi-rotor unmanned aircraft surveying an initial attack fire while a manned helicopter suppresses the fire with a water bucket. Wildfire-specific solver extensions are formulated to reduce the otherwise vast action spaces. The hierarchical framework outperforms firefighting techniques and a myopic baseline by up to 242% for moderate wildfires and 60% for rapid wildfires when simulated in abstracted and actual case studies. We also validate the early dispatching of additional suppression assets using regression models to ensure wildfire containment to thresholds established by wildfire agencies.

Systems and Control,Multiagent Systems
Parallel Distributional Prioritized Deep Reinforcement Learning for Unmanned Aerial Vehicles

Alisson Henrique Kolling,Victor Augusto Kich,Junior Costa de Jesus,Andressa Cavalcante da Silva,Ricardo Bedin Grando,Paulo Lilles Jorge Drews-Jr,Daniel F. T. Gamarra

2023-09-01

Abstract:This work presents a study on parallel and distributional deep reinforcement learning applied to the mapless navigation of UAVs. For this, we developed an approach based on the Soft Actor-Critic method, producing a distributed and distributional variant named PDSAC, and compared it with a second one based on the traditional SAC algorithm. In addition, we also embodied a prioritized memory system into them. The UAV used in the study is based on the Hydrone vehicle, a hybrid quadrotor operating solely in the air. The inputs for the system are 23 range findings from a Lidar sensor and the distance and angles towards a desired goal, while the outputs consist of the linear, angular, and, altitude velocities. The methods were trained in environments of varying complexity, from obstacle-free environments to environments with multiple obstacles in three dimensions. The results obtained, demonstrate a concise improvement in the navigation capabilities by the proposed approach when compared to the agent based on the SAC for the same amount of training steps. In summary, this work presented a study on deep reinforcement learning applied to mapless navigation of drones in three dimensions, with promising results and potential applications in various contexts related to robotics and autonomous air navigation with distributed and distributional variants.

Robotics
Forest Fire Localization: From Reinforcement Learning Exploration to a Dynamic Drone Control

Jonatan Alvarez,Assia Belbachir,Faiza Belbachir,Jamy Chahal,Abdelhak Goudjil,Johvany Gustave,Aybüke Öztürk Suri

DOI: https://doi.org/10.1007/s10846-023-02004-z

2023-12-01

Journal of Intelligent and Robotic Systems: Theory and Applications

Abstract:Globalization impacts directly pollution, and one of the side effects is the increasing number of forest fires and their fast propagation. To reduce this phenomenon, several studies have tried to model fire propagation and find an adequate method to predict (or follow) this spread to stop it. However, to the best of our knowledge, most of the developed works do not use an adaptive exploration strategy to follow the fire evolution. Instead, they are mainly focused on observing the evolution and trying to find an adequate spread model to predict fire behavior. Due to the lack of all the exact parameters to predict the fire spread, in this paper, we propose a new exploration strategy based on reinforcement learning using an Unmanned Aerial Vehicle (UAV). The learned exploration strategy is able to predict and follow the fire propagation. To follow the generated waypoints by the exploration strategy, we develop a new robust controller, which can be embedded in a UAV. All these modules are encapsulated and interact with each other using a synchronized architecture. To prove the efficiency of our proposal, we present the obtained results on several simulated forest fire scenarios and compare them with other approaches. Then, We validate our entire architecture and show its efficiency using software in the loop environment using the Robot Operating System (ROS).
Deep learning approach for uav-based wildfire detection and segmentation

Sreenath K,Hemalatha Reddy G,Venkata Ranga Reddy K,Sneha Sandhya G,Mahaboob Basha M D

DOI: https://doi.org/10.26524/sajet.2022.12.45

2022-07-11

South Asian Journal of Engineering and Technology

Abstract:Wildfires are a worldwide natural disaster causing important economic damages and loss of lives . Early detection and prediction of fire spread can help reduce affected areas and improve firefighting. Unmanned Aerial Vehicles were employed to tackle this problem due to their HIGH flexibility, their low-cost, and their ability to cover wide areas during the day or night. However , they are still limited by challenging problems such as small fire size, background complexity, and image degradation .To deal with the limitations, we adapted and optimized Deep Learning methods to detect wildfire at an early stage. A novel deep ensemble learning method, which combines EfficientNet-B5 and DenseNet-201 models, is proposed to identify and classify wildfire using aerial images.
Multi-UAV planning for cooperative wildfire coverage and tracking with quality-of-service guarantees

Esmaeil Seraj,Andrew Silva,Matthew Gombolay

DOI: https://doi.org/10.1007/s10458-022-09566-6

2022-06-25

Abstract:In recent years, teams of robot and Unmanned Aerial Vehicles (UAVs) have been commissioned by researchers to enable accurate, online wildfire coverage and tracking. While the majority of prior work focuses on the coordination and control of such multi-robot systems, to date, these UAV teams have not been given the ability to reason about a fire's track (i.e., location and propagation dynamics) to provide performance guarantee over a time horizon. Motivated by the problem of aerial wildfire monitoring, we propose a predictive framework which enables cooperation in multi-UAV teams towards collaborative field coverage and fire tracking with probabilistic performance guarantee. Our approach enables UAVs to infer the latent fire propagation dynamics for time-extended coordination in safety-critical conditions. We derive a set of novel, analytical temporal, and tracking-error bounds to enable the UAV-team to distribute their limited resources and cover the entire fire area according to the case-specific estimated states and provide a probabilistic performance guarantee. Our results are not limited to the aerial wildfire monitoring case-study and are generally applicable to problems, such as search-and-rescue, target tracking and border patrol. We evaluate our approach in simulation and provide demonstrations of the proposed framework on a physical multi-robot testbed to account for real robot dynamics and restrictions. Our quantitative evaluations validate the performance of our method accumulating and smaller tracking-error than state-of-the-art model-based and reinforcement learning benchmarks, respectively.
AI Enabled Fire-Detecting Drone Using Deep Learning Model

Murugesan G,

DOI: https://doi.org/10.26562/ijiris.2024.v1003.04

2024-04-30

International Journal of Innovative Research in Information Security

Abstract:Wildfires pose significant threats to both human lives and the environment, necessitating advanced technological solutions for early detection and rapid response. This project aims to design, develop, and implement an autonomous drone system equipped with cutting-edge fire detection technology leveraging deep learning concepts. The system's primary objective is to swiftly identify and locate wildfires, enabling timely intervention and mitigation efforts to enhance public safety and environmental protection. The proposed drone system integrates state-of-the-art deep learning algorithms, allowing it to analyze real-time aerial imagery for signs of fire outbreaks with high accuracy and efficiency. Through the utilization of convolutional neural networks(CNNs) trained on vast datasets of wildfire images, the system can recognize distinct patterns and characteristics associated with flames, smoke, and heat sources amidst varying environmental conditions. Key components of the autonomous drone system include advanced sensors such as infrared cameras and multispectral imaging devices, facilitating enhanced detection capabilities across different spectrums. The integration of these sensors enables the system to detect wildfires even in challenging scenarios such as dense foliage or low visibility conditions. Upon detection of potential wildfire activity, the autonomous drone employs intelligent navigation algorithms to swiftly navigate to the identified location for closer inspection and assessment. Real-time data transmission capabilities enable seamless communication with ground-based emergency response teams, providing critical information for prompt decision-making and deployment of firefighting resources.
A deep reinforcement learning based distributed multi-UAV dynamic area coverage algorithm for complex environment

Jian Xiao,Guohui Yuan,Yuxi Xue,Jinhui He,Yaoting Wang,Yuanjiang Zou,Zhuoran Wang

DOI: https://doi.org/10.1016/j.neucom.2024.127904

IF: 6

2024-05-23

Neurocomputing

Abstract:Dynamic area coverage algorithm is often used in multiple unmanned aerial vehicle (multi-UAV) systems to realize searching or monitoring an area of interest (AOI). Improving coverage efficiency is one of the important research issues of dynamic area coverage. In this paper, we propose a distributed dynamic area coverage algorithm based on a reinforcement learning (RL) algorithm to enhance the coverage efficiency in complex application environments. A coverage information fusion based discrete soft actor-critic algorithm (herein FDSAC) is proposed to solve the non-stationary problem of RL algorithm in area coverage task under the communication constraint environment. Considering the equivalence of UAVs in the area coverage tasks, we introduce a multi-UAV cooperative learning method for FDSAC by sharing the strategy and experience of the UAVs to accelerate the learning speed of FDSAC in multi-UAV system. With the FDSAC algorithm, the UAVs can intelligently select the best coverage points and achieve almost optimal coverage point planning for the entire coverage process. In addition, we also provide a coverage point adjustment method based on the distribution of obstacles to enable the proposed algorithm adapt to obstacle environments. The experimental results demonstrate that the proposed algorithm can efficiently complete the area coverage task in complex communication and stochastic control noise environment. The good scalability, environment adaptability, and practicality of our algorithm have been also confirmed in different complex environments of different experimental platforms.

computer science, artificial intelligence
An Autonomous Free Airspace En-route Controller using Deep Reinforcement Learning Techniques

Joris Mollinga,Herke van Hoof

DOI: https://doi.org/10.48550/arXiv.2007.01599

2020-07-03

Abstract:Air traffic control is becoming a more and more complex task due to the increasing number of aircraft. Current air traffic control methods are not suitable for managing this increased traffic. Autonomous air traffic control is deemed a promising alternative. In this paper an air traffic control model is presented that guides an arbitrary number of aircraft across a three-dimensional, unstructured airspace while avoiding conflicts and collisions. This is done utilizing the power of graph based deep learning approaches. These approaches offer significant advantages over current approaches to this task, such as invariance to the input ordering of aircraft and the ability to easily cope with a varying number of aircraft. Results acquired using these approaches show that the air traffic control model performs well on realistic traffic densities; it is capable of managing the airspace by avoiding 100% of potential collisions and preventing 89.8% of potential conflicts.

Artificial Intelligence,Machine Learning
Deep Reinforcement Learning for Time-Critical Wilderness Search And Rescue Using Drones

Jan-Hendrik Ewers,David Anderson,Douglas Thomson

2024-05-22

Abstract:Traditional search and rescue methods in wilderness areas can be time-consuming and have limited coverage. Drones offer a faster and more flexible solution, but optimizing their search paths is crucial. This paper explores the use of deep reinforcement learning to create efficient search missions for drones in wilderness environments. Our approach leverages a priori data about the search area and the missing person in the form of a probability distribution map. This allows the deep reinforcement learning agent to learn optimal flight paths that maximize the probability of finding the missing person quickly. Experimental results show that our method achieves a significant improvement in search times compared to traditional coverage planning and search planning algorithms. In one comparison, deep reinforcement learning is found to outperform other algorithms by over $160\%$, a difference that can mean life or death in real-world search operations. Additionally, unlike previous work, our approach incorporates a continuous action space enabled by cubature, allowing for more nuanced flight patterns.

Robotics,Machine Learning,Systems and Control
Multi-UAV Adaptive Path Planning Using Deep Reinforcement Learning

Jonas Westheider,Julius Rückin,Marija Popović

2023-03-02

Abstract:Efficient aerial data collection is important in many remote sensing applications. In large-scale monitoring scenarios, deploying a team of unmanned aerial vehicles (UAVs) offers improved spatial coverage and robustness against individual failures. However, a key challenge is cooperative path planning for the UAVs to efficiently achieve a joint mission goal. We propose a novel multi-agent informative path planning approach based on deep reinforcement learning for adaptive terrain monitoring scenarios using UAV teams. We introduce new network feature representations to effectively learn path planning in a 3D workspace. By leveraging a counterfactual baseline, our approach explicitly addresses credit assignment to learn cooperative behaviour. Our experimental evaluation shows improved planning performance, i.e. maps regions of interest more quickly, with respect to non-counterfactual variants. Results on synthetic and real-world data show that our approach has superior performance compared to state-of-the-art non-learning-based methods, while being transferable to varying team sizes and communication constraints.

Robotics
Wildland Fire Detection and Monitoring Using a Drone-Collected RGB/IR Image Dataset

Xiwen Chen,Bryce Hopkins,Hao Wang,Leo O'Neill,Fatemeh Afghah,Abolfazl Razi,Peter Fule,Janice Coen,Eric Rowell,Adam Watts

DOI: https://doi.org/10.1109/access.2022.3222805

IF: 3.9

2022-11-25

IEEE Access

Abstract:Current forest monitoring technologies including satellite remote sensing, manned/piloted aircraft, and observation towers leave uncertainties about a wildfire's extent, behavior, and conditions in the fire's near environment, particularly during its early growth. Rapid mapping and real-time fire monitoring can inform in-time intervention or management solutions to maximize beneficial fire outcomes. Drone systems' unique features of 3D mobility, low flight altitude, and fast and easy deployment make them a valuable tool for early detection and assessment of wildland fires, especially in remote forests that are not easily accessible by ground vehicles. In addition, the lack of abundant, well-annotated aerial datasets – in part due to unmanned aerial vehicles' (UAVs') flight restrictions during prescribed burns and wildfires – has limited research advances in reliable data-driven fire detection and modeling techniques. While existing wildland fire datasets often include either color or thermal fire images, here we present (1) a multi-modal UAV-collected dataset of dual-feed side-by-side videos including both RGB and thermal images of a prescribed fire in an open canopy pine forest in Northern Arizona and (2) a deep learning-based methodology for detecting fire and smoke pixels at accuracy much higher than the usual single-channel video feeds. The collected images are labeled to "fire" or "no-fire" frames by two human experts using side-by-side RGB and thermal images to determine the label. To provide context to the main dataset's aerial imagery, the included supplementary dataset provides a georeferenced pre-burn point cloud, an RGB orthomosaic, weather information, a burn plan, and other burn information. By using and expanding on this guide - ataset, research can develop new data-driven fire detection, fire segmentation, and fire modeling techniques.

computer science, information systems,telecommunications,engineering, electrical & electronic
Autonomous UAV Navigation Using Reinforcement Learning

Huy X. Pham,Hung M. La,David Feil-Seifer,Luan V. Nguyen

DOI: https://doi.org/10.48550/arXiv.1801.05086

2018-01-16

Abstract:Unmanned aerial vehicles (UAV) are commonly used for missions in unknown environments, where an exact mathematical model of the environment may not be available. This paper provides a framework for using reinforcement learning to allow the UAV to navigate successfully in such environments. We conducted our simulation and real implementation to show how the UAVs can successfully learn to navigate through an unknown environment. Technical aspects regarding to applying reinforcement learning algorithm to a UAV system and UAV flight control were also addressed. This will enable continuing research using a UAV with learning capabilities in more important applications, such as wildfire monitoring, or search and rescue missions.

Robotics

Distributed Wildfire Surveillance with Autonomous Aircraft Using Deep Reinforcement Learning

A Reinforcement Learning Approach for Wildfire Tracking with UAV Swarms

Image-based Guidance of Autonomous Aircraft for Wildfire Surveillance and Prediction

A Deep Reinforcement Learning Algorithm for Trajectory Planning of Swarm UAV Fulfilling Wildfire Reconnaissance

A Distributed Control Framework of Multiple Unmanned Aerial Vehicles for Dynamic Wildfire Tracking

PyroTrack: Belief-Based Deep Reinforcement Learning Path Planning for Aerial Wildfire Monitoring in Partially Observable Environments

Wildfire Monitoring in Remote Areas using Autonomous Unmanned Aerial Vehicles

Learning-based Wildfire Tracking with Unmanned Aerial Vehicles

Safe Coordination of Human-Robot Firefighting Teams

Hierarchical Framework for Optimizing Wildfire Surveillance and Suppression using Human-Autonomous Teaming

Parallel Distributional Prioritized Deep Reinforcement Learning for Unmanned Aerial Vehicles

Forest Fire Localization: From Reinforcement Learning Exploration to a Dynamic Drone Control

Deep learning approach for uav-based wildfire detection and segmentation

Multi-UAV planning for cooperative wildfire coverage and tracking with quality-of-service guarantees

AI Enabled Fire-Detecting Drone Using Deep Learning Model

A deep reinforcement learning based distributed multi-UAV dynamic area coverage algorithm for complex environment

An Autonomous Free Airspace En-route Controller using Deep Reinforcement Learning Techniques

Deep Reinforcement Learning for Time-Critical Wilderness Search And Rescue Using Drones

Multi-UAV Adaptive Path Planning Using Deep Reinforcement Learning

Wildland Fire Detection and Monitoring Using a Drone-Collected RGB/IR Image Dataset

Autonomous UAV Navigation Using Reinforcement Learning