Abstract:There are three primary objectives of this work; first: to establish a gas concentration map; second: to estimate the point of emission of the gas; and third: to generate a path from any location to the point of emission for UAVs or UGVs. A mountable array of MOX sensors was developed so that the angles and distances among the sensors, alongside sensors data, were utilized to identify the influx of gas plumes. Gas dispersion experiments under indoor conditions were conducted to train machine learning algorithms to collect data at numerous locations and angles. Taguchi’s orthogonal arrays for experiment design were used to identify the gas dispersion locations. For the second objective, the data collected after pre-processing was used to train an off-policy, model-free reinforcement learning agent with a Q-learning policy. After finishing the training from the training data set, Q-learning produces a table called the Q-table. The Q-table contains state-action pairs that generate an autonomous path from any point to the source from the testing dataset. The entire process is carried out in an obstacle-free environment, and the whole scheme is designed to be conducted in three modes: search, track, and localize. The hyperparameter combinations of the RL agent were evaluated through trial-and-error technique and it was found that ε = 0.9, γ = 0.9 and α = 0.9 was the fastest path generating combination that took 1258.88 seconds for training and 6.2 milliseconds for path generation. Out of 31 unseen scenarios, the trained RL agent generated successful paths for all the 31 scenarios, however, the UAV was able to reach successfully on the gas source in 23 scenarios, producing a success rate of 74.19%. The results paved the way for using reinforcement learning techniques to be used as autonomous path generation of unmanned systems alongside the need to explore and improve the accuracy of the reported results as future works.

Dangerous gas traceability route planning for Four- rotor UAV based on the weighted centroid method

Path Planning for Unmanned Vehicle with Searching for Sources of Dangerous Gas Leaks

On trackability of a moving target by fixed-wing UAV using geometric approach

Optimization of sampling structure on unmanned aerial vehicle for gas leakage monitoring in the atmosphere

Target Detection, Positioning and Tracking Using New UAV Gas Sensor Systems: Simulation and Analysis

A Coverage Sampling Path Planning Method Suitable for UAV 3D Space Atmospheric Environment Detection

Emergency Localization for Mobile Ground Users: An Adaptive UAV Trajectory Planning Method

Networked Drones for Industrial Emergency Events

Gas concentration mapping and source localization for environmental monitoring through unmanned aerial systems using model-free reinforcement learning agents

Locating Hazardous Gas Leaks in the Atmosphere Via Modified Genetic, Mcmc and Particle Swarm Optimization Algorithms

Detection of Natural Gas Leakages Using a Laser-Based Methane Sensor and UAV

A novel hybrid information-based PF-WOA algorithm for gas source localization in 3D space

An intelligent UAV path planning optimization method for monitoring the risk of unattended offshore oil platforms

Multi-UAV Method for Continuous Source Rate Estimation of Fugitive Gas Emissions from a Point Source

A fuzzy control algorithm for tracing air pollution based on unmanned aerial vehicles

Implementation of Trapped Personnel Detection and Evacuation Guidance in Indoor Fire Scene Based on Quadrotor Uav

Optimal Trajectory Planning of Drones for 3D Mobile Sensing

Location of natural gas leakage sources on offshore platform by a multi-robot system using particle swarm optimization algorithm

Gas Leak Location Detection Based on Data Fusion with Time Difference of Arrival and Energy Decay Using an Ultrasonic Sensor Array

Relative Localization and Circumnavigation of a UGV0 Based on Mixed Measurements of Multi-UAVs by Employing Intelligent Sensors

Three-dimensional path planning with enhanced gravitational search algorithm for unmanned aerial vehicle