Abstract:We have developed an adaptive sampling algorithm for an Explorer autonomous underwater vehicle (AUV) to conduct in-situ analysis of acoustic measurements to perform autonomous oil plume detection and tracking. The methodology of the tracking phase involves ongoing analysis of the detected plume, assessing target validity and proximity for AUV decision-making for plume mapping. We previously introduced the bumblebee flight path, a new biomimetic search pattern designed to maximize the spatial coverage in the oil plume detection phase. This paper focuses on a new tracking strategy as the key adaptive stage in our plume delineation. For initial development we used a 360-degree scanning sonar sensor model. Simulations were done with different plume models to assess the performance of the developed adaptive sampling algorithm. A convergence study demonstrated that the algorithm could successfully track the boundary of a non-regular shaped/patchy oil plume at up to a 0.05Hz sampling frequency. A sensitivity study identified the correlations between plume feature complexity and the anticipated range of acoustic measurement update delays. The decision-making architecture consists of three separate components which implements either proximity or boundary following control and contributes to the final decision on the next desired heading of the vehicle. A weight ratio, that determined the relative allocation of each component, was varied to study its impact on the tracking performance of the AUV. The novelty of our approach is in addressing the discontinuous and patchy nature of realistic oil plumes. Our sampling algorithm and its performance in simulations is a significant step beyond the practical limitations of existing gradient-following methods because it accounts for the oil patches and droplets which gradient-following algorithms do not.

Plume Tracing Via Model-Free Reinforcement Learning Method

A Plume-Tracing Strategy Via Continuous State-Action Reinforcement Learning

Neural Network Model-Based Reinforcement Learning Control for AUV 3-D Path Following

Underwater Multi-agent Cooperative Formation Hunting Based on Deep Reinforcement Learning

A Path Planning Method Based on Deep Reinforcement Learning for AUV in Complex Marine Environment

Depth Control of Model-Free AUVs Via Reinforcement Learning

Deep Interactive Reinforcement Learning for Path Following of Autonomous Underwater Vehicle

Mapless Motion Planning System for an Autonomous Underwater Vehicle Using Policy Gradient-based Deep Reinforcement Learning

Continuous Control for Autonomous Underwater Vehicle Path Following Using Deep Interactive Reinforcement Learning

Oil Plume Mapping: Adaptive Tracking and Adaptive Sampling From an Autonomous Underwater Vehicle

Path Planning of Unmanned Underwater Vehicles Based on Deep Reinforcement Learning Algorithm

Trajectory tracking control of vectored thruster autonomous underwater vehicles based on deep reinforcement learning

Path planning of autonomous underwater vehicle in unknown environment based on improved deep reinforcement learning

Mpc-Based Model-Based Reinforcement Learning and Planning for Auv Path Following

Deep Reinforcement Learning for Vectored Thruster Autonomous Underwater Vehicle Control

Path Planning based on Deep Reinforcement Learning for Autonomous Underwater Vehicles under Ocean Current Disturbance

Comprehensive Ocean Information-Enabled AUV Motion Planning Based on Reinforcement Learning

Unmanned Surface Vehicle Aided Maritime Data Collection Using Deep Reinforcement Learning

Unmanned Surface Vessel Motion Intention Recognition Based on Deep Reinforcement Learning

Deep Reinforcement Learning Based Optimal Trajectory Tracking Control of Autonomous Underwater Vehicle

A General Motion Controller Based on Deep Reinforcement Learning for an Autonomous Underwater Vehicle with Unknown Disturbances.