Abstract:Unmanned autonomous vehicles for various civilian and military applications have become a particularly interesting research area. Despite their many potential applications, a related technological challenge is realizing realistic coordinated autonomous control and decision making in complex and multi-agent environments. Machine learning approaches have been largely employed in simplified simulations to acquire intelligent control systems in multi-agent settings. However, the complexity of the physical environment, unrealistic assumptions, and lack of abstract physical environments derail the process of transition from simulation to real systems. This work presents a modular framework for automated data acquisition, training, and the evaluation of multiple unmanned surface vehicles controllers that facilitate prior knowledge integration and human-guided learning in a closed-loop. To realize this, we first present a digital maritime environment of multiple unmanned surface vehicles that abstracts the real-world dynamics in our application domain. Then, a behavior-driven artificial immune-inspired fuzzy classifier systems approach that is capable of optimizing agents’ behaviors and action selection in a multi-agent environment is presented. Evaluation scenarios of different combat missions are presented to demonstrate the performance of the system. Simulation results show that the resulting controllers can achieved an average wining rate between 52% and 98% in all test cases, indicating the effectiveness of the proposed approach and its feasibility in realizing adaptive controllers for efficient multiple unmanned systems’ cooperative decision making. We believe that this system can facilitate the simulation, data acquisition, training, and evaluation of practical cooperative unmanned vehicles’ controllers in a closed-loop.

Intelligent Controller for Unmanned Surface Vehicles by Deep Reinforcement Learning

A Model Predictive Control Approach for USV Autonomous Cruising Via Disturbance Learning

An adaptive PID controller for path following of autonomous underwater vehicle based on Soft Actor–Critic

PID Controller Based on Improved DDPG for Trajectory Tracking Control of USV

Path Following Control for Unmanned Surface Vehicles: A Reinforcement Learning-Based Method with Experimental Validation.

Single degree of freedom control based on deep reinforcement learning for underwater unmanned vehicle

Neural Network Model-Based Reinforcement Learning Control for AUV 3-D Path Following

Deep reinforcement learning with intrinsic curiosity module based trajectory tracking control for USV

LSTM-DPPO based deep reinforcement learning controller for path following optimization of unmanned surface vehicle

Advancing unmanned surface vehicle heading control: real-sea validation of a practical model predictive controller for a medium-scale hybrid-power trimaran

Fuzzy Categorical Deep Reinforcement Learning of a Defensive Game for an Unmanned Surface Vessel

Data-Driven Performance-Prescribed Reinforcement Learning Control of an Unmanned Surface Vehicle

Model predictive attitude control of unmanned surface vehicle based on short-time wave prediction

Adaptive Dynamic Model-Based Path Following Controller Design for an Unmanned Surface Vessel

Straight Line Path Following of Unmanned Surface Vessel Based on Fuzzy PID

Adaptive Neural Network Iterative Sliding Mode Course Tracking Control for Unmanned Surface Vessels

Path-Following Control of Unmanned Underwater Vehicle Based on an Improved TD3 Deep Reinforcement Learning

Towards Realizing Intelligent Coordinated Controllers for Multi-USV Systems Using Abstract Training Environments

Dynamic Obstacle Avoidance for USVs Using Cross-Domain Deep Reinforcement Learning and Neural Network Model Predictive Controller

An Offline Reinforcement Learning Approach for Path Following of an Unmanned Surface Vehicle

Reinforcement Learning for UAV Attitude Control