Abstract:Unmanned autonomous vehicles for various civilian and military applications have become a particularly interesting research area. Despite their many potential applications, a related technological challenge is realizing realistic coordinated autonomous control and decision making in complex and multi-agent environments. Machine learning approaches have been largely employed in simplified simulations to acquire intelligent control systems in multi-agent settings. However, the complexity of the physical environment, unrealistic assumptions, and lack of abstract physical environments derail the process of transition from simulation to real systems. This work presents a modular framework for automated data acquisition, training, and the evaluation of multiple unmanned surface vehicles controllers that facilitate prior knowledge integration and human-guided learning in a closed-loop. To realize this, we first present a digital maritime environment of multiple unmanned surface vehicles that abstracts the real-world dynamics in our application domain. Then, a behavior-driven artificial immune-inspired fuzzy classifier systems approach that is capable of optimizing agents’ behaviors and action selection in a multi-agent environment is presented. Evaluation scenarios of different combat missions are presented to demonstrate the performance of the system. Simulation results show that the resulting controllers can achieved an average wining rate between 52% and 98% in all test cases, indicating the effectiveness of the proposed approach and its feasibility in realizing adaptive controllers for efficient multiple unmanned systems’ cooperative decision making. We believe that this system can facilitate the simulation, data acquisition, training, and evaluation of practical cooperative unmanned vehicles’ controllers in a closed-loop.

Towards Realizing Intelligent Coordinated Controllers for Multi-USV Systems Using Abstract Training Environments

A Confidence-based Allocation Approach for USV Trajectory Tracking Via Human-Robot Co-Driving

A Multi-Agent Based Intelligent Training System for Unmanned Surface Vehicles

Multi-USV Dynamic Navigation and Target Capture: A Guided Multi-Agent Reinforcement Learning Approach

Hierarchical Control Design for the Cooperative Target Enclosing Motion of Unmanned Surface Vehicle.

Cooperative Target Enclosing Control for Multiple Unmanned Surface Vehicles with Unknown Dynamics and Safety Assurance

Behaivor-aware Cooperation for UAV-UGV System

Adaptive and extendable control of unmanned surface vehicle formations using distributed deep reinforcement learning

Collision Avoidance and Path Point Tracking Control for Underactuated Unmanned Surface Vehicles with Unknown Model Nonlinearity

Coordination control for multiple unmanned surface vehicles using hybrid behavior-based method

Motion Control and Collision Avoidance Algorithms for Unmanned Surface Vehicle Swarm in Practical Maritime Environment

Multi-USV System Antidisturbance Cooperative Searching Based on the Reinforcement Learning Method

Dynamic Obstacle Avoidance for USVs Using Cross-Domain Deep Reinforcement Learning and Neural Network Model Predictive Controller

Convergence of S3C Empowered Distributed Cooperative Optimization for Multi-Unmanned Surface Vehicles

Advancing unmanned surface vehicle heading control: real-sea validation of a practical model predictive controller for a medium-scale hybrid-power trimaran

Multi-Agent Deep Reinforcement Learning Framework Strategized by Unmanned Aerial Vehicles for Multi-Vessel Full Communication Connection

A Cooperative Heterogeneous System Design of Unmanned Aerial and Surface Vehicles

UAV Cooperative Air Combat Maneuvering Confrontation Based on Multi-agent Reinforcement Learning

A MBSE Application to Controllers of Autonomous Underwater Vehicles Based on Model-Driven Architecture Concepts

Distributed Coordinated Tracking Control of Multiple Unmanned Surface Vehicles under Complex Marine Environments

Reinforcement learning-based distributed cooperative sliding mode control for unmanned surface vehicles