Abstract:Communication efficiency and flocking stability are two basic requirements for the application of autonomous underwater vehicles (AUVs) in maritime transportation systems. Although they are closely related, most existing flocking approaches focus on the control techniques and ignore the influence of communication efficiency. This paper presents a joint design solution to the channel estimation and flocking control for multi-AUV-based maritime transportation systems, with the consideration of path loss, shadow and multipath fading channels. A value iteration-based reinforcement learning (RL) estimator is first designed to predict the channel quality of AUVs in positions that have not yet visited. With the predicted channel quality, we construct an integrated optimization problem for the co-design of communication and flocking strategies. Along with this, a value iteration-based RL flocking controller is developed to achieve the co-design of channel estimation and flocking control for AUVs. It is worth mentioning that, the value iteration-based RL estimator in this paper can avoid local optimal in traditional least-squares methods, and meanwhile the flocking controller in this paper can make a balance between flocking stability and communication efficiency for AUVs. Finally, simulation and experimental results reveal that the proposed approach in this paper has superior performances by comparing with the other works. As such, our approach is more useful for marine engineer to understand and explore the maritime transportation system from the communication and control view points.

Bearing Rigidity-Based Flocking Control of AUVs Via Semi-Supervised Incremental Broad Learning

Joint Design of Channel Estimation and Flocking Control for Multi-AUV-Based Maritime Transportation Systems

Distributed Path-Following Formation Control of Multi-AUV Based on Graph Laplacian

Distributed Circumnavigation Control of Autonomous Underwater Vehicles Based on Local Information.

Neural Network Model-Based Reinforcement Learning Control for AUV 3-D Path Following

Adaptive Formation Learning Control for Cooperative AUVs under Complete Uncertainty

Optimal Rigid Graph-Based Cooperative Formation Control of AUVs in Anchor-Free Environments

Model-Free Formation Control of Autonomous Underwater Vehicles: A Broad Learning-Based Solution

Enhanced Self-Organizing Control for Multiple AUV Systems: A Robust Approach

Joint Localisation and Tracking for Autonomous Underwater Vehicle: a Reinforcement Learning-Based Approach

Communication-Aware Formation Control of AUVs with Model Uncertainty and Fading Channel Via Integral Reinforcement Learning

Distributed robust model predictive control-based formation-containment tracking control for autonomous underwater vehicles

A novel method for formation control of multiple autonomous underwater vehicles(AUVs)

Bounded Neural Adaptive Formation Control of Multiple Underactuated AUVs under Uncertain Dynamics.

Learning-Based Multi-UAV Flocking Control With Limited Visual Field and Instinctive Repulsion

Adaptive Sliding Mode Control for AUV based on Backstepping and Neural Networks

Flocking of Under-Actuated Unmanned Surface Vehicles via Deep Reinforcement Learning and Model Predictive Path Integral Control

Simultaneous Control and Guidance of an AUV Based on Soft Actor-Critic

A Novel Multi-AUV Cooperative Navigation Method Using Information Incorporation

Integrated Localization and Tracking for AUV With Model Uncertainties via Scalable Sampling-Based Reinforcement Learning Approach

An Adaptive Fuzzy Reinforcement Learning Cooperative Approach for the Autonomous Control of Flock Systems