Abstract:This article proposes an optimal-distributed control protocol for multivehicle systems with an unknown switching communication graph. The optimal-distributed control problem is formulated to differential graphical games, and the Pareto optimum to multiplayer games is sought based on the viability theory and reinforcement learning techniques. The viability theory characterizes the controllability of a wide range of constrained nonlinear systems; and the viability kernel and the capture basin are the pillars of the viability theory. The capture basin is the set of all initial states, in which there exist control strategies that enable the states to reach the target in finite time while remaining inside a set before reaching the target. In this regard, the feasible learning region is characterized by the reinforcement learner. In addition, the approximation of the capture basin provides the learner with prior knowledge. Unlike the existing works that employ the viability theory to solve control problems with only one agent and differential games with only two players, the viability theory, in this article, is utilized to solve multiagent control problems and multiplayer differential games. The distributed control law is composed of two parts: 1) the approximation of the capture basin and 2) reinforcement learning, which are computed offline and online, respectively. The convergence properties of the parameters' estimation errors in reinforcement learning are proved, and the convergence of the control policy to the Pareto optimum of the differential graphical game is discussed. The guaranteed approximation results of the capture basin are provided and the simulation results of the differential graphical game are provided for multivehicle systems with the proposed distributed control policy.

Cooperative Path Following Control in Autonomous Vehicles Graphical Games: A Data-Based Off-Policy Learning Approach

Cooperative Distributed Predictive Control for Collision-Free Vehicle Platoons

Human-in-the-loop Distributed Cooperative Tracking Control with Applications to Autonomous Ground Vehicles: A Data-Driven Mixed Iteration Approach

Adaptive Learning-Based Path-Tracking Control for Unknown Vehicle Systems under Performance Optimization

Off-Policy Learning-Based Following Control of Cooperative Autonomous Vehicles Under Distributed Attacks

Switching Learning-Based Cooperative Control with Its Application to Connected Automated Vehicles

Differential Graphical Games for Constrained Autonomous Vehicles Based on Viability Theory

Perceptual Interaction-Based Path Tracking Control of Autonomous Vehicles under DoS Attacks: A Reinforcement Learning Approach

Path Following for Autonomous Ground Vehicle Using DDPG Algorithm: A Reinforcement Learning Approach

Synthesis of Distributed Control of Coordinated Path Following Based on Hybrid Approach.

Data-Efficient Off-Policy Learning for Distributed Optimal Tracking Control of HMAS with Unidentified Exosystem Dynamics.

A hybrid control approach to multi-robot coordinated path following

Game Theory-Based Control Strategy For Trajectory Following of Four-Wheel Independently Actuated Autonomous Vehicles

Optimal Lateral Path-Tracking Control of Vehicles with Partial Unknown Dynamics Via DPG-Based Reinforcement Learning Methods

Non-zero-sum Game Control for Multi-vehicle Driving via Reinforcement Learning

A Novel Vehicle Platoon Following Controller Based on Deep Deterministic Policy Gradient Algorithms

Adaptive Distributed Dynamic Surface Control For Cooperative Path Following Of Multi-Robot Systems With Unknown Uncertainties Under Directed Graphs

Distributed Drive Autonomous Vehicle Trajectory Tracking Control Based on Multi-Agent Deep Reinforcement Learning

An Optimization-Based Cooperative Path-Following Framework for Multiple Robotic Vehicles

Time-Dependent Hybrid-State A* and Optimal Control for Autonomous Vehicles in Arbitrary and Dynamic Environment

Data-Based Predictive Control Via Multistep Policy Gradient Reinforcement Learning