Abstract:Differential games have been extensively applied to optimal control problems. Nash equilibrium captures the tradeoff among players' policies when every player independently tries to minimize a predefined index. When considering potential cooperation, Pareto equilibrium plays an important role in cooperative differential games. This article studies the cooperative control of multiplayer systems on the quadratic infinite horizon. First, by defining a joint cost function using a parameter set, a cooperative differential game is reformulated as a general optimal control problem, where all players form a grand coalition. Then, the joint cost function is approximated by a critic neural network, and for the first time, a novel adaptive dynamic programming algorithm with two learning stages is proposed to determine the parameter selection and then obtain Pareto optimal solutions. A numerical example demonstrates that this algorithm can achieve optimal policies and Pareto frontier. As for its application, the cooperative control of a two-area interconnected power system is investigated, where the primary frequency control and secondary frequency control are regarded as two players. Simulation results indicate that the proposed scheme can obtain binding cooperation agreements, such that cooperative control scheme can get better overall performance compared to Nash control method and another three control methods.

Value Iteration-Based Cooperative Adaptive Optimal Control for Multi-Player Differential Games With Incomplete Information

Neural-network-based Learning Algorithms for Cooperative Games of Discrete-Time Multi-Player Systems with Control Constraints Via Adaptive Dynamic Programming

Optimal self-learning cooperative control for continuous-time heterogeneous multi-agent systems

Cooperative Differential Game-Based Optimal Control and Its Application to Power Systems

Adaptive Dynamic Programming for Solving Non-Zero-Sum Differential Games.

Discrete-Time Nonzero-Sum Games for Multiplayer Using Policy-Iteration-Based Adaptive Dynamic Programming Algorithms

Iterative ADP Learning Algorithms for Discrete-Time Multi-Player Games.

Policy-Iteration-Based Learning for Nonlinear Player Game Systems with Constrained Inputs.

Policy Iteration Adaptive Dynamic Programming for Optimal Control of Multi-Player Stackelberg-Nash Games

Model-Free Adaptive Optimal Control for Unknown Nonlinear Multiplayer Nonzero-Sum Game

Differential Dynamic Programming for Finite-Horizon Multi-Player Non-Zero-Sum Differential Games of Nonlinear Systems

Online Adaptive Q-learning Method for Fully Cooperative Linear Quadratic Dynamic Games

Adaptive Dynamic Programming for Two-Player Zero-Sum Differential Games with Completely Unknown Systems

Learning Algorithms For Differential Games Of Continuous-Time Systems

Robust Optimal Tracking Control for Linear Systems via Adaptive Dynamic Programming method

Robust Adaptive Dynamic Programming for A Three-Player Zero-Sum Differential Game with Unmatched Uncertainties

Online Finite-Horizon Optimal Learning Algorithm for Nonzero-Sum Games with Partially Unknown Dynamics and Constrained Inputs

Adaptive Dynamic Programming for a Class of Two-player Stackelberg Differential Games.

Iterative Adaptive Dynamic Programming Methods with Neural Network Implementation for Multi-Player Zero-Sum Games

Model Based Online Adaptive Inverse Non-Cooperative Linear-Quadratic Differential Games Via Finite-Time Concurrent Learning

Robust multi-agent differential games with application to cooperative guidance