Data-Driven Decision Making and Near-Optimal Path Planning for Multiagent System in Games

Xindi Wang,Hao Liu,Qing Gao
DOI: https://doi.org/10.1109/jmass.2023.3292259
2023-01-01
IEEE Journal on Miniaturization for Air and Space Systems
Abstract:In this article, the optimal real-time decision making and near-optimal path planning problem for multiagent systems subject to bounded state, collision avoidance, external disturbance, and partially unknown nonlinear dynamics of the multiagent system in complex games, is addressed and applied to the unmanned aerial vehicle. A mean-field decision-making model based on the neighbor information is established to transform the decision-making problem into a Bellman equation solving problem. A data-driven dynamic programming algorithm is proposed to solve the Bellman equation and generate an optimal strategy using the data from the historical database and expert knowledge. The near-optimal path planning problem is formulated with an optimal coordination control problem, and an online integral reinforcement learning algorithm is proposed to iteratively interact with the environment to obtain a near-optimal path. Simulation results are provided to verify the effectiveness of the proposed methods.
What problem does this paper attempt to address?