Coordination and Control in Multiagent Systems for Enhanced Pursuit-Evasion Game Performance

Hua Zhuang,Pengqun Gao,Xiaotong Wu,Ying Zhang,Huayi Jia
DOI: https://doi.org/10.1007/s13235-024-00584-5
2024-09-05
Dynamic Games and Applications
Abstract:This study introduces a creative approach called the Hybrid Deep Reinforcement Learning Approach (HYDREIL), which aims to improve coordination and control within the multiagent system for pursuit-evasion games. By combining the advanced techniques of DRL, this study can provide a strong foundation for improving the performance of pursuit-evasion games. The proposed HYDREIL combines the Improved Deep Deterministic Policy Gradient Algorithm (IDDPG) with fuzzy logic and the BFGS algorithm based on the Armijo-Goldstein criterion with the Deep Q Neural Network (DQN). Traditional techniques lag in coordinating with complex and robust systems. The combination provides a robust framework that addresses the difficulties of coordinating multiple agents in pursuit of game scenarios. Pursuing-evasion games aim to catch moving objects in constantly changing surroundings, which presents many difficulties for autonomous systems. This study is based on the bio-inspired differential pursuit of the Dog and Sheep game. In this game environment, the proposed HYDREIL-based DDPG is used to overcome the challenges of the traditional DRL models. At the same time, IDQN is used for real-time decision-making and to improve adaptive learning ability. Through both simulated tests and real-world experiments, the study shows the efficacy of HYDREIL. The ability of the HYDREIL is evaluated according to the learning ability based on average escape rates under challenging scenarios of the game. HYDREIL shows significant improvement even in complex game scenarios and improves the escape rate compared to traditional baseline models. Overall, the proposed HYDREIL framework shows a notable development in multiagent systems and provides an effective solution to the problems associated with control and coordination in pursuit of effective detection scenarios.
mathematics, interdisciplinary applications
What problem does this paper attempt to address?