A novel data-driven model-free synchronization protocol for discrete-time multi-agent systems via TD3 based algorithm

Zhongxin Liu,Ye Li,Ge Lan,Zengqiang Chen
DOI: https://doi.org/10.1016/j.knosys.2024.111430
IF: 8.139
2024-01-25
Knowledge-Based Systems
Abstract:System modeling is a complex and time-consuming task in engineering, and traditional model-based or observer-based methods are unable to deal situations when the system models are unknown or affected by elements such as temperature. As a result, it is critical to build model-free methods capable of iterative learning and real-time updating. In this paper, a data-driven, model-free TD3-based algorithm is proposed. The neural network is used to address the issue of dimensional explosion in the state and action space. Besides, each agent can set a variable number of neighbors via virtual neighbor technology, giving the connection topology more flexibility. What's more, the proposed controller is only constructed based on the consensus error, which can quickly realize synchronization while consuming the least amount of energy. Finally, proofs and some simulation examples are given to verify the efficiency of our algorithm.
computer science, artificial intelligence
What problem does this paper attempt to address?