Safe adaptive control for multi-agent systems under uncertain dynamic environments: a robust barrier-certified learning approach

Dey, Shawon,Xu, Hao
DOI: https://doi.org/10.1007/s00521-024-10639-8
2024-12-10
Neural Computing and Applications
Abstract:In this study, a decentralized safe learning-based adaptive control is developed for multi-agent systems (MAS) operating in uncertain environments. Ensuring the safety of MAS in uncertain environments becomes a challenging task, particularly when the dynamics of the individual agent are unknown and their accurate state information is unavailable to the local agent. Due to the fact that the safe set of the local agent depends on the other agents' states, the uncertainty of these external systems leads to an uncertain safety set. As a consequence, the safe control design of the local agent system in a multi-agent setting under environmental uncertainties becomes intractable. To address this challenge and ensure the safety of the local agent, a neural network (NN)-based adaptive observer is designed to estimate the state of the unknown external agents in the multi-agent environment. Based on the state estimation of external agents, an adaptive interplay control barrier function (AI-CBF) is formulated. The AI-CBF is designed by considering both the local agent's state and the estimated states of external agents. Notably, the limitation of forward invariance for the approximated safe set without guaranteeing the same for the actual safe set is acknowledged in AI-CBF design. The AI-CBF incorporates the bounds on state estimation errors of external agents to guarantee the strict safety requirements of the local agent. Based on the safety constraint enforced by the AI-CBF, a control framework is formulated using a quadratic programming (QP) method that integrates the safety and stability of the system. In addition, a stability analysis based on Lyapunov theory is performed to demonstrate the convergence of the neural network-based adaptive observer as well as the closed-loop stability of the overall system. Eventually, experimental validation and comparison study confirm the effectiveness of the developed approach that can ensure multi-agent system safety under challenging conditions in a decentralized manner.
computer science, artificial intelligence
What problem does this paper attempt to address?