Stability Margin of Data-Driven LQR and Its Application to Consensus Problem

Abdul Aris Umar,Kunhee Ryu,Juhoon Back,Jung-Su Kim
DOI: https://doi.org/10.3390/math12020199
IF: 2.4
2024-01-09
Mathematics
Abstract:In contrast with traditional control input design techniques based on mathematical models of the system, in data-driven control approaches, which have recently gained substantial attention, the controller is derived directly from the data that are collected from experiments or observations of the target system. In particular, several data-driven optimal control and model predictive control (MPC) techniques have been proposed. In this paper, it is shown that the recently proposed data-driven LQR (Linear Quadratic Regulator) has a stability margin that is the set of the uncertainties in the control input channels maintaining the closed-loop stability. As an application of the proposed stability margin of the data-driven LQR, the consensus problem is considered. Since the control design for the consensus of multi-agent systems can be reformulated into the robust stabilization of a linear system with uncertainty in the input channel, it is demonstrated that the derived stability margin can be used to design a controller for the consensus of multi-agent systems.
mathematics
What problem does this paper attempt to address?
The problem that this paper attempts to solve is the stability guarantee problem of data - driven linear quadratic regulator (DDLQR) in the presence of uncertainties in the control input channel, and applies it to the consensus problem of multi - agent systems. Specifically: 1. **Stability Margin Problem**: The paper first explores whether data - driven LQR (DDLQR) can provide stability margins like the traditional model - based discrete - time LQR (DLQR). The stability margin refers to the range in which the system can still maintain closed - loop stability when there are uncertainties in the control input channel. Through Lyapunov stability theory and the explicit solution of the Riccati equation, the paper derives the stability margin (or disk margin) of DDLQR, and proves that when the system is asymptotically null - controllable with bounded controls (ANCBC), the stability margin of DDLQR is the same as that of DLQR and continuous - time LQR (CLQR). 2. **Application to the Consensus Problem**: The paper further applies the derived DDLQR stability margin to the consensus problem of multi - agent systems (MAS). The consensus problem is to design a controller such that the states of multiple agents tend to be the same over a long period of time. Since the consensus problem can be transformed into a robust stabilization problem of a linear system with input channel uncertainties, the paper shows how to use the DDLQR stability margin to design a consensus controller. Specific steps include estimating the second - smallest eigenvalue of the graph Laplacian matrix, collecting data, selecting appropriate parameters, and calculating the control gain. Through the above research, the paper not only verifies the effectiveness of DDLQR in dealing with input channel uncertainties, but also provides a new method to solve the consensus problem of multi - agent systems, thereby providing theoretical support for robust control design in practical applications.