Abstract:This work investigates the adaptive output consensus problem for uncertain discrete-time linear multi-agent systems on directed graphs when both Laplacian matrices for communication graphs and agent system matrices are not available. Firstly, a fully distributed algorithm is proposed to estimate the Laplacian matrix for each agent. Then, based on the proposed estimation algorithm, two fully distributed adaptive control algorithms, one for state feedback and the other for output feedback, are developed to acquire the desired controller parameters by utilizing the so-called adaptive dynamic programming techniques. It is shown that the output consensus is achieved for the resulting closed-loop multi-agent system. Simulation results demonstrate the efficacy of the proposed fully distributed adaptive controllers resulting from those adaptive control algorithms.
What problem does this paper attempt to address?
### Problems the paper attempts to solve
This paper aims to solve the adaptive output consensus problem of uncertain discrete - time linear multi - agent systems (DT - LTI MASs) on directed graphs. Specifically, the paper focuses on the following challenges:
1. **Lack of global knowledge**: The Laplacian matrix of the communication graph and the matrices of each agent system are not available. Traditional distributed controller design depends on this global knowledge, but this knowledge is often difficult to obtain in practical applications.
2. **Uncertainty**: There is uncertainty in the dynamic model of agents, that is, the exact mathematical model of agents is unknown.
3. **Large - scale networks**: In large - scale networks, each agent does not even know the total number of agents in the network, so it is impossible to obtain the Laplacian matrix in advance.
### Solutions
To solve the above problems, the paper proposes the following methods:
1. **Fully distributed Laplacian matrix estimation algorithm**: Through a fully distributed algorithm, each agent can estimate its corresponding Laplacian matrix online.
2. **Fully distributed adaptive control algorithm based on adaptive dynamic programming (ADP)**:
- **State feedback**: A fully distributed adaptive control algorithm for state feedback is developed, and the required controller parameters are obtained through adaptive dynamic programming techniques.
- **Output feedback**: A fully distributed adaptive control algorithm for output feedback is developed, and the required controller parameters are also obtained through adaptive dynamic programming techniques.
### Main contributions
- **Theoretical analysis**: It is proved that under the proposed control strategy, the output consensus of the closed - loop multi - agent system can be achieved.
- **Simulation verification**: The effectiveness of the proposed fully distributed adaptive controller is verified by simulation results.
### Formula representation
- **Laplacian matrix estimation**:
\[
Z_i(k + 1)=Z_i(k)-\frac{1}{|N_i|}M_i\left(|N_i|Z_i(k)-\sum_{j\in N_i}Z_j(k)\right)
\]
where \(Z_i(k)\) is the estimate of \(\hat{L}^{-1}\), and \(M_i\) is an orthogonal projection matrix.
- **Value iteration algorithm of adaptive dynamic programming**:
\[
P_{t + 1}=C^TQC+A^TP_tA-(1-\delta^2)A^TP_tB(B^T P_tB)^{-1}B^TP_tA
\]
- **Conditions for output consensus**:
\[
\max_i|1 - c\lambda_i(\bar{L})|\leq\delta<\delta_c(CTQC),\quad i = 2,3,\ldots,N
\]
### Conclusion
The paper proposes a fully distributed adaptive control method, which can achieve the output consensus of uncertain discrete - time linear multi - agent systems in the absence of global knowledge. This method is not only strictly proved theoretically, but also verified by simulation results.