Distributed Least Squares Algorithm for Continuous-time Stochastic Systems Under Cooperative Excitation Condition

Xinghua Zhu,Zhixin Liu
2023-09-06
Abstract:In this paper, we study the distributed adaptive estimation problem of continuous-time stochastic dynamic systems over sensor networks where each agent can only communicate with its local neighbors. A distributed least squares (LS) algorithm based on diffusion strategy is proposed such that the sensors can cooperatively estimate the unknown time-invariant parameter vector from continuous-time noisy signals. By using the martingal estimation theory and Ito formula, we provide upper bounds for the estimation error of the proposed distributed LS algorithm, and further obtain the convergence results under a cooperative excitation condition. Compared with the existing results, our results are established without using the boundedness or persistent excitation (PE) conditions of regression signals. We provide simulation examples to show that multiple sensors can cooperatively accomplish the estimation task even if any individual can not.
Systems and Control,Optimization and Control
What problem does this paper attempt to address?
The paper is primarily dedicated to addressing the problem of distributed adaptive estimation in continuous-time stochastic systems within sensor networks. Specifically, the research aims to design a Distributed Least Squares (DLS) algorithm, enabling each sensor in the network to collaboratively estimate an unknown time-invariant parameter vector solely through information exchange with neighboring sensors. The main contributions of the paper can be summarized as follows: 1. **Proposed a DLS algorithm based on diffusion strategy**: The algorithm is divided into two steps—Adaptation and Diffusion. In the adaptation phase, each sensor updates its local parameter estimates based on the continuous-time signals it receives; in the diffusion phase, sensors exchange local estimation results and the inverse of their information matrices to collaboratively improve estimation accuracy. 2. **Introduced a cooperative excitation condition**: This is a weaker condition used to ensure the convergence of the algorithm, applicable even when the regression signals do not satisfy traditional assumptions of independence, stationarity, or ergodicity. This condition allows sensors to work cooperatively within the network, enabling the entire network to achieve the parameter estimation goal even if individual sensors cannot complete the task independently. 3. **Theoretical analysis**: Utilizing tools such as martingale estimation theory and Ito's lemma, the paper derives an upper bound for the estimation error of the algorithm under specific cooperative excitation conditions and further proves the convergence of the algorithm. Notably, this analysis does not require the regression signals to satisfy boundedness or persistent excitation conditions. 4. **Numerical simulations**: The effectiveness of the proposed algorithm is validated through numerical simulations, particularly highlighting the advantages of multi-sensor cooperation. Even when a single sensor cannot complete the task independently, the entire network can still achieve the estimation goal through cooperation. In summary, the paper provides an effective solution to the problem of distributed parameter estimation in continuous-time stochastic systems by proposing a new distributed least squares algorithm and cooperative excitation conditions.