Chi Ho Leung,Ashish R. Hota,Philip E. Paré
Abstract:In this work, we first show that the problem of parameter identification is often ill-conditioned and lacks the persistence of excitation required for the convergence of online learning schemes. To tackle these challenges, we introduce the notion of optimal and greedy excitation sets which contain data points with sufficient richness to aid in the identification task. We then present the greedy excitation set-based recursive least squares algorithm to alleviate the problem of the lack of persistent excitation, and prove that the iterates generated by the proposed algorithm minimize an auxiliary weighted least squares cost function. When data points are generated from time-varying parameters, online estimators tend to underfit the true parameter trajectory, and their predictability deteriorates. To tackle this problem, we propose a memory resetting scheme leveraging change point detection techniques. Finally, we illustrate the performance of the proposed algorithms via several numerical case studies to learn the (time-varying) parameters of networked epidemic dynamics, and compare it with results obtained using conventional approaches.
What problem does this paper attempt to address?
This paper attempts to solve two main problems in online system identification:
1. **Lack of Persistent Excitation (PE)**: In online parameter estimation, the input signal usually needs to satisfy the persistent excitation condition to ensure the convergence and accuracy of parameter estimation. However, in practical applications, the input signal often fails to continuously provide sufficient information richness, resulting in a decline in the performance of parameter estimation. By introducing the concepts of "Optimal Excitation Set" and "Greedy Excitation Set", as well as the Recursive Least Squares algorithm (RLS) based on these concepts, the paper addresses this problem. Specifically, the paper proposes a Greedily - weighted Recursive Least Squares algorithm (GRLS), which selects data points with sufficient information richness to compensate for the lack of persistent excitation.
2. **Time - Varying Parameters**: In many practical systems, system parameters change over time, which makes online parameter estimation more difficult. Traditional online estimation methods often underestimate the true parameter trajectory when dealing with time - varying parameters, leading to a decline in prediction ability. The paper combines the Exponentially Weighted Average Model and the Likelihood Ratio Test to detect the abrupt change points of system parameters and proposes a memory reset scheme to avoid using obsolete data points for parameter estimation, thereby improving the tracking ability of time - varying parameters.
### Main Contributions
- **Greedily - weighted Recursive Least Squares algorithm (GRLS)**: By introducing the greedy excitation set, this algorithm can dynamically select data points with sufficient information richness when data points arrive, thus overcoming the problem of lack of persistent excitation. The paper proves that the iterative values generated by this algorithm can minimize an auxiliary weighted least - squares cost function.
- **Detection of Time - Varying Parameters and Memory Reset**: The paper proposes a method that combines the Exponentially Weighted Average Model and the Likelihood Ratio Test to detect the abrupt change points of system parameters and resets the estimator's memory when a change point is detected to avoid using obsolete data points, thereby improving the tracking ability of time - varying parameters.
### Application Examples
Through numerical case studies, the paper demonstrates the performance of the proposed algorithm in learning the time - varying parameters of network epidemic dynamics (such as SIS and SIR models) and compares it with traditional methods to verify the effectiveness of the algorithm.
### Mathematical Formulas
- **Prediction Residual**:
\[
e_k=\psi_k - \phi_k\hat{\theta}_{k - 1}
\]
where \(\psi_k\) is the target vector, \(\phi_k\) is the feature vector, and \(\hat{\theta}_{k - 1}\) is the parameter estimate of the previous step.
- **Weighted Least - Squares Cost Function**:
\[
C_k=\sum_{i = 0}^k w_{i,k}\|r_i(\hat{\theta}_k)\|^2+\alpha^{k + 1}\|\hat{\theta}_k-\theta_0\|^2_{P^{-1}_0}
\]
where \(w_{i,k}\) is the weight function, \(\alpha\) is the forgetting factor, and \(P_0\) is the initial covariance matrix.
- **Closed - form Expression of the Optimal Solution**:
\[
\hat{\theta}_k=(\Phi_k^\top W_k\Phi_k + R_k)^{-1}(\Phi_k^\top W_k\Psi_k + R_k\theta_0)
\]
where \(\Phi_k\) is the feature matrix, \(W_k\) is the weight matrix, and \(\Psi_k\) is the target vector moment.