Learning linear modules in a dynamic network using regularized kernel-based methods

Karthik R. Ramaswamy,Giulio Bottegal,Paul M.J. Van den Hof
DOI: https://doi.org/10.48550/arXiv.2005.06266
2021-01-26
Abstract:In order to identify one system (module) in an interconnected dynamic network, one typically has to solve a Multi-Input-Single-Output (MISO) identification problem that requires identification of all modules in the MISO setup. For application of a parametric identification method this would require estimating a large number of parameters, as well as an appropriate model order selection step for a possibly large scale MISO problem, thereby increasing the computational complexity of the identification algorithm to levels that are beyond feasibility. An alternative identification approach is presented employing regularized kernel-based methods. Keeping a parametric model for the module of interest, we model the impulse response of the remaining modules in the MISO structure as zero mean Gaussian processes (GP) with a covariance matrix (kernel) given by the first-order stable spline kernel, accounting for the noise model affecting the output of the target module and also for possible instability of systems in the MISO setup. Using an Empirical Bayes (EB) approach the target module parameters are estimated through an Expectation-Maximization (EM) algorithm with a substantially reduced computational complexity, while avoiding extensive model structure selection. Numerical simulations illustrate the potentials of the introduced method in comparison with the state-of-the-art techniques for local module identification.
Systems and Control
What problem does this paper attempt to address?
This paper aims to solve the problem of local module identification in dynamic networks. Specifically, the paper focuses on how to effectively identify specific modules (systems) given the known network topology without performing full - network identification on the entire network. Traditional direct methods, when dealing with multi - input single - output (MISO) structures, need to estimate a large number of parameters and select an appropriate model order, which increases the computational complexity of the algorithm and makes it infeasible. Moreover, if some modules in the MISO structure are unstable, the existing prediction error identification methods cannot be used either, because these methods assume that the predictor is stable. To overcome these problems, the paper proposes a new method based on the regularized kernel method. The main contributions of this method include: 1. **Identifying local modules through direct methods**: Utilize the information of external excitation signals and perturbation signals to enhance the usefulness of data. 2. **Avoiding model order selection for large - scale problems**: Reduce the number of parameters, especially those that are not related to the main interests of the experimenter. 3. **Not depending on module stability**: This method can be used even if some modules in the MISO structure are unstable, without prior knowledge of which modules are unstable. The paper achieves the above goals by modeling the impulse responses of the remaining modules as zero - mean Gaussian processes (GP) and using a first - order stable spline kernel to encode the stability and smoothness of the process. In addition, the paper also introduces the empirical Bayes method to perform parameter estimation by maximizing the marginal likelihood of data and uses the expectation - maximization (EM) algorithm to iteratively solve the nonlinear optimization problem. In conclusion, this paper proposes a new method that can effectively identify local modules in dynamic networks, while reducing computational complexity and being able to handle the situation of unstable modules.