Approaches in Using Expectation Maximization Algorithm for Maximum Likelihood Estimation of the Parameters of a Constrained State Space Model with an External Input Series

Chengliang Huang,Xiao-Ping Zhang,Fang Wang
DOI: https://doi.org/10.5121/csit.2016.60506
2016-01-01
Abstract:EM algorithm is popular in maximum likelihood estimation of parameters for state-space models.However, extant approaches for the realization of EM algorithm are still not able to fulfill the task of identification systems, which have external inputs and constrained parameters.In this paper, we propose new approaches for both initial guessing and MLE of the parameters of a constrained state-space model with an external input.Using weighted least square for the initial guess and the partial differentiation of the joint log-likelihood function for the EM algorithm, we estimate the parameters and compare the estimated values with the "actual" values, which are set to generate simulation data.Moreover, asymptotic variances of the estimated parameters are calculated when the sample size is large, while statistics of the estimated parameters are obtained through bootstrapping when the sample size issmall.The results demonstrate that the estimated values are close to the "actual" values.Consequently, our approaches are promising and can applied in future research.
What problem does this paper attempt to address?