Abstract:The primary requirement of filtering algorithms such as Particle Filter (PF), Unscented Kalman Filter (UKF) and Extended Kalman Filter (EKF) is the availability of an accurate nonlinear state space model. In the absence of good parameter values, one has to estimate both the hidden states and the unknown parameters in a joint framework using measurements available from the process. This problem of joint state and parameter estimation for nonlinear systems can be solved recursively through the combination of a nonlinear smoother and a maximum likelihood parameter estimation scheme. Expectation Maximization (EM) is an efficient optimization algorithm which can provide the maximum likelihood estimate of the model parameters even in the presence of missing data. The algorithm can generate parameter estimates that maximize the likelihood of all the data including those with missing output measurements. This paper presents an approach which combines the EM algorithm with a suitable nonlinear smoother, such as PF, UKF or EKF based smoother. An application of this method to a simulated Continuous Fermentor process with unknown model parameters is presented. A comparative study of the results, when the different smoothing schemes were used in this approach, is presented. The results show that the UKS based technique was able to generate unbiased parameter estimates. The Particle Smoother based parameter estimates converged in the neighbouhood of their true values, but the technique was found to be computationally intensive compared to the UKS and EKS based techniques.

Empirical Frequency-Domain Optimal Parameter Estimate for Black-Box Processes.

Least-squares Based Iterative Parameter Estimation for Two-Input Multirate Sampled-Data Systems

Recursive Algorithm for the Two-Stage EFOP Estimation Method

System identification: New developments of the asymptotic theory/method

Spectral Analysis in Linear Process Identification—a New Look at an Old Problem

Reducing Identification Error Using Over-Sampling Technique

Multivariable Process Identification Based on Frequency Domain Measures

A NEW IDENTIFICATION APPROACH FOR ARX MODELS

Identifiability Implies Robust, Globally Exponentially Convergent On-line Parameter Estimation: Application to Model Reference Adaptive Control

A Nearly-Black-Box Online Algorithm for Joint Parameter and State Estimation in Temporal Models.

A New Excitation Scheme for Closed-Loop Subspace Identification Using Additional Sampling Outputs and Its Extension to Instrumental Variable Method.

Linear parameter-varying systems identification with slowly sampled outputs subjected to unknown time-delays and outliers.

Towards black-box parameter estimation

Parameter Identification for Nonlinear State-Space Models of A Biological Network Via Linearization and Robust State Estimation

A unified identification algorithm of FIR systems based on binary observations with time-varying thresholds

Unexpected Results Of Extended Fractional Kalman Filter For Parameter Identification In Fractional Order Chaotic Systems

Parameter Estimation of Stochastic Fractional Dynamic Systems Using Nonlinear Bayesian Filtering System Identification Methods

Comparison of Expectation-Maximization based parameter estimation using Particle Filter, Unscented and Extended Kalman Filtering techniques

Robust Identification of Wiener Time-Delay System with Expectation-Maximization Algorithm.

Self-error learning framework-based algorithm for parameter recovery of extended Wiener-Hammerstein systems subject to quantised measurements

Random Fourier Features Extended Kernel Recursive Least P-Power Algorithm