Iterative Identification of Hammerstein Systems

Yun Liu,Er-Wei Bai

DOI: https://doi.org/10.1016/j.automatica.2006.09.004

IF: 6.4

2007-01-01

Automatica

Abstract:Convergences of iterative algorithms have been established for identification of Hammerstein systems in the case that the unknown nonlinearities are odd. Then, the results are further extended to nonsmooth nonlinearities.

What problem does this paper attempt to address?

Identification of Hammerstein Models for Control

YC Zhu

DOI: https://doi.org/10.1080/00207170050201771

IF: 2.102

2000-01-01

International Journal of Control

Abstract:Identification of single-input single-output Hammerstein models is studied in this work. The basic idea here is to extend the recently developed asymptotic method (ASYM) of linear model identification to include input non-linearity in the model set. First identification test design will be discussed. In parameter estimation, prediction error criterion is used in order to maintain consistence when the process is operating in closed-loop. A relaxation iteration scheme is proposed by making use of a model structure in which the error is bilinear in the parameters. The order of the linear part and nonlinear part are determined by looking at an output error related criterion which is control-relevant. The frequency domain upper error bound of the linear part will be derived and used for model validation. Simulation study will be used to illustrate the method and comparisons with other methods are also given.
On the convergence of iterative identification of Hammerstein systems

Guangshe Zhao,Guoqi Li,Changyun Wen,Feng Yang

DOI: https://doi.org/10.1007/978-3-642-25553-3_38

2011-01-01

Abstract:An iterative identification algorithm of Hammerstein systems needs a proper initial condition to guarantee its convergence. In this paper, we propose a new algorithm by fixing the norm of the parameter estimates. The normalized algorithm ensures the convergence property under arbitrary nonzero initial conditions. The proofs of the property give a geometrical explanation on why the normalization guarantees the convergence. An additional contribution is that the static function in the Hammerstein system is extended to non-odd functions. © 2011 Springer-Verlag.
Identification of Harnrnerst Ein Models for Control

Yucai Zhu

1998-01-01

Abstract:Identification of single-input single-output Hammerstein models is studied. First we define identification for control that has four problems. In parameter estimation, prediction error criterion is used in order to maintain consistence when the process is operating in closed-loop. A relaxation iteration sheme is proposed by making use of a model structure in which the error is bilinear in the parameters. The order of the linear part and nonlinear part are determined by looking at an output error related criterion which is controlrelevant.
A Novel APSO-aided Maximum Likelihood Identification Method for Hammerstein Systems

Jianliang Sun,Xinggao Liu

DOI: https://doi.org/10.1007/s11071-013-0800-4

IF: 5.741

2013-01-01

Nonlinear Dynamics

Abstract:Identification of Hammerstein nonlinear models has received much attention due to its ability to describe a wide variety of nonlinear systems. In this paper the maximum likelihood estimator which was originally derived for linear systems is extended to work for Hammerstein nonlinear systems in colored-noise environment. The maximum likelihood estimate is known to be statistically efficient, but can lead to complex nonlinear multidimensional optimization problem; traditional methods solve this problem at the computational cost of evaluating second derivatives. To overcome these shortcomings, a particle swarm optimization (PSO) aided maximum likelihood identification algorithm (Maximum Likelihood-Particle Swarm Optimization, ML-PSO) is first proposed to integrate PSO's simplicity in implementation and computation, and its ability to quickly converge to a reasonably good solution. Furthermore, a novel adaptive strategy using the evolution state estimation technique is proposed to improve PSO's performance (maximum likelihood-adaptive particle swarm optimization, ML-APSO). A simulation example shows that ML-APSO method outperforms ML-PSO and traditional recursive least square method in various noise conditions, and thus proves the effectiveness of the proposed identification scheme.
Gradient-based and Least-Squares-based Iterative Algorithms for Hammerstein Systems Using the Hierarchical Identification Principle

Feng Ding,Xinggao Liu,Jian Chu

DOI: https://doi.org/10.1049/iet-cta.2012.0313

2013-01-01

Abstract:This study derives a least-squares-based iterative algorithm and a gradient-based iterative algorithm for Hammerstein systems using the decomposition-based hierarchical identification principle. The simulation results confirm that the proposed two algorithms can give satisfactory identification accuracies and the least-squares-based iterative algorithm has faster convergence rates than the gradient-based iterative algorithm.
A Novel APSO-aided Weighted LSSVM Method for Nonlinear Hammerstein System Identification

Liang Ma,Xinggao Liu

DOI: https://doi.org/10.1016/j.jfranklin.2016.12.022

IF: 4.246

2016-01-01

Journal of the Franklin Institute

Abstract:Identification of Hammerstein nonlinear models has received much attention due to its ability to describe a wide variety of nonlinear systems. A novel identification approach based on intelligent optimal weighted least squares SVM (WLSSVM) is proposed for Hammerstein system, where a new adaptive particle swarm optimization algorithm (APSO) using the evolutionary state estimation technique and mutation operator is applied. The proposed method not only has fast convergence to the global optimal solution but also has good identification results. The comparison researches are carried out among the proposed method, WLSSVM, LSSVM and RIV methods in detail. The research results show the effectiveness of proposed APSO-WLSSVM method.
Identification for Hammerstein Nonlinear Systems Based on Universal Spline Fractional Order LMS Algorithm

Songsong Cheng,Yiheng Wei,Dian Sheng,Yong Wang

DOI: https://doi.org/10.1016/j.cnsns.2019.104901

2019-01-01

Abstract:In this paper, we investigate the identification problem of the Hammerstein nonlinear systems. In order to approximate the nonlinear block and for the convenience of analyzing the convergence of the proposed algorithm, we modify the conventional spline interpolation such that the nonlinear output signal can be expressed in a universal form. Besides, we develop a fractional order LMS (Least-Mean-Square) algorithm to identify the linear block and control points of the nonlinear block and establish the convergence properties of the algorithm by employing the stability theory of fractional order difference systems. Finally, we also provide two numerical examples to illustrate the effectiveness of the proposed algorithm. (C) 2019 Elsevier B.V. All rights reserved.
Adaptive algorithm for recursive identification of Hammerstein systems

陈坤,刘毅,王海清,宋执环,李平

DOI: https://doi.org/10.3785/j.issn.1008-973X.2010.01.018

2010-01-01

Abstract:A new on-line adaptive sparse, recursive identification algorithm of Hammerstein models based on output predictive error was proposed to solve the problems of the least squares support vector regression methods, such as lacking of sparsity and difficult to get a recursive form. The proposed method changes the recursive form, and adaptively chooses the strategy of sparseness/recursion/re-initialization according to the output predictive error. The error accumulation or even divergence problems are avoided and therefore the sparseness and accuracy are improved. The simulation illustrated that compared with the general recursive method, the proposed adaptive algorithm has sparse formulation and simplifies the model while keeping the identification accuracy. Also, the approach is robust and efficient, and it can meet the requirement of online identification.
Online identification of Hammerstein systems with B‐spline networks

Yanjiao Wang,Yiting Liu,Jiehao Chen,Shihua Tang,Muqing Deng

DOI: https://doi.org/10.1002/acs.3792

IF: 3.369

2024-03-27

International Journal of Adaptive Control and Signal Processing

Abstract:Summary Nonlinear systems widely exist in real‐word applications and the research for these systems has enjoyed a long and fruitful history, including the system identification community. However, the modeling for nonlinear systems is often quite challenging and still remains many unresolved questions. This article considers the online identification issue of Hammerstein systems, whose nonlinear static function is modeled by a B‐spline network. First, the identification model of the studied system is constructed using the bilinear parameter decomposition model. Second, the online recursive algorithms are proposed to find the estimates using the moving data window and the particle swarm optimization procedure, and show that these estimates converge to their true values with a low computational burden. Numerical examples are also given to test the effectiveness of the proposed algorithms.

automation & control systems,engineering, electrical & electronic
A nonlinear recursive instrumental variables identification method of Hammerstein ARMAX system

Liang Ma,Xinggao Liu

DOI: https://doi.org/10.1007/s11071-014-1763-9

IF: 5.741

2014-01-01

Nonlinear Dynamics

Abstract:Identification of nonlinear Hammerstein models has received much attention due to its ability to describe a wide variety of nonlinear systems. This paper considers the problem of the parameter estimation of the ARMAX models for the Hammerstein systems. A novel nonlinear recursive instrumental variables method, which is simple and easy for practical applications, is proposed to deal with the problem. In order to make the instrumental variables uncorrelated with the colored noise and to obtain better identification effect, three approaches for choosing the instrumental variables usually used in the linear RIV method are introduced. Furthermore, the procedure of the nonlinear RIV method and its property of the mean square convergence of the nonlinear RIV method are rigorously derived. Finally, an example is carried out as illustration, where the ARMAX-RLS method is compared as the basis, and the results show that the nonlinear RIV method is superior to ARMAX-RLS method in terms of identification accuracy and convergence speed under colored noise, which reveals the effectiveness of the proposed method.
Hierarchical Maximum Likelihood Iterative Identification Algorithm for Hammerstein Box-Jenkins Systems

Junhong Li,Juping Gu,Yi Yang,Xinsong Zhang

DOI: https://doi.org/10.1109/control.2016.7737582

2016-01-01

Abstract:This paper considers the identification problems of Hammerstein Box-Jenkins systems based on the hierarchical identification and maximum likelihood principle. After decomposing the Hammersetin Box-Jenkins systems into two subsystems, a maximum likelihood least squares based iterative algorithm is derived to interactively estimate the parameters of the two subsystems. The simulation results show that the proposed algorithm can effectively estimate the parameters of Hammerstein Box-Jenkins systems.
Online identification of non-homogeneous fractional order Hammerstein continuous systems based on the principle of multi-innovation

Chunlei Liu,Hongwei Wang,Qian Zhang,Xiaojing Ma

DOI: https://doi.org/10.1007/s11071-023-08876-y

IF: 5.741

2023-09-14

Nonlinear Dynamics

Abstract:In the process of online identification of non-homogeneous fractional order Hammerstein systems in continuous time, traditional identification algorithms have slow convergence speed and low precision, and it is difficult to simultaneously identify multiple non-homogeneous fractional orders and system parameters. This paper proposes an identification method based on the principle of multi-innovation identification. Firstly, the Hammerstein non-homogeneous fractional order continuous-time system is given, and the parameters to be identified are clarified. Secondly, based on the Riemann–Liouville differential operator, the partial derivative equation of the objective function to non-homogeneous fractional orders in the identification process is given, which ensures that the coefficients of the system and non-homogeneous fractional orders can be identified at the same time. Then, within the given value range of the fractional vector, the partial derivative equation is progressively simplified to make it convenient for online calculation. And the principle of multi-innovation is introduced into the traditional Levenberg–Marquardt algorithm, which improves the convergence speed and convergence precision of the algorithm. Finally, we illustrate the validity of the theory through two experiments, including a numerical simulation example of a fractional-order system and a numerical example of a flexible manipulator system. Experiments prove that the algorithm proposed in this paper has good performance in both simulation examples and actual systems.

engineering, mechanical,mechanics
Recursive Maximum Likelihood Method for the Identification of Hammerstein ARMAX System

Liang Ma,Xinggao Liu

DOI: https://doi.org/10.1016/j.apm.2016.01.062

IF: 5.336

2016-01-01

Applied Mathematical Modelling

Abstract:Identification of Hammerstein nonlinear models has received much attention due to its ability to describe a wide variety of nonlinear systems. This paper considers the parameter estimation problem of ARMAX models for the Hammerstein systems. The recursive maximum likelihood method, which can be applied to online identification and occupies small memory capacity, is proposed to deal with the problem in here. It is an approximation of the maximum likelihood method. The parameters of the linear and nonlinear parts of the Hammerstein model and the noise model can be directly obtained without using the overparameterization technique. Finally, the proposed method is applied to a classic Hammerstein ARMAX system and is compared with RLS method in detail. The research results show the effectiveness of the proposed method. (C) 2016 Elsevier Inc. All rights reserved.
A Recursive Method of Identification of Hammerstein Model Based on Least Squares Support Vector Machines

Kun Chen,Haiqing Wang,Zhihuan Song

DOI: https://doi.org/10.3182/20080706-5-kr-1001.00839

2008-01-01

IFAC Proceedings Volumes

Abstract:In the domain of industrial process modeling and control, Hammerstein model has been used widely to describe a class of nonlinear systems. Goethals et al. (2005) proposed a method based on Least Squares Support Vector Machines (LSSVM) to identify the input-output relationship of the Hammerstein model. Unfortunately, as the data points grow, this kernel learning approach costs much time correspondingly. Besides, Goethals's technique is not suitable for the on-line identification. To this end, a recursive nonlinear identification method is proposed in this paper. The basic idea is to get the recursive form of the parts of the high-dimensional matrix arisen from the optimization derivation, and get the estimation with the trick of sub-inverse matrix. With this new LSSVM approach, the Hammerstein model can be obtained recursively and much quickly, which is crucial to industrial applications that require online estimation and prediction. The simulation illustrates the validity and feasibility of the developed online identification method.
Identification of Hammerstein Model Based on Spline Approximation and Wavelet Decomposition

Jun ZHENG,Wen-jun YAN,Jing ZHU

DOI: https://doi.org/10.3969/j.issn.1004-731X.2005.05.012

2005-01-01

Abstract:A method is presented to approximate the nonlinear gain of Hammerstein model using the cubic B-spline instead of the traditional polynomial approximation. Compared with the polynomial approximation, not only the method is simple and feasible, but also the accuracy of approximation is improved evidently. To improve identification accuracy, we decompose input and output data by applying the wavelet multiresolution analysis because noises are restrained in low-frequency band. The theory analysis and simulation results show that the estimation is asymptotically unbiased and has strong consistency, and that the new method is very efficient and practical.
Identification of Hammerstein Systems with Random Fourier Features and Kernel Risk Sensitive Loss

Yunfei Zheng,Shiyuan Wang,Badong Chen

DOI: https://doi.org/10.1007/s11063-023-11191-7

IF: 2.565

2023-01-01

Neural Processing Letters

Abstract:Identification of Hammerstein systems with polynomial features and mean square error loss has received a lot of attention due to their simplicity in calculation and solid theoretical foundation. However, when the prior information of nonlinear subblock of a Hammerstein system is unknown or some outliers are involved, the performance of related methods may degenerate seriously. The main reason is that the used polynomial just has finite approximation capability to an unknown nonlinear function, and mean square error loss is sensitive to outliers. In this paper, a new identification method based on random Fourier features and kernel risk sensitive loss is therefore proposed. Since the linear combination of random Fourier features can well approximate any continuous nonlinear function, it is expected to be more powerful to characterize the nonlinear behavior of Hammerstein systems. Moreover, since the kernel risk sensitive loss is a similarity measure that is insensitive to outliers, it is expected to have excellent robustness. Based on the mean square convergence analysis, a sufficient condition to ensure the convergence and some theoretical values regarding the steady-state excess mean square error of the proposed method are also provided. Simulation results on the tasks of Hammerstein system identification and electroencephalogram noise removal show that the new method can outperform other popular and competitive methods in terms of accuracy and robustness.
New Identification Method of Nonlinear Systems Based on Hammerstein Models

XIANG Wei,CHEN Zong-hai

DOI: https://doi.org/10.3969/j.issn.1000-8152.2007.01.027

2007-01-01

Abstract:Hammerstein models are commonly used to present the pH process or the processes with characteristics such as exponent, dead-zone and switch. A new method for identification Hammerstein models is presented in this paper. Firstly, the nonlinear static part and the linear dynamic part are expressed by nonlinear basis functions and the Laguerre functions, respectively. The parameters of these two parts are then identified by least squares estimation, singular value decomposition and matrix dimension expansion. The convergence of the output error is also proved when white noises exist in the output signal. The proposed approach is based on weak assumptions on persistency of the excitation, so it is suitable for many applications. The operation is easy and the result is accurate. Finally, a simulation on a pH process is given to validate the conclusions.
Frequency Domain Identification of Continuous-Time Hammerstein Systems With Adaptive Continuous-Time Rational Orthonormal Basis Functions

Wen Mi,Liming Zhang,Wei Xing Zheng,Sheng Zhang

DOI: https://doi.org/10.1109/tac.2023.3254366

IF: 6.549

2023-01-01

IEEE Transactions on Automatic Control

Abstract:In this paper, we propose a new identification method for continuous-time Hammerstein systems. This method is based on the adaptive generalized rational orthonormal basis functions. In particular, we use the strategy in which poles of basis functions are selected one by one in terms of a criterion. By doing this, we not only take advantage of the variability of the generalized orthogonal basis functions, but also reduce the computational burden. The proposed algorithm is adaptive. Meanwhile, convergence analysis is performed with considering the sampling frequency, noise level, sampling length, and terms of basis functions. The obtained results guarantee the convergence of the whole Hammerstein system. Finally, a numerical example is presented to illustrate the usefulness of the proposed identification algorithm.

automation & control systems,engineering, electrical & electronic
Hybrid identification method for fractional-order nonlinear systems based on the multi-innovation principle

Zhang Qian,Wang Hongwei,Liu Chunlei

DOI: https://doi.org/10.1007/s10489-022-04309-2

IF: 5.3

2022-11-25

Applied Intelligence

Abstract:Aiming at the identification problems arising for fractional-order Hammerstein-Wiener system parameter coupling, namely, the difficulty of estimating the fractional order, low algorithm accuracy and slow convergence, an alternate identification method based on the principle of multiple innovations is proposed. First, a discrete model of a fractional-order Hammerstein-Wiener system is constructed. Second, an information matrix composed of fractional-order variables is used as the system input, combined with the multi-innovation principle, and the multi-innovation recursive gradient descent algorithm and the multi-innovation Levenberg-Marquardt algorithm are used to alternately estimate the parameters and fractional order of the model. The algorithms are executed cyclically and alternately presuppose each other. Finally, the convergence of the overall algorithm is theoretically analyzed, and the fractional-order Hammerstein-Wiener nonlinear system model is used to carry out numerical simulation experiments to verify the effectiveness of the algorithm. Moreover, we apply the proposed algorithm to an actual flexible manipulator system and perform fractional-order modeling and identification with high accuracy. Compared with the methods proposed by other scholars, the method proposed in this paper is more effective.

computer science, artificial intelligence
Robust extended recursive least squares identification algorithm for Hammerstein systems with dynamic disturbances

Shijian Dong,Li Yu,Wen-An Zhang,Bo Chen

DOI: https://doi.org/10.1016/j.dsp.2020.102716

IF: 2.92

2020-01-01

Digital Signal Processing

Abstract:This paper derives an identification algorithm for Hammerstein nonlinear systems with dynamic disturbances and measurement noise. The dynamic disturbance is viewed as a time-varying sequence to be estimated and its model structure and excitation signal are not considered. By extending the parameter and information vector, an extended recursive least squares algorithm is proposed first time to identify recursively both the system parameters and dynamic disturbance of a Hammerstein output error model. By constructing matrix forgetting factor, the dot product operation is used to update covariance matrix, which improves the estimation accuracy of time-invariant system parameters and the tracking performance of dynamic disturbance. The auxiliary model technique ensures that consistent estimation of model parameters can be obtained. The adaptive forgetting factor improves the convergence rate of the algorithm under finite sampling data. Numerical example with Monte-Carlo simulation test is used to verify the superiority of the proposed algorithm. (C) 2020 Elsevier Inc. All rights reserved.

Iterative Identification of Hammerstein Systems

Identification of Hammerstein Models for Control

On the convergence of iterative identification of Hammerstein systems

Identification of Harnrnerst Ein Models for Control

A Novel APSO-aided Maximum Likelihood Identification Method for Hammerstein Systems

Gradient-based and Least-Squares-based Iterative Algorithms for Hammerstein Systems Using the Hierarchical Identification Principle

A Novel APSO-aided Weighted LSSVM Method for Nonlinear Hammerstein System Identification

Identification for Hammerstein Nonlinear Systems Based on Universal Spline Fractional Order LMS Algorithm

Adaptive algorithm for recursive identification of Hammerstein systems

Online identification of Hammerstein systems with B‐spline networks

A nonlinear recursive instrumental variables identification method of Hammerstein ARMAX system

Hierarchical Maximum Likelihood Iterative Identification Algorithm for Hammerstein Box-Jenkins Systems

Online identification of non-homogeneous fractional order Hammerstein continuous systems based on the principle of multi-innovation

Recursive Maximum Likelihood Method for the Identification of Hammerstein ARMAX System

A Recursive Method of Identification of Hammerstein Model Based on Least Squares Support Vector Machines

Identification of Hammerstein Model Based on Spline Approximation and Wavelet Decomposition

Identification of Hammerstein Systems with Random Fourier Features and Kernel Risk Sensitive Loss

New Identification Method of Nonlinear Systems Based on Hammerstein Models

Frequency Domain Identification of Continuous-Time Hammerstein Systems With Adaptive Continuous-Time Rational Orthonormal Basis Functions

Hybrid identification method for fractional-order nonlinear systems based on the multi-innovation principle

Robust extended recursive least squares identification algorithm for Hammerstein systems with dynamic disturbances