Abstract:We present a hybrid global–local optimization algorithm for parameter estimation of radial basis function (RBF) networks and the RBF-type autoregressive models without exogenous inputs (RBF-AR) or with exogenous inputs (RBF-ARX). The RBF-AR (X) models are quasi-linear time-varying AR (X) models with Gaussian RBF network-style coefficients, which have been used to effectively model the nonlinear behavior of various complex systems. However, the identification of these models is a difficult optimization problem because of the large number of local minima. A hybrid approach is proposed in this paper to achieve better optimization results for these RBF-type models. The applied hybrid search strategy (EA-SNPOM) is developed by combining an evolutionary algorithm (EA) with a gradient-based algorithm known as the structured nonlinear parameter optimization method (SNPOM). This strategy makes use of the robustness of the EA to cover an entire global search space and the efficiency of the gradient search to converge to a local optimum. Several examples of time series modeling and system identification are presented. The simulation results indicate that the performance of the proposed hybrid approach is better than the performance obtained from using each method (EA or SNPOM) alone. Furthermore, the RBF-AR (X) models estimated by the EA-SNPOM achieve much better modeling accuracy relative to other neural networks or fuzzy models in the simulations.

Identification of an ARX-type Nonlinear Rational Model Based on the Renyi Error Entropy and the Epanechnikov Kernel

A Method of ARX Model Estimation of Errors-in-Variables Systems

Arx Model Estimation Of Multivariable Errors-In-Variables Systems

Cauchy kernel correntropy‐based robust multi‐innovation identification method for the nonlinear exponential autoregressive model in non‐Gaussian environment

A NEW IDENTIFICATION APPROACH FOR ARX MODELS

Accelerated Identification Algorithms for Rational Models Based on the Vector Transformation

Nonlinear Recursive Minimum Model Error Estimation

Latest Estimation Based Recursive Stochastic Gradient Identification Algorithms for Arx Models

Identifiability Implies Robust, Globally Exponentially Convergent On-line Parameter Estimation: Application to Model Reference Adaptive Control

An identification algorithm for polynomial NARX models based on simulation error minimization

Parameter identification based on adaptive density estimation

Multierror stochastic gradient algorithm for identification of a Hammerstein system with random noise and its application in the modeling of a continuous stirring tank reactor

An Iterative Algebraic Geometric Approach for Identification of Switched ARX Models with Noise

A Variable Projection Approach for Efficient Estimation of RBF-ARX Model.

Identification of Wiener Model with Internal Noise Using a Cubic Spline Approximation-Bayesian Composite Quantile Regression Algorithm.

Weighted Hierarchical Stochastic Gradient Identification Algorithms for ARX Models

Accelerated Identification Algorithms for Exponential Nonlinear Models: Two-Stage Method and Particle Swarm Optimization Method

A global–local optimization approach to parameter estimation of RBF-type models

Hybrid gradient descent algorithms for the exponential autoregressive model

Gradient-Based Identification Methods for Hammerstein Nonlinear Armax Models

The Nesterov accelerated gradient algorithm for Auto-Regressive Exogenous models with random lost measurements: interpolation method and auxiliary model method