Abstract:This paper presents a Functional Weights Wavelet Neural Network-based state-dependent AR (FWWNN-AR) model with the main objective to address the modeling and prediction problem of nonlinear time series. The FWWNN-AR model is a state-dependent autoregressive (SD-AR) model, which has its coefficients approximated by a set of Functional Weights Wavelet Neural Network (FWWNN). The FWWNN is an enhanced type of wavelet neural network comprising of five layers: input, wavelet, product, output and functional weight layer that computes the weights as function of inputs thus making the weights to vary with the inputs and to share the dynamics with the wavelet compartment. The FWWNN-AR model possesses both the advantages of the state-dependent AR model in the description of nonlinear dynamics using few nodes and of the FWWNN in functional approximation considering mutually the time and frequency spaces. It learns the nonlinear dynamics from three distinct levels: AR level, Wavelet compartment level and functional weights level. A Structured Nonlinear Parameter Optimization Method (SNPOM) is applied to estimate the FWWNN-AR model parameters. This learning approach divides the parameter search space into linear and nonlinear subspaces and centers the search in the nonlinear subspace, but at each iteration in the optimization process, a search in the nonlinear (or linear) subspace is executed on the basis of the estimated values just obtained in linear (or nonlinear) subspace. The search in the nonlinear subspace uses a method similar to the Levemberg-Marquardt Method (LMM), and the search in the linear subspace uses the Least Square Method (LSM). The proposed model is validated by comparing its performances and effectiveness with those achieved by some well known models on both generated and real nonlinear time series.

A locally linear RBF network-based state-dependent AR model for nonlinear time series modeling

Nonlinear time series modeling and prediction using functional weights wavelet neural network-based state-dependent AR model

A Novel Nonlinear Dynamic System Modeling Approach Using Radial Basis Function Neural Networks

A Nonlinear Adaptive Controller Based on RBF Networks

Exploiting the interpretability and forecasting ability of the RBF-AR model for nonlinear time series

A Hybrid Modeling Method Based on Linear AR and Nonlinear DBN-AR Model for Time Series Forecasting

A Novel FRBF-Type Model for Nonlinear Time Series Prediction

DBN based SD-ARX model for nonlinear time series prediction and analysis

Stability Analysis of Deep Belief Network: Based SD-AR Model for Nonlinear Time Series

Time Series Forecasting Using a Hybrid RBF Neural Network and AR Model Based on Binomial Smoothing

Deep Learning-Based State-Dependent ARX Modeling and Predictive Control of Nonlinear Systems

Nonlinear modeling and control approach to magnetic levitation ball system using functional weight RBF network-based state-dependent ARX model

Nonlinear System Modeling and Predictive Control Using the RBF Nets-Based Quasi-Linear ARX Model

AR-Net: A simple Auto-Regressive Neural Network for time-series

Efficient Interpretable Nonlinear Modeling for Multiple Time Series

Support Vector Regression Based Nonlinear Model Reference Adaptive Control

The Power of Linear Recurrent Neural Networks

Nonlinear time series modeling and prediction using RBF network with improved clustering algorithm

A neural network-based ARMA model for fuzzy time series data

POD-based Radial Basis Function Neural Network for Nonlinear Time Series Prediction

A novel expectation–maximization-based separable algorithm for parameter identification of RBF-AR model