Abstract:This paper presents a Functional Weights Wavelet Neural Network-based state-dependent AR (FWWNN-AR) model with the main objective to address the modeling and prediction problem of nonlinear time series. The FWWNN-AR model is a state-dependent autoregressive (SD-AR) model, which has its coefficients approximated by a set of Functional Weights Wavelet Neural Network (FWWNN). The FWWNN is an enhanced type of wavelet neural network comprising of five layers: input, wavelet, product, output and functional weight layer that computes the weights as function of inputs thus making the weights to vary with the inputs and to share the dynamics with the wavelet compartment. The FWWNN-AR model possesses both the advantages of the state-dependent AR model in the description of nonlinear dynamics using few nodes and of the FWWNN in functional approximation considering mutually the time and frequency spaces. It learns the nonlinear dynamics from three distinct levels: AR level, Wavelet compartment level and functional weights level. A Structured Nonlinear Parameter Optimization Method (SNPOM) is applied to estimate the FWWNN-AR model parameters. This learning approach divides the parameter search space into linear and nonlinear subspaces and centers the search in the nonlinear subspace, but at each iteration in the optimization process, a search in the nonlinear (or linear) subspace is executed on the basis of the estimated values just obtained in linear (or nonlinear) subspace. The search in the nonlinear subspace uses a method similar to the Levemberg-Marquardt Method (LMM), and the search in the linear subspace uses the Least Square Method (LSM). The proposed model is validated by comparing its performances and effectiveness with those achieved by some well known models on both generated and real nonlinear time series.

A neural network-based ARMA model for fuzzy time series data

Application of Neural Network and Time Series Techniques in Wool Growth Modeling

Nonlinear time series modeling and prediction using functional weights wavelet neural network-based state-dependent AR model

AR-Net: A simple Auto-Regressive Neural Network for time-series

Online learning of ARIMA for time series prediction.(2016)

Time series forecasting using a hybrid ARIMA and neural network model

An On-Line Algorithm for Segmenting Time Series Based on ARMA Model

ARMA Cell: A Modular and Effective Approach for Neural Autoregressive Modeling

Enhancing Integer Time Series Model Estimations through Neural Network-Based Fuzzy Time Series Analysis

A Novel FRBF-Type Model for Nonlinear Time Series Prediction

State Prediction of Chaotic Time-Series Systems Using Autoregressive Integrated with Adaptive Network-Fuzzy

Online ARIMA Algorithms for Time Series Prediction

Estimation of ARMA Model Order via Artificial Neural Network for Modeling Physiological Systems

Online learning of ARIMA for time series prediction

IFNN: Intuitionistic Fuzzy Logic Based Neural Network Model for Time Series Forecasting

An irregularly spaced ARMA(1,1) model and an application to contamination data

Hybridization of long short-term memory neural network in fractional time series modeling of inflation

Generalized Autoregressive Neural Network Models

A long-memory integer-valued time series model, INARFIMA, for financial application

Artificial Neural Networks and Time Series of Counts: A Class of Nonlinear INGARCH Models

Positive time series regression models: theoretical and computational aspects