Abstract:Recurrent neural network (RNN) models continue the theory of the autoregression integrated moving average (ARIMA) model class. In this paper, we consider the architecture of the RNN with embedded memory—«Process of Nonlinear Autoregressive Exogenous Model» (NARX). Though it is known that NN is a universal approximator, certain difficulties and restrictions in different NN applications are still topical and call for new approaches and methods. In particular, it is difficult for an NN to model noisy and significantly nonstationary time series. The paper suggests optimizing the modeling process for a complicated-structure time series by NARX networks involving wavelet filtering. The developed procedure of wavelet filtering includes the application of the construction of wavelet packets and stochastic thresholds. A method to estimate the thresholds to obtain a solution with a defined confidence level is also developed. We introduce the algorithm of wavelet filtering. It is shown that the proposed wavelet filtering makes it possible to obtain a more accurate NARX model and improves the efficiency of the forecasting process for a natural time series of a complicated structure. Compared to ARIMA, the suggested method allows us to obtain a more adequate model of a nonstationary time series of complex nonlinear structure. The advantage of the method, compared to RNN, is the higher quality of data approximation for smaller computation efforts at the stages of network training and functioning that provides the solution to the problem of long-term dependencies. Moreover, we develop a scheme of approach realization for the task of data modeling based on NARX and anomaly detection. The necessity of anomaly detection arises in different application areas. Anomaly detection is of particular relevance in the problems of geophysical monitoring and requires method accuracy and efficiency. The effectiveness of the suggested method is illustrated in the example of processing of ionospheric parameter time series. We also present the results for the problem of ionospheric anomaly detection. The approach can be applied in space weather forecasting to predict ionospheric parameters and to detect ionospheric anomalies.

Long-term time series prediction with the NARX network: An empirical evaluation

Time series prediction based on NARX neural networks: An advanced approach

A Dual-Stage Attention-Based Recurrent Neural Network for Time Series Prediction

A delay damage model selection algorithm for NARX neural networks

Forecasting groundwater levels using nonlinear autoregressive networks with exogenous input (NARX)

Analyzing and Exploiting NARX Recurrent Neural Networks for Long-Term Dependencies

Salinity Time Series Prediction and Forecasting Using Dynamic Neural Networks in the Qiantang River Estuary

Insightful Railway Track Evaluation: Leveraging NARX Feature Interpretation

Potential and limitations of NARX for defect detection in guided wave signals

Approximation and Analysis of Natural Data Based on NARX Neural Networks Involving Wavelet Filtering

AMLNet: Adversarial Mutual Learning Neural Network for Non-AutoRegressive Multi-Horizon Time Series Forecasting

The Use of NARX Neural Networks to Forecast Daily Groundwater Levels

A Novel Approach Based Deep RNN Using Hybrid NARX-LSTM Model For Solar Power Forecasting

The Prediction of Derailment Coefficient Using NARX Neural Network

Application of Nonlinear Autoregressive with Exogenous Input (NARX) neural network in macroeconomic forecasting, national goal setting and global competitiveness assessment

Optical characterization of chevron texture formation in nematic electroconvection

Application of NARX Dynamic Neural Network in Quantitative Investment Forecasting System

Forecasting peak air pollution levels using NARX models

Stability of discrete-time feed-forward neural networks in NARX configuration

Back to Basics: The Power of the Multilayer Perceptron in Financial Time Series Forecasting

Neural Activity Inspired Asymmetric Basis Function TV-NARX Model for the Identification of Time-Varying Dynamic Systems