Abstract:Time series forecasting is an essential and challenging task, especially for large-scale time-series (LSTS) forecasting, which plays a crucial role in many real-world applications. Due to the instability of time series data and the randomness (noise) of their characteristics, it is difficult for polynomial neural network (PNN) and its modifications to achieve accurate and stable time series prediction. In this study, we propose a novel structure of hierarchical neural networks (HNN) realized by long short-term memory (LSTM), two classes of self-organizing dynamical fuzzy neural network architectures of fuzzy rule-based polynomial neurons (FPN) and polynomial neurons (PN) constructed by variant generation of nodes as well as layers of networks. The proposed HNN combines the deep learning method with the PNN method for the first time and extends it to time series prediction as a modification of PNN. LSTM extracts the temporal dependencies present in each time series and enables the model to learn its representation. FPNs are designed to capture the complex non-linear patterns present in the data space by utilizing Fuzzy C-Means clustering (FCM) and least square error (LSE)-based learning of polynomial functions. The self-organizing hierarchical network architecture generated by the Elitism-based Roulette Wheel Selection (ERWS) strategy ensures that candidate neurons exhibit sufficient fitting ability while enriching the diversity of heterogeneous neurons, addressing the issue of multicollinearity and providing opportunities to select better prediction neurons. In addition, L2-norm regularization is applied to mitigate the overfitting problem. Experiments are conducted on 9 real-world LSTS datasets including three practical applications. The results show that the proposed model exhibits high prediction performance, outperforming many state-of-the-art models.

Time series forecasting by ANN and SVM hierarchical architecture

A machine learning approach for forecasting hierarchical time series

Effective LSTMs with Seasonal-Trend Decomposition and Adaptive Learning and Niching-Based Backtracking Search Algorithm for Time Series Forecasting

Hierarchical Classification Auxiliary Network for Time Series Forecasting

Optimizing Time Series Forecasting Architectures: A Hierarchical Neural Architecture Search Approach

A Hybrid Wind Speed Prediction Approach Based on Ensemble Empirical Mode Decomposition and BO-LSTM Neural Networks for Digital Twin

Machine learning applications in time series hierarchical forecasting

A novel hybrid deep learning time series forecasting model based on long-short-term patterns

Real-time Forecasting of Time Series in Financial Markets Using Sequentially Trained Many-to-one LSTMs

On the forecasting of high‐frequency financial time series based on ARIMA model improved by deep learning

Enhancing Time Series Forecasting: A Hierarchical Transformer with Probabilistic Decomposition Representation

Design of Hierarchical Neural Networks Using Deep LSTM and Self-organizing Dynamical Fuzzy-Neural Network Architecture

SLOTH: Structured Learning and Task-Based Optimization for Time Series Forecasting on Hierarchies

Forecasting Hierarchical Time Series

Enhancing Neural Network Based Hybrid Learning with Empirical Wavelet Transform for Time Series Forecasting

A Novel Hybridization of ARIMA, ANN, and K-Means for Time Series Forecasting

Time series forecasting model for non-stationary series pattern extraction using deep learning and GARCH modeling

Hierarchical Temporal Memory method for time-series-based anomaly detection

Multi-Scaled Forecasting Model Based On Support Vector Machines

Self-attention-based time-variant neural networks for multi-step time series forecasting

Prediction of hierarchical time series using structured regularization and its application to artificial neural networks