Abstract:Time series forecasting is an essential and challenging task, especially for large-scale time-series (LSTS) forecasting, which plays a crucial role in many real-world applications. Due to the instability of time series data and the randomness (noise) of their characteristics, it is difficult for polynomial neural network (PNN) and its modifications to achieve accurate and stable time series prediction. In this study, we propose a novel structure of hierarchical neural networks (HNN) realized by long short-term memory (LSTM), two classes of self-organizing dynamical fuzzy neural network architectures of fuzzy rule-based polynomial neurons (FPN) and polynomial neurons (PN) constructed by variant generation of nodes as well as layers of networks. The proposed HNN combines the deep learning method with the PNN method for the first time and extends it to time series prediction as a modification of PNN. LSTM extracts the temporal dependencies present in each time series and enables the model to learn its representation. FPNs are designed to capture the complex non-linear patterns present in the data space by utilizing Fuzzy C-Means clustering (FCM) and least square error (LSE)-based learning of polynomial functions. The self-organizing hierarchical network architecture generated by the Elitism-based Roulette Wheel Selection (ERWS) strategy ensures that candidate neurons exhibit sufficient fitting ability while enriching the diversity of heterogeneous neurons, addressing the issue of multicollinearity and providing opportunities to select better prediction neurons. In addition, L2-norm regularization is applied to mitigate the overfitting problem. Experiments are conducted on 9 real-world LSTS datasets including three practical applications. The results show that the proposed model exhibits high prediction performance, outperforming many state-of-the-art models.

HDResNet: Hierarchical-Decomposition Residual Network for Hierarchical Time Series Forecasting.

A Novel Sequence-to-Sequence-Based Deep Learning Model for Multistep Load Forecasting.

Hidformer: Hierarchical Dual-Tower Transformer Using Multi-Scale Mergence for Long-Term Time Series Forecasting

The Temperature Prediction of Hydro-generating Units based on Temporal Convolutional Network and Recurrent Neural Network

Enhancing Time Series Forecasting: A Hierarchical Transformer with Probabilistic Decomposition Representation

DRCNN: decomposing residual convolutional neural networks for time series forecasting

End-to-End Modeling Hierarchical Time Series Using Autoregressive Transformer and Conditional Normalizing Flow based Reconciliation

End-to-End Modeling of Hierarchical Time Series Using Autoregressive Transformer and Conditional Normalizing Flow-based Reconciliation

Hierarchical U-net with re-parameterization technique for spatio-temporal weather forecasting

Hierarchical Classification Auxiliary Network for Time Series Forecasting

Reliable Long-Term Energy Load Trend Prediction Model for Smart Grid Using Hierarchical Decomposition Self-Attention Network

Design of Hierarchical Neural Networks Using Deep LSTM and Self-organizing Dynamical Fuzzy-Neural Network Architecture

DeepHGNN: Study of Graph Neural Network based Forecasting Methods for Hierarchically Related Multivariate Time Series

TreeDRNet:A Robust Deep Model for Long Term Time Series Forecasting

A machine learning approach for forecasting hierarchical time series

Short-term Load Forecasting with Deep Residual Networks

SLOTH: Structured Learning and Task-Based Optimization for Time Series Forecasting on Hierarchies

Learning the Dynamic Correlations and Mitigating Noise by Hierarchical Convolution for Long-term Sequence Forecasting

TPRNN: A Top-Down Pyramidal Recurrent Neural Network for Time Series Forecasting

Convolutional residual network to short-term load forecasting

A New Unified Deep Learning Approach with Decomposition-Reconstruction-Ensemble Framework for Time Series Forecasting