Abstract:Long-term prediction of multivariate time series is still an important but challenging problem. The key to solve this problem is capturing (1) the spatial correlations at the same time, (2) the spatio-temporal relationships at different times, and (3) long-term dependency of the temporal relationships between different series. Attention-based recurrent neural networks (RNN) can effectively represent and learn the dynamic spatio-temporal relationships between exogenous series and target series, but they only perform well in one-step time prediction and short-term time prediction. In this paper, inspired by human attention mechanism including the dual-stage two-phase (DSTP) model and the influence mechanism of target information and non-target information, we propose DSTP-based RNN (DSTP-RNN) and DSTP-RNN-II respectively for long-term time series prediction. Specifically, we first propose the DSTP-based structure to enhance the spatial correlations between exogenous series. The first phase produces violent but decentralized response weight, while the second phase leads to stationary and concentrated response weight. Then, we employ multiple attentions on target series to boost the long-term dependency. Finally, we study the performance of deep spatial attention mechanism and provide interpretation. Experimental results demonstrate that the present work can be successfully used to develop expert or intelligent systems for a wide range of applications, with state-of-the-art performances superior to nine baseline methods on four datasets in the fields of energy, finance, environment and medicine, respectively. Overall, the present work carries a significant value not merely in the domain of machine intelligence and deep learning, but also in the fields of many applications. (C) 2019 Elsevier Ltd. All rights reserved.

A granular recurrent neural network for multiple time series prediction

Time series prediction with granular neural networks

STONet: A Neural-Operator-Driven Spatio-temporal Network

Multi-Scale Information Granule-Based Time Series Forecasting Model with Two-Stage Prediction Mechanism

Hybrid Time Series Interval Prediction by Granular Neural Network and ARIMA

Time-Series Forecasting Via Fuzzy-Probabilistic Approach with Evolving Clustering-Based Granulation

Granular Neural Networks Learning for Time Series Prediction under a Federated Scenario

The Long-Term Prediction of Time Series: A Granular Computing-Based Design Approach

Time-series Prediction Based on VMD and Stack Recurrent Neural Network.

Information Granules-Based BP Neural Network for Long-Term Prediction of Time Series

Stochastic Recurrent Neural Network for Multistep Time Series Forecasting

A deep granular network with adaptive unequal-length granulation strategy for long-term time series forecasting and its industrial applications

Building Trend Fuzzy Granulation-Based LSTM Recurrent Neural Network for Long-Term Time-Series Forecasting

Multiple Granularity Spatiotemporal Network for Sea Surface Temperature Prediction

Hierarchical Neural Networks for Multivariate Time Series Prediction

A Recurrent Spatio-Temporal Graph Neural Network Based on Latent Time Graph for Multi-Channel Time Series Forecasting

Prediction of Time Series Gene Expression and Structural Analysis of Gene Regulatory Networks Using Recurrent Neural Networks

Dirichlet Graph Convolution Coupled Neural Differential Equation for Spatio-temporal Time Series Prediction

DSTP-RNN: A Dual-Stage Two-Phase Attention-Based Recurrent Neural Network for Long-Term and Multivariate Time Series Prediction

Prediction of gene expression time series and structural analysis of gene regulatory networks using recurrent neural networks

A Multi-Granularity Hierarchical Network for Long- and Short-Term Forecasting on Multivariate Time Series Data