Abstract:Time-series forecasting is one of the most active research topics in artificial intelligence. It has the power to bring light to problems in several areas of knowledge, such as epidemiological studies, healthcare inference, and climate change analysis. Applications in real-world time series should consider two factors for achieving reliable predictions: modeling dynamic dependencies among multiple variables and adjusting the model's intrinsic hyperparameters. An open gap in the literature is that statistical and ensemble learning approaches systematically present lower predictive performance than deep learning methods. The existing applications consistently disregard the data sequence aspect entangled with multivariate data represented in more than one time series. Conversely, this work presents a novel neural network architecture for time-series forecasting that combines the power of graph evolution with deep recurrent learning on distinct data distributions, named after Recurrent Graph Evolution Neural Network (ReGENN). The idea is to infer multiple multivariate relationships between co-occurring time-series by assuming that the temporal data depends not only on inner variables and intra-temporal relationships (i.e., observations from itself) but also on outer variables and inter-temporal relationships (i.e., observations from other-selves). An extensive set of experiments was conducted comparing ReGENN with tens of ensemble methods and classical statistical ones. The results outperformed both statistical and ensemble-learning approaches, showing an improvement of 64.87 percent over the competing algorithms on the SARS-CoV-2 dataset of the renowned John Hopkins University for 188 countries simultaneously. For further validation, we tested our architecture in two other public datasets of different domains, the PhysioNet Computing in Cardiology Challenge 2012 and Brazilian Weather datasets. We also analyzed the Evolution Weights arising from the hidden layers of ReGENN to describe how the variables of the dataset interact with each other; and, as a result of looking at inter and intra-temporal relationships simultaneously, we concluded that time-series forecasting is majorly improved if paying attention to how multiple multivariate data synchronously evolve.

Evolving network representation learning based on recurrent neural network

Dynamic Network Embeddings for Network Evolution Analysis.

Online Dynamic Network Embedding

EPNE: Evolutionary Pattern Preserving Network Embedding.

Temporal Network Representation Learning via Historical Neighborhoods Aggregation

Neighbor-enhanced Representation Learning for Link Prediction in Dynamic Heterogeneous Attributed Networks

Dynamic network link prediction with node representation learning from graph convolutional networks

Models for Capturing Temporal Smoothness in Evolving Networks for Learning Latent Representation of Nodes

Exploring Evolution of Dynamic Networks Via Diachronic Node Embeddings

Contrastive Representation Learning for Dynamic Link Prediction in Temporal Networks

EvoNet: A Neural Network for Predicting the Evolution of Dynamic Graphs

Deep Dynamic Network Embedding for Link Prediction

Network Representation Learning with Ensemble Methods

An extended self-representation model of complex networks for link prediction

Network representation learning: a systematic literature review

Modeling Dynamic Heterogeneous Network for Link Prediction using Hierarchical Attention with Temporal RNN

DCENet: A dynamic correlation evolve network for short-term traffic prediction

Pay Attention to Evolution: Time Series Forecasting with Deep Graph-Evolution Learning

Temporally Factorized Network Modeling for Evolutionary Network Analysis.

Network Representation Learning: From Preprocessing, Feature Extraction to Node Embedding

Predicting Path Failure In Time-Evolving Graphs