Abstract:Time-series forecasting is one of the most active research topics in artificial intelligence. It has the power to bring light to problems in several areas of knowledge, such as epidemiological studies, healthcare inference, and climate change analysis. Applications in real-world time series should consider two factors for achieving reliable predictions: modeling dynamic dependencies among multiple variables and adjusting the model's intrinsic hyperparameters. An open gap in the literature is that statistical and ensemble learning approaches systematically present lower predictive performance than deep learning methods. The existing applications consistently disregard the data sequence aspect entangled with multivariate data represented in more than one time series. Conversely, this work presents a novel neural network architecture for time-series forecasting that combines the power of graph evolution with deep recurrent learning on distinct data distributions, named after Recurrent Graph Evolution Neural Network (ReGENN). The idea is to infer multiple multivariate relationships between co-occurring time-series by assuming that the temporal data depends not only on inner variables and intra-temporal relationships (i.e., observations from itself) but also on outer variables and inter-temporal relationships (i.e., observations from other-selves). An extensive set of experiments was conducted comparing ReGENN with tens of ensemble methods and classical statistical ones. The results outperformed both statistical and ensemble-learning approaches, showing an improvement of 64.87 percent over the competing algorithms on the SARS-CoV-2 dataset of the renowned John Hopkins University for 188 countries simultaneously. For further validation, we tested our architecture in two other public datasets of different domains, the PhysioNet Computing in Cardiology Challenge 2012 and Brazilian Weather datasets. We also analyzed the Evolution Weights arising from the hidden layers of ReGENN to describe how the variables of the dataset interact with each other; and, as a result of looking at inter and intra-temporal relationships simultaneously, we concluded that time-series forecasting is majorly improved if paying attention to how multiple multivariate data synchronously evolve.

Evolutionary Multi-Objective Generation of Recurrent Neural Network Ensembles for Time Series Prediction

Multi-objective Evolutionary Recurrent Neural Network Ensemble for Prediction of Computational Fluid Dynamic Simulations.

Dynamic Multi-Objective Optimization Algorithm Guided by Recurrent Neural Network

Evolutionary Ensemble Learning for Multivariate Time Series Prediction

Recurrent neural network ensembles for convergence prediction in surrogate-assisted evolutionary optimization

Evolutionary Multiobjective Ensemble Learning Based on Bayesian Feature Selection.

Multiobjective Evolution of Fuzzy Rough Neural Network via Distributed Parallelism for Stock Prediction

Multi-objective Ensemble Generation

Concurrent Optimization of Multiple Base Learners in Neural Network Ensembles: an Adaptive Niching Differential Evolution Approach

Developing parsimonious ensembles using ensemble diversity within a reinforcement learning framework

Pay Attention to Evolution: Time Series Forecasting with Deep Graph-Evolution Learning

Ensemble Learning Using Multi-Objective Evolutionary Algorithms

Evolutionary Random Neural Ensembles Based on Negative Correlation Learning

Remaining useful life estimation based on selective ensemble of deep neural networks with diversity

Neural Network Regularization and Ensembling Using Multi-Objective Evolutionary Algorithms

Multi-objective Ensemble Construction , Learning and Evolution

Reusing Genetic Programming for Ensemble Selection in Classification of Unbalanced Data

An Ensemble of Single Multiplicative Neuron Models for Probabilistic Prediction

Evolving Artificial Neural Network Ensembles

Evolving, training and designing neural network ensembles

Embedded feature selection in LSTM networks with multi-objective evolutionary ensemble learning for time series forecasting