Abstract:Time series forecasting (TSF) is one of the most important tasks in data science given the fact that accurate time series (TS) predictive models play a major role across a wide variety of domains including finance, transportation, health care, and power systems. Real-world utilization of machine learning (ML) typically involves (pre-)training models on collected, historical data and then applying them to unseen data points. However, in real-world applications, time series data streams are usually non-stationary and trained ML models usually, over time, face the problem of data or concept drift. To address this issue, models must be periodically retrained or redesigned, which takes significant human and computational resources. Additionally, historical data may not even exist to re-train or re-design model with. As a result, it is highly desirable that models are designed and trained in an online fashion. This work presents the Online NeuroEvolution-based Neural Architecture Search (ONE-NAS) algorithm, which is a novel neural architecture search method capable of automatically designing and dynamically training recurrent neural networks (RNNs) for online forecasting tasks. Without any pre-training, ONE-NAS utilizes populations of RNNs that are continuously updated with new network structures and weights in response to new multivariate input data. ONE-NAS is tested on real-world, large-scale multivariate wind turbine data as well as the univariate Dow Jones Industrial Average (DJIA) dataset. Results demonstrate that ONE-NAS outperforms traditional statistical time series forecasting methods, including online linear regression, fixed long short-term memory (LSTM) and gated recurrent unit (GRU) models trained online, as well as state-of-the-art, online ARIMA strategies.

Evolutionary Neural Architecture Search for Multivariate Time Series Forecasting.

STONet: A Neural-Operator-Driven Spatio-temporal Network

Dynamic Spatial-Temporal Embedding Via Neural Conditional Random Field for Multivariate Time Series Forecasting

Scale-Aware Neural Architecture Search for Multivariate Time Series Forecasting

Pre-training Enhanced Spatial-temporal Graph Neural Network for Multivariate Time Series Forecasting

Online Evolutionary Neural Architecture Search for Multivariate Non-Stationary Time Series Forecasting

Spatial-Temporal Convolutional Transformer Network for Multivariate Time Series Forecasting

Dynamic meta-graph convolutional recurrent network for heterogeneous spatiotemporal graph forecasting

Spectral Temporal Graph Neural Network for Multivariate Time-series Forecasting

Learning the Evolutionary and Multi-scale Graph Structure for Multivariate Time Series Forecasting

SAGDFN: A Scalable Adaptive Graph Diffusion Forecasting Network for Multivariate Time Series Forecasting

Learning and Integration of Adaptive Hybrid Graph Structures for Multivariate Time Series Forecasting.

Spatiotemporal Transformer Neural Network for Time-Series Forecasting

A Decomposition-Based Memetic Neural Architecture Search Algorithm for Univariate Time Series Forecasting.

TDG4MSF: A temporal decomposition enhanced graph neural network for multivariate time series forecasting

Genetic-GNN: Evolutionary architecture search for Graph Neural Networks

AutoSTF: Decoupled Neural Architecture Search for Cost-Effective Automated Spatio-Temporal Forecasting

Connecting the Dots: Multivariate Time Series Forecasting with Graph Neural Networks

MDG: A Multi-Task Dynamic Graph Generation Framework for Multivariate Time Series Forecasting

Spatial-Temporal Semantic Neural Network for Time Series Forecasting

Automated Spatio-Temporal Synchronous Modeling with Multiple Graphs for Traffic Prediction