Abstract:Predictive linear and nonlinear models based on kernel machines or deep neural networks have been used to discover dependencies among time series. This paper proposes an efficient nonlinear modeling approach for multiple time series, with a complexity comparable to linear vector autoregressive (VAR) models while still incorporating nonlinear interactions among different time-series variables. The modeling assumption is that the set of time series is generated in two steps: first, a linear VAR process in a latent space, and second, a set of invertible and Lipschitz continuous nonlinear mappings that are applied per sensor, that is, a component-wise mapping from each latent variable to a variable in the measurement space. The VAR coefficient identification provides a topology representation of the dependencies among the aforementioned variables. The proposed approach models each component-wise nonlinearity using an invertible neural network and imposes sparsity on the VAR coefficients to reflect the parsimonious dependencies usually found in real applications. To efficiently solve the formulated optimization problems, a custom algorithm is devised combining proximal gradient descent, stochastic primal-dual updates, and projection to enforce the corresponding constraints. Experimental results on both synthetic and real data sets show that the proposed algorithm improves the identification of the support of the VAR coefficients in a parsimonious manner while also improving the time-series prediction, as compared to the current state-of-the-art methods.

Linear, Machine Learning and Probabilistic Approaches for Time Series Analysis

Machine Learning Algorithms for Time Series Analysis and Forecasting

Machine learning advances for time series forecasting

Analytics of Business Time Series Using Machine Learning and Bayesian Inference

An Analysis of Linear Time Series Forecasting Models

Linguistic Approach to Time Series Forecasting

Bayesian Regression Approach for Building and Stacking Predictive Models in Time Series Analytics

Time-Series Forecasting of Seasonal Data Using Machine Learning Methods

Machine Learning vs Statistical Methods for Time Series Forecasting: Size Matters

Machine learning applications in time series hierarchical forecasting

Comparing statistical and machine learning methods for time series forecasting in data-driven logistics -- A simulation study

Comparative Simulation Study of Classical and Machine Learning Techniques for Forecasting Time Series Data

Efficient Interpretable Nonlinear Modeling for Multiple Time Series

Learning Interpretable Deep State Space Model for Probabilistic Time Series Forecasting

Forecasting realized volatility with machine learning: Panel data perspective

Forecasting economic and financial time-series with non-linear models

Manifold-based time series forecasting

Machine Learning and Causal Analyses for Modeling Financial and Economic Data

Nonlinear Time Series Forecasting Based on Relevance Vector Regression

Econometrics of Machine Learning Methods in Economic Forecasting

Time Series Analysis: yesterday, today, tomorrow