Machine Learning of Time Series Using Time-Delay Embedding and Precision Annealing

Alexander J. A. Ty,Zheng Fang,Rivver A. Gonzalez,Paul. J. Rozdeba,Henry D. I. Abarbanel
DOI: https://doi.org/10.1162/neco_a_01224
IF: 3.278
2019-10-01
Neural Computation
Abstract:Tasking machine learning to predict segments of a time series requires estimating the parameters of a ML model with input/output pairs from the time series. We borrow two techniques used in statistical data assimilation in order to accomplish this task: time-delay embedding to prepare our input data and precision annealing as a training method. The precision annealing approach identifies the global minimum of the action ([Formula: see text]). In this way, we are able to identify the number of training pairs required to produce good generalizations (predictions) for the time series. We proceed from a scalar time series [Formula: see text] and, using methods of nonlinear time series analysis, show how to produce a [Formula: see text]-dimensional time-delay embedding space in which the time series has no false neighbors as does the observed [Formula: see text] time series. In that [Formula: see text]-dimensional space, we explore the use of feedforward multilayer perceptrons as network models operating on [Formula: see text]-dimensional input and producing [Formula: see text]-dimensional outputs.
computer science, artificial intelligence,neurosciences
What problem does this paper attempt to address?