Abstract:Context. Neural Ordinary Differential Equations is a deep neural networks family that leverage numerical methods approaches for solving the problem of time series reconstruction, given small amount of unevenly distributed samples. Objective. The goal of the following research is the synthesis of a deep neural network that is able to solve input signal reconstruction and time series extrapolation task. Method. The proposed method exhibits the benefits of solving time series extrapolation task over forecasting one. A model that implements encoder-decoder architecture with differential equation solving in latent space, is proposed. The latter approach was proven to demonstrate outstanding performance in solving time series reconstruction task given a small percentage of noisy and uneven distributed input signals. The proposed Latent Ordinary Differential Equations Variational Autoencoder (LODE-VAE) model was benchmarked on synthetic non-stationary data with added white noise and randomly sampled with random intervals between each signal. Results. The proposed method was implemented via deep neural network to solve time series extrapolation task. Conclusions. The conducted experiments have confirmed that proposed model solves the given task effectively and is recommended to apply it to solving real-world problems that require reconstructing dynamics of non-stationary processes. The prospects for further research may include the process of computational optimization of proposed models, as well as conducting additional experiments involving different baselines, e. g. Generative Adversarial Networks or attention Networks.

Reconstructing nonlinear networks subject to fast-varying noises by using linearization with expanded variables

Reconstruction of Noise-Driven Nonlinear Networks from Node Outputs by Using High-Order Correlations

Reconstruction of Dynamic Networks with Time-Delayed Interactions in the Presence of Fast-Varying Noises

Reconstructing dynamics of complex systems from noisy time series with hidden variables

Depicting Network Structures from Variable Data Produced by Unknown Colored-Noise Driven Dynamics

Control of Nonaffine Nonlinear Discrete-Time Systems Using Reinforcement-Learning-Based Linearly Parameterized Neural Networks

Reconstruction of Complex Time-varying Weighted Networks Based on LASSO

Time-delayed Network Reconstruction based on Nonlinear Continuous Dynamical Systems

Structure Reconstruction for Linear Network Systems with Dynamical Structure Functions

Neural-Network-Based Filtering for A General Class of Nonlinear Systems under Dynamically Bounded Innovations over Sensor Networks

NEURAL ORDINARY DIFFERENTIAL EQUATIONS FOR TIME SERIES RECONSTRUCTION

Efficient Reconstruction of Neural Mass Dynamics Modeled by Linear-Threshold Networks

Reconstruction of network dynamics from partial observations

Sparse dynamic network reconstruction through L1-regularization of a Lyapunov equation

Reconstructing links in directed networks from noisy dynamics

Learning Dynamics from Noisy Measurements using Deep Learning with a Runge-Kutta Constraint

A projected nonlinear state-space model for forecasting time series signals

A scalable multi-step least squares method for network identification with unknown disturbance topology

Efficient Interpretable Nonlinear Modeling for Multiple Time Series

System Aliasing in Dynamic Network Reconstruction:Issues on Low Sampling Frequencies

Learning Linearized Models from Nonlinear Systems with Finite Data