Abstract:Internet of Things realizes the ubiquitous connection of all things, generating countless time-tagged data called time series. However, real-world time series are often plagued with missing values on account of noise or malfunctioning sensors. Existing methods for modeling such incomplete time series typically involve preprocessing steps, such as deletion or missing data imputation using statistical learning or machine learning methods. Unfortunately, these methods unavoidable destroy time information and bring error accumulation to the subsequent model. To this end, this paper introduces a novel continuous neural network architecture, named Time-aware Neural-Ordinary Differential Equations (TN-ODE), for incomplete time data modeling. The proposed method not only supports imputation missing values at arbitrary time points, but also enables multi-step prediction at desired time points. Specifically, TN-ODE employs a time-aware Long Short-Term Memory as an encoder, which effectively learns the posterior distribution from partial observed data. Additionally, the derivative of latent states is parameterized with a fully connected network, thereby enabling continuous-time latent dynamics generation. The proposed TN-ODE model is evaluated on both real-world and synthetic incomplete time-series datasets by conducting data interpolation and extrapolation tasks as well as classification task. Extensive experiments show the TN-ODE model outperforms baseline methods in terms of Mean Square Error for imputation and prediction tasks, as well as accuracy in downstream classification task.

A New Robust Learning Algorithm for Ordinary Differential Equation Network

Stiff neural ordinary differential equations

Learning nonparametric ordinary differential equations from noisy data

ODEN: A Framework to Solve Ordinary Differential Equations using Artificial Neural Networks

On Robustness of Neural Ordinary Differential Equations

Neural ordinary differential equations with irregular and noisy data

RODE-Net: Learning Ordinary Differential Equations with Randomness from Data

Collocation based training of neural ordinary differential equations

Robust Estimation of Parameters in Nonlinear Ordinary Differential Equation Models

The advance of neural ordinary differential ordinary differential equations

Constrained Neural Ordinary Differential Equations with Stability Guarantees

Stable Neural Stochastic Differential Equations in Analyzing Irregular Time Series Data

Capturing Actionable Dynamics with Structured Latent Ordinary Differential Equations

KAN-ODEs: Kolmogorov-Arnold Network Ordinary Differential Equations for Learning Dynamical Systems and Hidden Physics

Locally Regularized Neural Differential Equations: Some Black Boxes Were Meant to Remain Closed!

Learning Networked Dynamical System Models with Weak Form and Graph Neural Networks

Time-aware neural ordinary differential equations for incomplete time series modeling

A new regularized and robust LSTM learning algorithm for industrial soft sensors

Neural ODEs with Irregular and Noisy Data

Neural Ordinary Differential Equations with Envolutionary Weights

Sparse Additive Ordinary Differential Equations for Dynamic Gene Regulatory Network Modeling