Abstract:Ordinary differential equations (ODEs) can provide mechanistic models of temporally local changes of processes, where parameters are often informed by external knowledge. While ODEs are popular in systems modeling, they are less established for statistical modeling of longitudinal cohort data, e.g., in a clinical setting. Yet, modeling of local changes could also be attractive for assessing the trajectory of an individual in a cohort in the immediate future given its current status, where ODE parameters could be informed by further characteristics of the individual. However, several hurdles so far limit such use of ODEs, as compared to regression-based function fitting approaches. The potentially higher level of noise in cohort data might be detrimental to ODEs, as the shape of the ODE solution heavily depends on the initial value. In addition, larger numbers of variables multiply such problems and might be difficult to handle for ODEs. To address this, we propose to use each observation in the course of time as the initial value to obtain multiple local ODE solutions and build a combined estimator of the underlying dynamics. Neural networks are used for obtaining a low-dimensional latent space for dynamic modeling from a potentially large number of variables, and for obtaining patient-specific ODE parameters from baseline variables. Simultaneous identification of dynamic models and of a latent space is enabled by recently developed differentiable programming techniques. We illustrate the proposed approach in an application with spinal muscular atrophy patients and a corresponding simulation study. In particular, modeling of local changes in health status at any point in time is contrasted to the interpretation of functions obtained from a global regression. This more generally highlights how different application settings might demand different modeling strategies.

Dynamical Modeling for Non-Gaussian Data with High-Dimensional Sparse Ordinary Differential Equations

A Joint Estimation Approach to Sparse Additive Ordinary Differential Equations.

Kernel Ordinary Differential Equations

A statistical approach to latent dynamic modeling with differential equations

Sparse Additive Ordinary Differential Equations for Dynamic Gene Regulatory Network Modeling

Automatically discovering ordinary differential equations from data with sparse regression

Deep Generative Modeling for Identification of Noisy, Non-Stationary Dynamical Systems

Robust Estimation of Parameters in Nonlinear Ordinary Differential Equation Models

Data2Dynamics: a Modeling Environment Tailored to Parameter Estimation in Dynamical Systems.

Data-driven discovery of stochastic differential equations

Numerical Discretization-Based Kernel Type Estimation Methods for Ordinary Differential Equation Models

Estimating and Assessing Differential Equation Models with Time-Course Data

Parameter Estimation and Variable Selection for Big Systems of Linear Ordinary Differential Equations: A Matrix-Based Approach

Automatically identifying ordinary differential equations from data

The Dynamic Evolutionary Modeling of Higher-Order Ordinary Differential Equations

Parameter estimation of ODE's via nonparametric estimators

An evolutionary approach for discovering non-Gaussian stochastic dynamical systems based on nonlocal Kramers-Moyal formulas

Nonparametric Estimation of Ordinary Differential Equations: Snake and Stubble

Model-Embedded Gaussian Process Regression for Parameter Estimation in Dynamical System

Model Selection for Ordinary Differential Equations: A Statistical Testing Approach

Calibrating multi-dimensional complex ODE from noisy data via deep neural networks