A Bayesian Approach for Discovering Time- Delayed Differential Equation from Data

Debangshu Chowdhury,Souvik Chakraborty
2025-01-06
Abstract:Time-delayed differential equations (TDDEs) are widely used to model complex dynamic systems where future states depend on past states with a delay. However, inferring the underlying TDDEs from observed data remains a challenging problem due to the inherent nonlinearity, uncertainty, and noise in real-world systems. Conventional equation discovery methods often exhibit limitations when dealing with large time delays, relying on deterministic techniques or optimization-based approaches that may struggle with scalability and robustness. In this paper, we present BayTiDe - Bayesian Approach for Discovering Time-Delayed Differential Equations from Data, that is capable of identifying arbitrarily large values of time delay to an accuracy that is directly proportional to the resolution of the data input to it. BayTiDe leverages Bayesian inference combined with a sparsity-promoting discontinuous spike-and-slab prior to accurately identify time-delayed differential equations. The approach accommodates arbitrarily large time delays with accuracy proportional to the input data resolution, while efficiently narrowing the search space to achieve significant computational savings. We demonstrate the efficiency and robustness of BayTiDe through a range of numerical examples, validating its ability to recover delayed differential equations from noisy data.
Machine Learning,Computational Physics
What problem does this paper attempt to address?
### What problem does this paper attempt to solve? This paper aims to solve the challenge of inferring time - delayed differential equations (TDDEs) from observational data. Specifically, the authors propose a new method - BayTiDe (Bayesian method for Time - Delay Differential Equation discovery) to overcome the limitations of existing methods in dealing with large time delays, nonlinearity, uncertainty and noise. #### Main problems and challenges 1. **Modeling of complex dynamic systems**: Time - delayed differential equations (TDDEs) are widely used to model complex dynamic systems where future states depend on past states. These systems are very important in fields such as neuroscience, epidemiology, economics and engineering, because they can capture the delay effects in feedback loops or information propagation. 2. **Difficulties in inferring TDDEs from data**: Due to the inherent nonlinearity, uncertainty and noise in real - world systems, inferring the underlying TDDEs from observational data is a challenging problem. Traditional equation discovery methods often show limitations when dealing with large time delays, relying on deterministic techniques or optimization - based methods, which may encounter difficulties in terms of scalability and robustness. 3. **Limitations of existing methods**: - **Computational efficiency and scalability**: Many existing methods are computationally expensive and difficult to scale when dealing with high - dimensional data or complex systems. - **Sensitivity to noise**: Most existing methods are very sensitive to measurement noise, leading to a decline in performance in practical applications. - **Requirement for manual parameter tuning**: Many frameworks require manual adjustment of hyper - parameters, limiting their robustness and applicability in diverse and complex systems. #### BayTiDe's solutions To address the above challenges, the authors propose BayTiDe, a time - delay differential equation discovery method based on Bayesian inference. BayTiDe has the following features: - **Uncertainty quantification**: Through the Bayesian formula, it not only provides point estimates of equations, but also provides the posterior distribution of weight vectors, so that confidence intervals can be calculated and the uncertainty in the identified equations can be quantified. - **Robustness**: BayTiDe is highly robust to noise, can handle highly corrupted data without affecting performance, and has excellent generalization ability. - **Adaptability to large time delays**: Unlike many existing methods that can only identify small time delays, BayTiDe can handle arbitrarily large time delays. - **Insensitivity to stability**: BayTiDe can identify systems with different stability characteristics, whether they are periodic systems or chaotic systems. In summary, BayTiDe provides a powerful, reliable and flexible framework for discovering time - delay differential equations from data, especially suitable for dealing with complex real - world systems.