Relation of Biologically Motivated New Interpretation of

Jianghong Shi,Tianqi Chen,Ruoshi Yuan,Bo Yuan,Ping Ao

2011-01-01

Abstract:Stochastic dierential equations (SDE) are widely used in modeling stochastic dynamics in liter

What problem does this paper attempt to address?

Relation of a New Interpretation of Stochastic Differential Equations to Ito Process

Jianghong Shi,Tianqi Chen,Ruoshi Yuan,Bo Yuan,Ping Ao

DOI: https://doi.org/10.1007/s10955-012-0532-8

2012-01-01

Journal of Statistical Physics

Abstract:Stochastic differential equations (SDE) are widely used in modeling stochastic dynamics in literature. However, SDE alone is not enough to determine a unique process. A specified interpretation for stochastic integration is needed. Different interpretations specify different dynamics. Recently, a new interpretation of SDE is put forward by one of us. This interpretation has a built-in Boltzmann-Gibbs distribution and shows the existence of potential function for general processes, which reveals both local and global dynamics. Despite its powerful property, its relation with classical ones in arbitrary dimension remains obscure. In this paper, we will clarify such connection and derive the concise relation between the new interpretation and Ito process. We point out that the derived relation is experimentally testable.
Data-driven discovery of stochastic differential equations

Yasen Wang,Huazhen Fang,Junyang Jin,Guijun Ma,Xin He,Xing Dai,Zuogong Yue,Cheng Cheng,Hai-Tao Zhang,Donglin Pu,Dongrui Wu,Ye Yuan,Jorge Gonçalves,Jürgen Kurths,Han Ding

DOI: https://doi.org/10.1016/j.eng.2022.02.007

IF: 12.834

2022-03-01

Engineering

Abstract:Stochastic differential equations (SDEs) are mathematical models that are widely used to describe complex processes or phenomena perturbed by random noise from different sources. The identification of SDEs governing a system is often a challenge because of the inherent strong stochasticity of data and the complexity of the system’s dynamics. The practical utility of existing parametric approaches for identifying SDEs is usually limited by insufficient data resources. This study presents a novel framework for identifying SDEs by leveraging the sparse Bayesian learning (SBL) technique to search for a parsimonious, yet physically necessary representation from the space of candidate basis functions. More importantly, we use the analytical tractability of SBL to develop an efficient way to formulate the linear regression problem for the discovery of SDEs that requires considerably less time-series data. The effectiveness of the proposed framework is demonstrated using real data on stock and oil prices, bearing variation, and wind speed, as well as simulated data on well-known stochastic dynamical systems, including the generalized Wiener process and Langevin equation. This framework aims to assist specialists in extracting stochastic mathematical models from random phenomena in the natural sciences, economics, and engineering fields for analysis, prediction, and decision making.

engineering, multidisciplinary
SDE Decomposition and A-type Stochastic Interpretation in Nonequilibrium Processes

Ruoshi Yuan,Ying Tang,Ping Ao

DOI: https://doi.org/10.1007/s11467-017-0718-2

2017-01-01

Frontiers of Physics

Abstract:An innovative theoretical framework for stochastic dynamics based on the decomposition of a stochastic differential equation (SDE) into a dissipative component, a detailed-balance-breaking component, and a dual-role potential landscape has been developed, which has fruitful applications in physics, engineering, chemistry, and biology. It introduces the A-type stochastic interpretation of the SDE beyond the traditional Ito or Stratonovich interpretation or even the α-type interpretation for multidimensional systems. The potential landscape serves as a Hamiltonian-like function in nonequilibrium processes without detailed balance, which extends this important concept from equilibrium statistical physics to the nonequilibrium region. A question on the uniqueness of the SDE decomposition was recently raised. Our review of both the mathematical and physical aspects shows that uniqueness is guaranteed. The demonstration leads to a better understanding of the robustness of the novel framework. In addition, we discuss related issues including the limitations of an approach to obtaining the potential function from a steady-state distribution.
Discovering stochastic dynamical equations from biological time series data

Arshed Nabeel,Ashwin Karichannavar,Shuaib Palathingal,Jitesh Jhawar,David B. Brückner,Danny Raj M.,Vishwesha Guttal

2024-02-17

Abstract:Stochastic differential equations (SDEs) are an important framework to model dynamics with randomness, as is common in most biological systems. The inverse problem of integrating these models with empirical data remains a major challenge. Here, we present an equation discovery methodology that takes time series data as an input, analyses fine scale fluctuations and outputs an interpretable SDE that can correctly capture long-time dynamics of data. We achieve this by combining traditional approaches from stochastic calculus literature with state-of-the-art equation discovery techniques. We validate our approach on synthetic datasets, and demonstrate the generality and applicability of the method on two real-world datasets of vastly different spatiotemporal scales: (i) collective movement of fish school where stochasticity plays a crucial role, and (ii) confined migration of a single cell, primarily following a relaxed oscillation. We make the method available as an easy-to-use, open-source Python package, PyDaddy (Python Library for Data Driven Dynamics).

Quantitative Methods,Machine Learning,Dynamical Systems
The physical mechanism of stochastic calculus in random walks

Chern Lee,Hai Ye,Hui Li

DOI: https://doi.org/10.1088/1742-5468/ad1be1

2024-02-14

Journal of Statistical Mechanics Theory and Experiment

Abstract:Stochastic differential equations (SDEs) play an important role in fields ranging from physics and biology to economics. The interpretation of stochastic calculus in the presence of multiplicative noise continues to be an open question. Commonly, the choice of stochastic calculus rules is largely based on empirical knowledge and lacks quantitative substantiation. In this study, we introduce a functional method that quantitatively links stochastic calculus rules to the underlying physical mechanisms in random walks. For a given diffusion coefficient, we construct three models to exemplify the physical features of conventional stochastic calculus. Our work provides a new perspective for quantitatively addressing state-dependent noise and aims to contribute to the understanding of the physical factors underlying uncertainty in SDEs.

physics, mathematical,mechanics
Varying-Coefficient Stochastic Differential Equations with Applications in Ecology

Théo Michelot,Richard Glennie,Catriona Harris,Len Thomas

DOI: https://doi.org/10.1007/s13253-021-00450-6

2021-03-26

Abstract:Abstract Stochastic differential equations (SDEs) are popular tools to analyse time series data in many areas, such as mathematical finance, physics, and biology. They provide a mechanistic description of the phenomenon of interest, and their parameters often have a clear interpretation. These advantages come at the cost of requiring a relatively simple model specification. We propose a flexible model for SDEs with time-varying dynamics where the parameters of the process are nonparametric functions of covariates, similar to generalized additive models. Combining the SDE and nonparametric approaches allows for the SDE to capture more detailed, non-stationary, features of the data-generating process. We present a computationally efficient method of approximate inference, where the SDE parameters can vary according to fixed covariate effects, random effects, or basis-penalty smoothing splines. We demonstrate the versatility and utility of this approach with three applications in ecology, where there is often a modelling trade-off between interpretability and flexibility. Supplementary materials accompanying this paper appear online.
Statistical inference for stochastic differential equations

Peter Craigmile,Radu Herbei,Ge Liu,Grant Schneider

DOI: https://doi.org/10.1002/wics.1585

2022-04-27

WIREs Computational Statistics

Abstract:Statistical inference for Stochastic Differential Equations (SDEs)Many scientific fields have experienced growth in the use of stochastic differential equations (SDEs), also known as diffusion processes, to model scientific phenomena over time. SDEs can simultaneously capture the known deterministic dynamics of underlying variables of interest (e.g., ocean flow, chemical and physical characteristics of a body of water, presence, absence, and spread of a disease), while enabling a modeler to capture the unknown random dynamics in a stochastic setting. We focus on reviewing a wide range of statistical inference methods for likelihood‐based frequentist and Bayesian parametric inference based on discretely‐sampled diffusions. Exact parametric inference is not usually possible because the transition density is not available in closed form. Thus, we review the literature on approximate numerical methods (e.g., Euler, Milstein, local linearization, and Aït‐Sahalia) and simulation‐based approaches (e.g., data augmentation and exact sampling) that are used to carry out parametric statistical inference on SDE processes. We close with a brief discussion of other methods of inference for SDEs and more complex SDE processes such as spatio‐temporal SDEs.This article is categorized under:Data: Types and Structure > Time Series, Stochastic Processes, and Functional DataAlgorithms and Computational Methods > Maximum Likelihood MethodsStatistical Models > Fitting Models
On Uniqueness of "SDE Decomposition" in A-type Stochastic Integration

Ruoshi Yuan,Ying Tang,Ping Ao

DOI: https://doi.org/10.48550/arxiv.1603.07927

2016-01-01

Abstract:An innovative theoretical framework for stochastic dynamics based on a decomposition of a stochastic differential equation (SDE) has been developed with an evident advantage in connecting deterministic and stochastic dynamics, as well as useful applications in physics, engineering, chemistry and biology. It introduces the A-type stochastic integration for SDE beyond traditional Ito's or Stratonovich's interpretation. Serious question on its uniqueness was recently raised. We provide here both mathematical and physical demonstrations that the uniqueness is guaranteed. Such discussion leads to a better understanding on the robustness of the novel framework. We also discuss the limitation of a related approach of obtaining potential function from steady state distribution.
Stability in Mean of Partial Variables for Stochastic Reaction-Diffusion Systems with Markovian Switching

Yonggui Kao,Changhong Wang,Fusheng Zha,Hongxia Cao

DOI: https://doi.org/10.1016/j.jfranklin.2013.04.009

IF: 4.246

2014-01-01

Journal of the Franklin Institute

Abstract:This paper is denoted to investigating stability in mean of partial variables for stochastic reaction–diffusion equations with Markovian switching (SRDEMS). By transforming the integral of the trajectory with respect to spatial variables as the solution of the stochastic ordinary differential equations with Markovian switching (SODEMS) and using Itô formula, sufficient criteria on uniform stability in mean, asymptotic stability in mean, uniformly asymptotic stability in mean, exponential stability in mean of partial variables for SRDEMS are first derived. An example is presented to illustrate the effectiveness and efficiency of the obtained results.
A Stochastic SIS Epidemic Model with Ornstein-Uhlenbeck Process and Brown Motion

Xingzhi Chen,Baodan Tian,Xin Xu,Ruoxi Yang,Shouming Zhong

DOI: https://doi.org/10.21203/rs.3.rs-679213/v1

2021-01-01

Abstract:Abstract This paper studies a stochastic differential equation SIS epidemic model, disturbed randomly by the mean-reverting Ornstein-Uhlenbeck process and Brownian motion. We prove the existence and uniqueness of the positive global solutions of the model and obtain the controlling conditions for the extinction and persistence of the disease. The results show that when the basic reproduction number Rs0 < 1, the disease will extinct, on the contrary, when the basic reproduction number Rs0 > 1, the disease will persist. Furthermore, we can inhibit the outbreak of the disease by increasing the intensity of volatility or decreasing the speed of reversion ϑ, respectively. Finally, we give some numerical examples to verify these results.
Dynamics of Stochastic Reaction-Diffusion Equations

Christian Kuehn,Alexandra Neamtu

DOI: https://doi.org/10.48550/arXiv.1908.09177

2019-08-25

Abstract:Stochastic partial differential equations (SPDEs) represent a very active research field with numerous recent developments and breakthrough results. There are several well-established approaches and methods used to construct solutions for SPDEs, which is always a challenge due to the irregularity of the noise terms that perturb the equation. In applications, such noise terms can quantify the lack of knowledge of certain parameters, finite-size effects, and/or fluctuations occurring due to external perturbations. Since SPDEs have become a key modelling tool in applications, there has been a growing interest in studying their dynamical phenomena. The main goal of this work is to provide a survey on different approaches to solution theory and dynamical properties for SPDEs, which is accessible for a wide community interested in modern methods in stochastic analysis, dynamics and applications.

Probability,Dynamical Systems
A class of stochastic partial differential equations for interacting superprocesses on a bounded domain

Yanxia Ren,Renming Song,Hao Wang

DOI: https://doi.org/10.18910/10952

2009-01-01

Osaka journal of mathematics

Abstract:A class of interacting superprocesses on R, called superprocesses with dependent spatial motion (SDSMs), were introduced and studied in Wang [32] and Dawson et al. [9]. In the present paper, we extend this model to allow particles moving in a bounded domain in R(d) with killing boundary. We show that under a proper re-scaling, a class of discrete SPDEs for the empirical measure-valued processes generated by branching particle systems subject to the same white noise converge ill L(2)(Omega, F, P) to the SPDE for an SDSM on a bounded domain and the corresponding martingale problem for the SDSMs on a bounded domain is well-posed.
Stochastic Differential Equations with Multi-Markovian Switching

Meng Liu,Ke Wang

DOI: https://doi.org/10.1155/2013/357869

2013-01-01

Journal of Applied Mathematics

Abstract:This paper is concerned with stochastic differential equations (SDEs) with multi-Markovian switching. The existence and uniqueness of solution are investigated, and thepth moment of the solution is estimated. The classical theory of SDEs with single Markovian switching is extended.
Dealing with Stochasticity in Biological ODE Models

Hamda Ajmal,Michael Madden,Catherine Enright

DOI: https://doi.org/10.48550/arXiv.1910.04909

2019-10-14

Abstract:Mathematical modeling with Ordinary Differential Equations (ODEs) has proven to be extremely successful in a variety of fields, including biology. However, these models are completely deterministic given a certain set of initial conditions. We convert mathematical ODE models of three benchmark biological systems to Dynamic Bayesian Networks (DBNs). The DBN model can handle model uncertainty and data uncertainty in a principled manner. They can be used for temporal data mining for noisy and missing variables. We apply Particle Filtering algorithm to infer the model variables by re-estimating the models parameters of various biological ODE models. The model parameters are automatically re-estimated using temporal evidence in the form of data streams. The results show that DBNs are capable of inferring the model variables of the ODE model with high accuracy in situations where data is missing, incomplete, sparse and irregular and true values of model parameters are not known.

Machine Learning,Neural and Evolutionary Computing
Stochastic Differential Equation Driven by Countably Many Brownian Motions with Non-Lipschitzian Coefficients

ZX Liang

DOI: https://doi.org/10.1080/07362990600629017

2006-01-01

Stochastic Analysis and Applications

Abstract:We study m -dimensional SDE X-t = x(0) + Sigma(infinity)(i=1) integral(t)(0) sigma(i) (X-s) dW(s)(i) + integral(t)(0) b(X-s)ds, where {W-i)(i >= 1) is an infinite sequence of independent standard one-dimensional Brownian motions. Existence and pathwise uniqueness, non-explosion, and a Freidlin-Wentzell large deviations principle of strong solutions to the SDE are established under modulus of continuity of the coefficients is less than vertical bar x -y vertical bar (log(1)/((x - y)))(y), y epsilon [0, 1], which are different from that results constructed recently by Cao and He [2] and Fang and Zhang [6].
A Stochastic Differential Equation SIRS Epidemic Model with Ratio-Dependent Incidence Rate

Yongli Cai,Yun Kang,Weiming Wang,Min Zhao

2013-01-01

Abstract:In this paper we study global dynamics of a general SIRS epidemic model with a ratiodependent incidence rate and its corresponding stochastic differential equation version. For the deterministic model, we show that the disease reproduction number R 0 determines whether there is an endemic outbreak or not: the disease free dynamics occurs if R 0 ≤ 1 while the unique endemic steady state is globally stable if R 0 > 1. For the stochastic model, we show that its related reproduction number R S 0 can determine whether there is a unique disease-free stationary distribution or a unique endemic stationary distribution. In addition, we provide analytic results regarding the stochastic boundedness, permanence/extinction, asymptotic stability as well as its related ergodic properties. One of the most interesting findings is that random fluctuations introduced in our stochastic model can suppress disease outbreak, which can provide us some useful control strategies to regulate disease dynamics. Combining our analytical and numerical results, we conclude that different stochastic modeling approaches can have different dynamical outcomes. This provides us a caution when we derive the stochastic models from a given deterministic model.
Differential-Equation Constrained Optimization With Stochasticity

Qin Li,Li Wang,Yunan Yang

2024-03-11

Abstract:Most inverse problems from physical sciences are formulated as PDE-constrained optimization problems. This involves identifying unknown parameters in equations by optimizing the model to generate PDE solutions that closely match measured data. The formulation is powerful and widely used in many sciences and engineering fields. However, one crucial assumption is that the unknown parameter must be deterministic. In reality, however, many problems are stochastic in nature, and the unknown parameter is random. The challenge then becomes recovering the full distribution of this unknown random parameter. It is a much more complex task. In this paper, we examine this problem in a general setting. In particular, we conceptualize the PDE solver as a push-forward map that pushes the parameter distribution to the generated data distribution. This way, the SDE-constrained optimization translates to minimizing the distance between the generated distribution and the measurement distribution. We then formulate a gradient-flow equation to seek the ground-truth parameter probability distribution. This opens up a new paradigm for extending many techniques in PDE-constrained optimization to that for systems with stochasticity.

Optimization and Control,Numerical Analysis
Modeling and Prediction Using Stochastic Differential Equations

Rune Juhl,Jan Kloppenborg Møller,John Bagterp Jørgensen,Henrik Madsen

DOI: https://doi.org/10.1007/978-3-319-25913-0_10

2015-11-25

Abstract:Pharmacokinetic/pharmakodynamic (PK/PD) modeling for a single subject is most often performed using nonlinear models based on deterministic ordinary differential equations (ODEs), and the variation between subjects in a population of subjects is described using a population (mixed effects) setup that describes the variation between subjects. The ODE setup implies that the variation for a single subject is described by a single parameter (or vector), namely the variance (covariance) of the residuals. Furthermore the prediction of the states is given as the solution to the ODEs and hence assumed deterministic and can predict the future perfectly. A more realistic approach would be to allow for randomness in the model due to e.g., the model be too simple or errors in input. We describe a modeling and prediction setup which better reflects reality and suggests stochastic differential equations (SDEs) for modeling and forecasting. It is argued that this gives models and predictions which better reflect reality. The SDE approach also offers a more adequate framework for modeling and a number of efficient tools for model building. A software package (CTSM-R) for SDE-based modeling is briefly described.
Global Dynamics of McKean-Vlasov SDEs via Stochastic Order

Baoyou Qu,Jinxiang Yao,Yanpeng Zhi

2024-11-03

Abstract:This paper studies the rich dynamics of general one-dimensional McKean-Vlasov stochastic differential equations based on the preservation of stochastic order. The existing work is limited to the case of additive noises, while our framework allows multiplicative noises. When the equation has multiple invariant measures, we show basins of attraction of certain invariant measures contain unbounded open sets in the 2-Wasserstein space, which is vacant in previous research even for additive noises. Also, our main results target on total orderedness and finiteness of invariant measures, global convergence to order interval enclosed by two order-related invariant measures, alternating arrangement of invariant measures in terms of stability (locally attracting) and instability (connecting orbits). Our theorems cover a wide range of classical granular media equations, such as symmetric, flat-bottom and asymmetric double-well confinement potentials with quadratic interaction, multi-well landscapes, and double-well landscapes with perturbations. Specific values for the parameter ranges, explicit descriptions of attracting sets and phase diagrams are provided.

Probability,Dynamical Systems
Stochastic Modified Equations and Dynamics of Stochastic Gradient Algorithms I: Mathematical Foundations

Qianxiao Li,Cheng Tai,Weinan E

2018-01-01

Journal of Machine Learning Research

Abstract:We develop the mathematical foundations of the stochastic modified equations (SME) framework for analyzing the dynamics of stochastic gradient algorithms, where the latter is approximated by a class of stochastic differential equations with small noise parameters. We prove that this approximation can be understood mathematically as an weak approximation, which leads to a number of precise and useful results on the approximations of stochastic gradient descent (SGD), momentum SGD and stochastic Nesterov's accelerated gradient method in the general setting of stochastic objectives. We also demonstrate through explicit calculations that this continuous-time approach can uncover important analytical insights into the stochastic gradient algorithms under consideration that may not be easy to obtain in a purely discrete-time setting.

Relation of Biologically Motivated New Interpretation of

Relation of a New Interpretation of Stochastic Differential Equations to Ito Process

Data-driven discovery of stochastic differential equations

SDE Decomposition and A-type Stochastic Interpretation in Nonequilibrium Processes

Discovering stochastic dynamical equations from biological time series data

The physical mechanism of stochastic calculus in random walks

Varying-Coefficient Stochastic Differential Equations with Applications in Ecology

Statistical inference for stochastic differential equations

On Uniqueness of "SDE Decomposition" in A-type Stochastic Integration

Stability in Mean of Partial Variables for Stochastic Reaction-Diffusion Systems with Markovian Switching

A Stochastic SIS Epidemic Model with Ornstein-Uhlenbeck Process and Brown Motion

Dynamics of Stochastic Reaction-Diffusion Equations

A class of stochastic partial differential equations for interacting superprocesses on a bounded domain

Stochastic Differential Equations with Multi-Markovian Switching

Dealing with Stochasticity in Biological ODE Models

Stochastic Differential Equation Driven by Countably Many Brownian Motions with Non-Lipschitzian Coefficients

A Stochastic Differential Equation SIRS Epidemic Model with Ratio-Dependent Incidence Rate

Differential-Equation Constrained Optimization With Stochasticity

Modeling and Prediction Using Stochastic Differential Equations

Global Dynamics of McKean-Vlasov SDEs via Stochastic Order

Stochastic Modified Equations and Dynamics of Stochastic Gradient Algorithms I: Mathematical Foundations