General nonlinear stochastic systems motivated by chemostat models: Complete characterization of long-time behavior, optimal controls, and applications to wastewater treatment

Dang H. Nguyen,Nhu N. Nguyen,George Yin
DOI: https://doi.org/10.1016/j.spa.2020.01.010
IF: 1.43
2020-08-01
Stochastic Processes and their Applications
Abstract:<p>This paper focuses on a general class of systems of nonlinear stochastic differential equations, inspired by stochastic chemostat models. In the first part, the system is formulated as a hybrid switching diffusion. A complete characterization of the asymptotic behavior of the system under consideration is provided. It is shown that the long-term properties of the system can be classified by using a real-valued parameter <span class="math"><math>λ</math></span>. If <span class="math"><math>λ≤0</math></span>, the bacteria will die out, which means that the process does not operate. If <span class="math"><math>λ&gt;0</math></span>, the system has an invariant probability measure and the transition probability of the solution process converges to that of the invariant measure. The rate of convergence is also obtained. One of the distinct features of this paper is that the critical case <span class="math"><math>λ=0</math></span> is also considered. Moreover, numerical examples are given to illustrate our results. In the second part of the paper, controlled diffusions with a long-run average objective function are treated. The associated Hamilton–Jacobi-Bellman (HJB) equation is derived and the existence of an optimal Markov control is established. The techniques and methods of analysis in this paper can be applied to many other stochastic Kolmogorov systems.</p>
statistics & probability
What problem does this paper attempt to address?