Controlled Martingale Problems And Their Markov Mimics

Siva Athreya,Vivek S. Borkar,Nitya Gadhiwala
2023-09-01
Abstract:In this article we prove under suitable assumptions that the marginals of any solution to a relaxed controlled martingale problem on a Polish space $E$ can be mimicked by a Markovian solution of a Markov-relaxed controlled martingale problem. We also show how such `Markov mimics' can be obtained by relative entropy minimisation. We provide many examples where the above results can be applied.
Probability,Information Theory,Optimization and Control
What problem does this paper attempt to address?