On the irreducibility and convergence of a class of nonsmooth nonlinear state-space models on manifolds

Armand Gissler,Alain Durmus,Anne Auger
2024-02-09
Abstract:In this paper, we analyze a large class of general nonlinear state-space models on a state-space X, defined by the recursion $\phi_{k+1} = F(\phi_k,\alpha(\phi_k,U_{k+1}))$, $k \in\bN$, where $F,\alpha$ are some functions and $\{U_{k+1}\}_{k\in\bN}$ is a sequence of i.i.d. random variables. More precisely, we extend conditions under which this class of Markov chains is irreducible, aperiodic and satisfies important continuity properties, relaxing two key assumptions from prior works. First, the state-space X is supposed to be a smooth manifold instead of an open subset of a Euclidean space. Second, we only suppose that $F is locally Lipschitz continuous.
Optimization and Control,Probability
What problem does this paper attempt to address?