Invariant Distributions in Nonlinear Markov Chains with an Aggregator: Theory and Applications

Bar Light
2024-11-02
Abstract:We study the properties of a subclass of stochastic processes called discrete-time nonlinear Markov chains with an aggregator. In these chains, the next period's distribution depends on both the current state and a real-valued function of the current distribution. For these chains, we provide conditions for the uniqueness of an invariant distribution that do not rely on typical contraction arguments. Instead, our approach leverages flexible monotonicity properties imposed on the nonlinear Markov kernel. We also provide existence results and introduce a straightforward computational method for finding the invariant distribution. We demonstrate the necessity of these monotonicity conditions in proving the uniqueness of an invariant distribution through simple examples. We apply our findings to analyze invariant distributions in strategic queueing systems, establish conditions under which a class of nonlinear equations in $\mathbb{R}^{n}$ has a unique solution, and examine the properties of stationary wealth distributions in large dynamic economies.
Probability
What problem does this paper attempt to address?