Abstract:Consider the following two-person mixed strategy game of a probabilist against Nature with respect to the parameters $(f, \mathcal{B},\pi)$, where $f$ is a convex function satisfying certain regularity conditions, $\mathcal{B}$ is either the set $\{L_i\}_{i=1}^n$ or its convex hull with each $L_i$ being a Markov infinitesimal generator on a finite state space $\mathcal{X}$ and $\pi$ is a given positive discrete distribution on $\mathcal{X}$. The probabilist chooses a prior measure $\mu$ within the set of probability measures on $\mathcal{B}$ denoted by $\mathcal{P}(\mathcal{B})$ and picks a $L \in \mathcal{B}$ at random according to $\mu$, whereas Nature follows a pure strategy to select $M \in \mathcal{L}(\pi)$, the set of $\pi$-reversible Markov generators on $\mathcal{X}$. Nature pays an amount $D_f(M||L)$, the $f$-divergence from $L$ to $M$, to the probabilist. We prove that a mixed strategy Nash equilibrium always exists, and establish a minimax result on the expected payoff of the game. This also contrasts with the pure strategy version of the game where we show a Nash equilibrium may not exist. To find approximately a mixed strategy Nash equilibrium, we propose and develop a simple projected subgradient algorithm that provably converges with a rate of $\mathcal{O}(1/\sqrt{t})$, where $t$ is the number of iterations. In addition, we elucidate the relationships of Nash equilibrium with other seemingly disparate notions such as weighted information centroid, Chebyshev center and Bayes risk. This article generalizes the two-person game of a statistician against Nature developed in the literature, and highlights the powerful interplay and synergy between modern Markov chains theory and geometry, information theory, game theory, optimization and mathematical statistics.

Nash equilibria for total expected reward absorbing Markov games: the constrained and unconstrained cases

Nash Equilibria for Total Expected Reward Absorbing Markov Games: The Constrained and Unconstrained Cases

Distributed Generalized Nash Equilibrium Seeking: An Operator-Theoretic Perspective

Nash equilibrium with Sugeno payoff

On Nash-solvability of n-person graphical games under Markov's and a priori realizations

Nash Equilibrium Existence without Convexity

Nash Equilibrium in Games on Graphs with Incomplete Preferences

Markov chain entropy games and the geometry of their Nash equilibria

Differential N-players game: Nash equilibria and Mather measures

The Existence and Uniqueness of a Nash Equilibrium in Mean Field Game Theory

Strong Nash equilibria and mixed strategies

Nash Equilibria for Stochastic Games with Asymmetric Information-Part 1: Finite Games

Mixed-strategy Nash equilibrium for a discontinuous symmetric $N$-player game

Learning Nash Equilibria in Zero-Sum Markov Games: A Single Time-scale Algorithm Under Weak Reachability

Nash, Conley, and Computation: Impossibility and Incompleteness in Game Dynamics

Randomness Requirements and Asymmetries in Nash Equilibria

Strong and safe Nash equilibrium in some repeated 3-player games

Markov-Nash equilibria in mean-field games under model uncertainty

Learning Stationary Nash Equilibrium Policies in [math]-Player Stochastic Games with Independent Chains

Stationary Almost Markov ε-Equilibria for Discounted Stochastic Games with Borel Spaces and Unbounded Payoffs

Nash Equilibria of Two-Player Matrix Games Repeated Until Collision