Distributed Discrete-time Nash Equilibrium Seeking with Markovian Switching Topologies

Xiao Fang,Guanghui Wen,Kaijie Zhang,Maojiao Ye
DOI: https://doi.org/10.1109/ssci44817.2019.9002920
2019-01-01
Abstract:This paper develops a distributed discrete-time algorithm to seek Nash equilibrium for games under Markovian switching topologies. In the game problem considered in this paper, all players are assumed to use gradient-like descent method to update their own actions based on the estimation of all the other players' actions with the intention to minimize their cost functions. All players exchange their estimation information with their neighbors at each discrete time instant through some undirected graphs that are Markovian switching. Suppose that the transition probability matrix is specified and the union of all switching topologies is connected, it is shown that the players' actions can converge to the unique Nash equilibrium in the mean square sense for any initial condition. The convergence result is established by utilizing Lyapunov stability theory for discrete-time stochastic systems.
What problem does this paper attempt to address?