Equilibria in Repeated Games with Countably Many Players and Tail-Measurable Payoffs

Galit Ashkenazi-Golan,Janos Flesch,Arkadi Predtetchinski,Eilon Solan

DOI: https://doi.org/10.48550/arXiv.2106.03975

2021-06-08

Abstract:We prove that every repeated game with countably many players, finite action sets, and tail-measurable payoffs admits an $\epsilon$-equilibrium, for every $\epsilon > 0$.

Optimization and Control,Computer Science and Game Theory

What problem does this paper attempt to address?

Repeated Games with Tail-Measurable Payoffs

János Flesch,Eilon Solan

DOI: https://doi.org/10.48550/arXiv.2205.12164

2022-05-24

Abstract:We study multiplayer Blackwell games, which are repeated games where the payoff of each player is a bounded and Borel-measurable function of the infinite stream of actions played by the players during the game. These games are an extension of the two-player perfect-information games studied by David Gale and Frank Stewart (1953). Recently, various new ideas have been discovered to study Blackwell games. In this paper, we give an overview of these ideas by proving, in four different ways, that Blackwell games with a finite number of players, finite action sets, and tail-measurable payoffs admit an $\varepsilon$-equilibrium, for all $\varepsilon>0$.

Optimization and Control,Logic
Uniformly strict equilibrium for repeated games with private monitoring and communication

Richard McLean,Ichiro Obara,Andrew Postlewaite

DOI: https://doi.org/10.1007/s00199-024-01561-0

2024-03-30

Economic Theory

Abstract:Cooperation through repetition is an important theme in game theory. In this regard, various celebrated "folk theorems" have been proposed for repeated games in increasingly more complex environments. There has, however, been insufficient attention paid to the robustness of a large set of equilibria that is needed for such folk theorems. Starting with perfect public equilibrium as our starting point, we study uniformly strict equilibria in repeated games with private monitoring and direct communication (cheap talk). We characterize the limit equilibrium payoff set and identify the conditions for the folk theorem to hold with uniformly strict equilibrium.

economics
An Anti-Folk Theorem for Large Repeated Games with Imperfect Monitoring

Mallesh M. Pai,Aaron Roth,Jonathan Ullman

DOI: https://doi.org/10.48550/arXiv.1402.2801

2014-10-09

Abstract:We study infinitely repeated games in settings of imperfect monitoring. We first prove a family of theorems that show that when the signals observed by the players satisfy a condition known as $(\epsilon, \gamma)$-differential privacy, that the folk theorem has little bite: for values of $\epsilon$ and $\gamma$ sufficiently small, for a fixed discount factor, any equilibrium of the repeated game involve players playing approximate equilibria of the stage game in every period. Next, we argue that in large games ($n$ player games in which unilateral deviations by single players have only a small impact on the utility of other players), many monitoring settings naturally lead to signals that satisfy $(\epsilon,\gamma)$-differential privacy, for $\epsilon$ and $\gamma$ tending to zero as the number of players $n$ grows large. We conclude that in such settings, the set of equilibria of the repeated game collapse to the set of equilibria of the stage game.

Computer Science and Game Theory,Data Structures and Algorithms
Infinitely split Nash equilibrium problems in repeated games

Jinlu Li

DOI: https://doi.org/10.1186/s13663-018-0636-1

2018-04-23

Fixed Point Theory and Applications

Abstract:In this paper, we introduce the concept of infinitely split Nash equilibrium in repeated games in which the profile sets are chain-complete posets. Then by using a fixed point theorem on posets in (J. Math. Anal. Appl. 409:1084–1092, 2014), we prove an existence theorem. As an application, we study the repeated extended Bertrant duopoly model of price competition.
Equilibrium Behaviors in Repeated Games

Yingkai Li,Harry Pei

DOI: https://doi.org/10.48550/arXiv.2007.14002

2021-02-11

Abstract:We examine a patient player's behavior when he can build reputations in front of a sequence of myopic opponents. With positive probability, the patient player is a commitment type who plays his Stackelberg action in every period. We characterize the patient player's action frequencies in equilibrium. Our results clarify the extent to which reputations can refine the patient player's behavior and provide new insights to entry deterrence, business transactions, and capital taxation. Our proof makes a methodological contribution by establishing a new concentration inequality.

Theoretical Economics
Equilibria in Repeated Games under No-Regret with Dynamic Benchmarks

Ludovico Crippa,Yonatan Gur,Bar Light

2023-07-24

Abstract:In repeated games, strategies are often evaluated by their ability to guarantee the performance of the single best action that is selected in hindsight, a property referred to as \emph{Hannan consistency}, or \emph{no-regret}. However, the effectiveness of the single best action as a yardstick to evaluate strategies is limited, as any static action may perform poorly in common dynamic settings. Our work therefore turns to a more ambitious notion of \emph{dynamic benchmark consistency}, which guarantees the performance of the best \emph{dynamic} sequence of actions, selected in hindsight subject to a constraint on the allowable number of action changes. Our main result establishes that for any joint empirical distribution of play that may arise when all players deploy no-regret strategies, there exist dynamic benchmark consistent strategies such that if all players deploy these strategies the same empirical distribution emerges when the horizon is large enough. This result demonstrates that although dynamic benchmark consistent strategies have a different algorithmic structure and provide significantly enhanced individual assurances, they lead to the same equilibrium set as no-regret strategies. Moreover, the proof of our main result uncovers the capacity of independent algorithms with strong individual guarantees to foster a strong form of coordination.

Computer Science and Game Theory,Theoretical Economics
Strong and safe Nash equilibrium in some repeated 3-player games

Tadeusz Kufel,Sławomir Plaskacz,Joanna Zwierzchowska

DOI: https://doi.org/10.48550/arXiv.1711.10929

2018-05-15

Abstract:We consider a 3-player game in the normal form, in which each player has two actions. We assume that the game is symmetric and repeated infinitely many times. At each stage players make their choices knowing only the average payoffs from previous stages of all the players. A strategy of a player in the repeated game is a function defined on the convex hull of the set of payoffs. Our aim is to construct a strong Nash equilibrium in the repeated game, i.e. a strategy profile being resistant to deviations by coalitions. Constructed equilibrium strategies are safe, i.e. the non-deviating player payoff is not smaller than the equilibrium payoff in the stage game, and deviating players' payoffs do not exceed the non-deviating player payoff more than a positive constant which can be arbitrary small and chosen by the non-deviating player. Our construction is inspired by Smale's good strategies described in \cite{smale}, where the repeated Prisoner's Dilemma was considered. In proofs we use arguments based on approachability and strong approachability type results.

Optimization and Control
Nash, Conley, and Computation: Impossibility and Incompleteness in Game Dynamics

Jason Milionis,Christos Papadimitriou,Georgios Piliouras,Kelly Spendlove

DOI: https://doi.org/10.48550/arXiv.2203.14129

2022-03-26

Computer Science and Game Theory

Abstract:Under what conditions do the behaviors of players, who play a game repeatedly, converge to a Nash equilibrium? If one assumes that the players' behavior is a discrete-time or continuous-time rule whereby the current mixed strategy profile is mapped to the next, this becomes a problem in the theory of dynamical systems. We apply this theory, and in particular the concepts of chain recurrence, attractors, and Conley index, to prove a general impossibility result: there exist games for which any dynamics is bound to have starting points that do not end up at a Nash equilibrium. We also prove a stronger result for $\epsilon$-approximate Nash equilibria: there are games such that no game dynamics can converge (in an appropriate sense) to $\epsilon$-Nash equilibria, and in fact the set of such games has positive measure. Further numerical results demonstrate that this holds for any $\epsilon$ between zero and $0.09$. Our results establish that, although the notions of Nash equilibria (and its computation-inspired approximations) are universally applicable in all games, they are also fundamentally incomplete as predictors of long term behavior, regardless of the choice of dynamics.
Playing repeated games with sublinear randomness

Farid Arthaud

2023-12-21

Abstract:We study the amount of entropy players asymptotically need to play a repeated normal-form game in a Nash equilibrium. Hubáček, Naor, and Ullman (SAGT'15, TCSys'16) gave sufficient conditions on a game for the minimal amount of randomness required to be $O(1)$ or $\Omega(n)$ for all players, where $n$ is the number of repetitions. We provide a complete characterization of games in which there exists Nash equilibria of the repeated game using $O(1)$ randomness, closing an open question posed by Budinich and Fortnow (EC'11) and Hubáček, Naor, and Ullman. Moreover, we show a 0--1 law for randomness in repeated games, showing that any repeated game either has $O(1)$-randomness Nash equilibria, or all of its Nash equilibria require $\Omega(n)$ randomness. Our techniques are general and naturally characterize the payoff space of sublinear-entropy equilibria, and could be of independent interest to the study of players with other bounded capabilities in repeated games.

Computer Science and Game Theory
Empirical Distribution of Equilibrium Play and Its Testing Application

Yakov Babichenko,Siddharth Barman,Ron Peretz

DOI: https://doi.org/10.1287/moor.2016.0794

IF: 2.215

2017-01-01

Mathematics of Operations Research

Abstract:We show that in any n-player, m-action normal-form game, we can obtain an approximate equilibrium by sampling any mixed-action equilibrium a small number of times. We study three types of equilibria: Nash, correlated, and coarse-correlated. For each one we obtain upper and lower bounds on the number of samples required for the empirical distribution over the sampled action profiles to form an approximate equilibrium with probability close to 1. These bounds imply that using a small number of samples we can test whether or not players are playing according to an approximate equilibrium, even in games where n and m are large. In addition, our results substantially improve previously known upper bounds on the support size of approximate equilibria in games with many players. In particular, for the three types of equilibria we show the existence of approximate equilibrium with support-size polylogarithmic in n and m, whereas the previously best-known upper bounds were polynomial in n (Hémon et al. [Hémon S, de Rougemont M, Santha M (2008) Approximate nash equilibria for multi-player games. Algorithmic Game Theory (Springer), 267–278], Germano and Lugosi [Germano F, Lugosi G (2007) Existence of sparsely supported correlated equilibria. Econom. Theory 32(3):575–578], Hart et al. [Hart S, Mas-Colell A, Babichenko Y (2013) Simple Adaptive Strategies: From Regret-Matching to Uncoupled Dynamics, Vol. 4 (World Scientific Publishing Company)]).

mathematics, applied,operations research & management science
Nash Equilibria for Total Expected Reward Absorbing Markov Games: The Constrained and Unconstrained Cases

François Dufour,Tomás Prieto-Rumeau

DOI: https://doi.org/10.1007/s00245-023-10095-1

2024-01-18

Applied Mathematics & Optimization

Abstract:We consider a nonzero-sum N -player Markov game on an abstract measurable state space with compact metric action spaces. The payoff functions are bounded Carathéodory functions and the transitions of the system are assumed to have a density function satisfying some continuity conditions. The optimality criterion of the players is given by a total expected payoff on an infinite discrete-time horizon. Under the condition that the game model is absorbing, we establish the existence of Markov strategies that are a noncooperative equilibrium in the family of all history-dependent strategies of the players for both the constrained and the unconstrained problems. We obtain, as a particular case of our results, the existence of Nash equilibria for discounted constrained and unconstrained game models.

mathematics, applied
Bounded Computational Capacity Equilibrium

Penelope Hernandez,Eilon Solan

DOI: https://doi.org/10.48550/arXiv.1008.2632

2010-08-16

Abstract:We study repeated games played by players with bounded computational power, where, in contrast to Abreu and Rubisntein (1988), the memory is costly. We prove a folk theorem: the limit set of equilibrium payoffs in mixed strategies, as the cost of memory goes to 0, includes the set of feasible and individually rational payoffs. This result stands in sharp contrast to Abreu and Rubisntein (1988), who proved that when memory is free, the set of equilibrium payoffs in repeated games played by players with bounded computational power is a strict subset of the set of feasible and individually rational payoffs. Our result emphasizes the role of memory cost and of mixing when players have bounded computational power.

Probability,Optimization and Control
The Truth Behind the Myth of the Folk Theorem

Joseph Y. Halpern,Rafael Pass,Lior Seeman

DOI: https://doi.org/10.48550/arXiv.1312.1017

2015-03-21

Abstract:We study the problem of computing an $\epsilon$-Nash equilibrium in repeated games. Earlier work by Borgs et al. [2010] suggests that this problem is intractable. We show that if we make a slight change to their model---modeling the players as polynomial-time Turing machines that maintain state ---and make some standard cryptographic hardness assumptions (the existence of public-key encryption), the problem can actually be solved in polynomial time. Our algorithm works not only for games with a finite number of players, but also for constant-degree graphical games. As Nash equilibrium is a weak solution concept for extensive form games, we additionally define and study an appropriate notion of a subgame-perfect equilibrium for computationally bounded players, and show how to efficiently find such an equilibrium in repeated games (again, making standard cryptographic hardness assumptions).

Computer Science and Game Theory
Safe Equilibrium

Sam Ganzfried

2023-08-21

Abstract:The standard game-theoretic solution concept, Nash equilibrium, assumes that all players behave rationally. If we follow a Nash equilibrium and opponents are irrational (or follow strategies from a different Nash equilibrium), then we may obtain an extremely low payoff. On the other hand, a maximin strategy assumes that all opposing agents are playing to minimize our payoff (even if it is not in their best interest), and ensures the maximal possible worst-case payoff, but results in exceedingly conservative play. We propose a new solution concept called safe equilibrium that models opponents as behaving rationally with a specified probability and behaving potentially arbitrarily with the remaining probability. We prove that a safe equilibrium exists in all strategic-form games (for all possible values of the rationality parameters), and prove that its computation is PPAD-hard. We present exact algorithms for computing a safe equilibrium in both 2 and $n$-player games, as well as scalable approximation algorithms.

Computer Science and Game Theory,Artificial Intelligence,Cryptography and Security,Multiagent Systems,Theoretical Economics
Payoff Control in Repeated Games

Renfei Tan,Qi Su,Bin Wu,Long Wang

DOI: https://doi.org/10.48550/arXiv.2108.12644

2021-08-28

Abstract:Evolutionary game theory is a powerful mathematical framework to study how intelligent individuals adjust their strategies in collective interactions. It has been widely believed that it is impossible to unilaterally control players' payoffs in games, since payoffs are jointly determined by all players. Until recently, a class of so-called zero-determinant strategies are revealed, which enables a player to make a unilateral payoff control over her partners in two-action repeated games with a constant continuation probability. The existing methods, however, lead to the curse of dimensionality when the complexity of games increases. In this paper, we propose a new mathematical framework to study ruling strategies (with which a player unilaterally makes a linear relation rule on players' payoffs) in repeated games with an arbitrary number of actions or players, and arbitrary continuation probability. We establish an existence theorem of ruling strategies and develop an algorithm to find them. In particular, we prove that strict Markov ruling strategy exists only if either the repeated game proceeds for an infinite number of rounds, or every round is repeated with the same probability. The proposed mathematical framework also enables the search of collaborative ruling strategies for an alliance to control outsiders. Our method provides novel theoretical insights into payoff control in complex repeated games, which overcomes the curse of dimensionality.

Optimization and Control,Populations and Evolution
Characterizing the Feasible Payoff Set of OLG Repeated Games

Daehyun Kim,Chihiro Morooka

DOI: https://doi.org/10.48550/arXiv.2303.12988

2024-12-08

Abstract:We study the set of (stationary) feasible payoffs of OLG repeated games that can be achieved by action sequences in which every generation of players plays the same sequence of action profiles. Our first main result completely characterizes the set of feasible payoffs given any fixed discount factor of players and the length of interaction. We can use this result to obtain the feasible payoff set in closed form. Second, we provide novel comparative statics of the feasible payoff set with respect to the discount factor and the length of interaction. Perhaps interestingly, the feasible payoff set becomes smaller as players' discount factor becomes larger. In addition, we identify a necessary and sufficient condition for this monotonicity to be strict.

Theoretical Economics
A folk theorem for repeated games with unequal discounting.

Bo Chen,Satoru Takahashi

DOI: https://doi.org/10.1016/j.geb.2012.07.011

IF: 1.265

2012-01-01

Games and Economic Behavior

Abstract:We introduce a “dynamic non-equivalent utilities” (DNEU) condition and the notion of dynamic player-specific punishments for a general repeated game with unequal discounting, both naturally generalizing the stationary counterparts in Abreu et al. (1994). We show that if the DNEU condition, i.e., no pair of players have equivalent utility functions in the repeated game, is satisfied, then any feasible and strictly sequentially individually rational payoff sequence allows dynamic player-specific punishments. Using this result, we prove a folk theorem for unequal discounting repeated games that satisfy the DNEU condition.
Emergence of Locally Suboptimal Behavior in Finitely Repeated Games

Yichen Yang,Martin Rinard

DOI: https://doi.org/10.48550/arXiv.2303.16806

2023-03-29

Abstract:We study the emergence of locally suboptimal behavior in finitely repeated games. Locally suboptimal behavior refers to players play suboptimally in some rounds of the repeated game (i.e., not maximizing their payoffs in those rounds) while maximizing their total payoffs in the whole repeated game. The central research question we aim to answer is when locally suboptimal behavior can arise from rational play in finitely repeated games. In this research, we focus on the emergence of locally suboptimal behavior in subgame-perfect equilibria (SPE) of finitely repeated games with complete information. We prove the first sufficient and necessary condition on the stage game G that ensure that, for all T and all subgame-perfect equilibria of the repeated game G(T), the strategy profile at every round of G(T) forms a Nash equilibrium of the stage game G. We prove the sufficient and necessary conditions for three cases: 1) only pure strategies are allowed, 2) the general case where mixed strategies are allowed, and 3) one player can only use pure strategies and the other player can use mixed strategies. Based on these results, we obtain complete characterizations on when allowing players to play mixed strategies will change whether local suboptimality can ever occur in some repeated game. Furthermore, we present an algorithm for the computational problem of, given an arbitrary stage game, deciding if locally suboptimal behavior can arise in the corresponding finitely repeated games. This addresses the practical side of the research question.

Computer Science and Game Theory
Uncoupled Learning Rules for Seeking Equilibria in Repeated Plays: An Overview

M. Sadegh Talebi

DOI: https://doi.org/10.48550/arXiv.1310.5660

2013-10-22

Abstract:In this note, we consider repeated play of a finite game using learning rules whose period-by-period behavior probabilities or empirical distributions converge to some notion of equilibria of the stage game. Our primary focus is on uncoupled and completely uncoupled learning rules. While the former relies on players being aware of only their own payoff functions and able to monitor the action taken by the others, the latter assumes that players only know their own past realized payoffs. We highlight the border between possible and impossible results using these rules. We also overview several uncoupled and completely uncoupled learning rules, most of which leverage notions of regret as the solution concept to seek payoff-improving action profiles.

Computer Science and Game Theory

Equilibria in Repeated Games with Countably Many Players and Tail-Measurable Payoffs

Repeated Games with Tail-Measurable Payoffs

Uniformly strict equilibrium for repeated games with private monitoring and communication

An Anti-Folk Theorem for Large Repeated Games with Imperfect Monitoring

Infinitely split Nash equilibrium problems in repeated games

Equilibrium Behaviors in Repeated Games

Equilibria in Repeated Games under No-Regret with Dynamic Benchmarks

Strong and safe Nash equilibrium in some repeated 3-player games

Nash, Conley, and Computation: Impossibility and Incompleteness in Game Dynamics

Playing repeated games with sublinear randomness

Empirical Distribution of Equilibrium Play and Its Testing Application

Nash Equilibria for Total Expected Reward Absorbing Markov Games: The Constrained and Unconstrained Cases

Bounded Computational Capacity Equilibrium

The Truth Behind the Myth of the Folk Theorem

Safe Equilibrium

Payoff Control in Repeated Games

Characterizing the Feasible Payoff Set of OLG Repeated Games

A folk theorem for repeated games with unequal discounting.

Emergence of Locally Suboptimal Behavior in Finitely Repeated Games

Uncoupled Learning Rules for Seeking Equilibria in Repeated Plays: An Overview