Strategies in deterministic totally-ordered-time games

Tomohiko Kawamori

DOI: https://doi.org/10.48550/arXiv.2211.03398

2022-11-07

Theoretical Economics

Abstract:We consider deterministic totally-ordered-time games. We present three axioms for strategies. We show that for any tuple of strategies that satisfy the axioms, there exists a unique complete history that is consistent with the strategy tuple.

What problem does this paper attempt to address?

On the implementation of zero-determinant strategies in repeated games

Masahiko Ueda

2024-05-15

Abstract:Zero-determinant strategies are a class of strategies in repeated games which unilaterally control payoffs. Zero-determinant strategies have attracted much attention in studies of social dilemma, particularly in the context of evolution of cooperation. So far, not only general properties of zero-determinant strategies have been investigated, but zero-determinant strategies have been applied to control in the fields of information and communications technology and analysis of imitation. Here, we further deepen our understanding on general mathematical properties of zero-determinant strategies. We first prove that zero-determinant strategies, if exist, can be implemented by some one-dimensional transition probability. Next, we prove that, if a two-player game has a non-trivial potential function, a zero-determinant strategy exists in its repeated version. These results assist us to implement zero-determinant strategies in broader situations.

Statistical Mechanics,Computer Science and Game Theory,Systems and Control,Physics and Society
Different Strokes in Randomised Strategies: Revisiting Kuhn's Theorem under Finite-Memory Assumptions

James C. A. Main,Mickael Randour

2024-11-22

Abstract:Two-player (antagonistic) games on (possibly stochastic) graphs are a prevalent model in theoretical computer science, notably as a framework for reactive synthesis. Optimal strategies may require randomisation when dealing with inherently probabilistic goals, balancing multiple objectives, or in contexts of partial information. There is no unique way to define randomised strategies. For instance, one can use so-called mixed strategies or behavioural ones. In the most general setting, these two classes do not share the same expressiveness. A seminal result in game theory -- Kuhn's theorem -- asserts their equivalence in games of perfect recall. This result crucially relies on the possibility for strategies to use infinite memory, i.e., unlimited knowledge of all past observations. However, computer systems are finite in practice. Hence it is pertinent to restrict our attention to finite-memory strategies, defined as automata with outputs. Randomisation can be implemented in these in different ways: the initialisation, outputs or transitions can be randomised or deterministic respectively. Depending on which aspects are randomised, the expressiveness of the corresponding class of finite-memory strategies differs. In this work, we study two-player concurrent stochastic games and provide a complete taxonomy of the classes of finite-memory strategies obtained by varying which of the three aforementioned components are randomised. Our taxonomy holds in games of perfect and imperfect information with perfect recall, and in games with more than two players. We also provide an adapted taxonomy for games with imperfect recall.

Computer Science and Game Theory,Formal Languages and Automata Theory,Logic in Computer Science
Optimal Time-Abstract Schedulers for CTMDPs and Markov Games

Markus Rabe,Sven Schewe

DOI: https://doi.org/10.4204/EPTCS.28.10

2010-06-26

Abstract:We study time-bounded reachability in continuous-time Markov decision processes for time-abstract scheduler classes. Such reachability problems play a paramount role in dependability analysis and the modelling of manufacturing and queueing systems. Consequently, their analysis has been studied intensively, and techniques for the approximation of optimal control are well understood. From a mathematical point of view, however, the question of approximation is secondary compared to the fundamental question whether or not optimal control exists. We demonstrate the existence of optimal schedulers for the time-abstract scheduler classes for all CTMDPs. Our proof is constructive: We show how to compute optimal time-abstract strategies with finite memory. It turns out that these optimal schedulers have an amazingly simple structure - they converge to an easy-to-compute memoryless scheduling policy after a finite number of steps. Finally, we show that our argument can easily be lifted to Markov games: We show that both players have a likewise simple optimal strategy in these more general structures.

Formal Languages and Automata Theory
Deterministic monotone dynamics and dominated strategies

Yannick Viossat

DOI: https://doi.org/10.48550/arXiv.1110.6246

2011-10-28

Abstract:We survey and unify results on elimination of dominated strategies by monotonic dynamics and prove some new results that may be seen as dual to those of Hofbauer and Weibull (J. Econ. Theory, 1996, 558-573) on convex monotonic dynamics.

Optimization and Control,Classical Analysis and ODEs
Game Characterizations of Timed Relations for Timed Automata Processes

Shibashis Guha,Shankara Narayanan Krishna

DOI: https://doi.org/10.48550/arXiv.1206.6565

2012-06-28

Abstract:In this work, we design the game semantics for timed equivalences and preorders of timed processes. The timed games corresponding to the various timed relations form a hierarchy. These games are similar to Stirling's bisimulation games. If it is the case that the existence of a winning strategy for the defender in a game ${\cal G}_1$ implies that there exists a winning strategy for the defender in another game ${\cal G}_2$, then the relation that corresponds to ${\cal G}_1$ is stronger than the relation corresponding to ${\cal G}_2$. The game hierarchy also throws light into several timed relations that are not considered in this paper.

Formal Languages and Automata Theory,Logic in Computer Science
Strategic Dominance: A New Preorder for Nondeterministic Processes

Thomas A. Henzinger,Nicolas Mazzocchi,N. Ege Saraç

2024-07-15

Abstract:We study the following refinement relation between nondeterministic state-transition models: model B strategically dominates model A iff every deterministic refinement of A is language contained in some deterministic refinement of B. While language containment is trace inclusion, and the (fair) simulation preorder coincides with tree inclusion, strategic dominance falls strictly between the two and can be characterized as "strategy inclusion" between A and B: every strategy that resolves the nondeterminism of A is dominated by a strategy that resolves the nondeterminism of B. Strategic dominance can be checked in 2-ExpTime by a decidable first-order Presburger logic with quantification over words and strategies, called resolver logic. We give several other applications of resolver logic, including checking the co-safety, co-liveness, and history-determinism of boolean and quantitative automata, and checking the inclusion between hyperproperties that are specified by nondeterministic boolean and quantitative automata.

Logic in Computer Science
Linear algebraic structure of zero-determinant strategies in repeated games

Masahiko Ueda,Toshiyuki Tanaka

DOI: https://doi.org/10.1371/journal.pone.0230973

2020-03-17

Abstract:Zero-determinant (ZD) strategies, a recently found novel class of strategies in repeated games, has attracted much attention in evolutionary game theory. A ZD strategy unilaterally enforces a linear relation between average payoffs of players. Although existence and evolutional stability of ZD strategies have been studied in simple games, their mathematical properties have not been well-known yet. For example, what happens when more than one players employ ZD strategies have not been clarified. In this paper, we provide a general framework for investigating situations where more than one players employ ZD strategies in terms of linear algebra. First, we theoretically prove that a set of linear relations of average payoffs enforced by ZD strategies always has solutions, which implies that incompatible linear relations are impossible. Second, we prove that linear payoff relations are independent of each other under some conditions. These results hold for general games with public monitoring including perfect-monitoring games. Furthermore, we provide a simple example of a two-player game in which one player can simultaneously enforce two linear relations, that is, simultaneously control her and her opponent's average payoffs. All of these results elucidate general mathematical properties of ZD strategies.

Computer Science and Game Theory,Statistical Mechanics,Physics and Society
Partial-Observation Stochastic Games: How to Win When Belief Fails

Krishnendu Chatterjee,Laurent Doyen

DOI: https://doi.org/10.1109/lics.2012.28

2012-06-01

Abstract:We consider two-player stochastic games played on finite graphs with reachability objectives where the first player tries to ensure a target state to be visited almost-surely (i.e., with probability 1), or positively (i.e., with positive probability), no matter the strategy of the second player. We classify such games according to the information and the power of randomization available to the players. On the basis of information, the game can be one-sided with either (a) player 1, or (b) player 2 having partial observation (and the other player has perfect observation), or two-sided with (c) both players having partial observation. On the basis of randomization, the players (a) may not be allowed to use randomization (pure strategies), or (b) may choose a probability distribution over actions but the actual random choice is external and not visible to the player (actions invisible), or (c) may use full randomization. Our main results for pure strategies are as follows. (1) For one-sided games with player 1 having partial observation we show that (in contrast to full randomized strategies) belief-based (subset-construction based) strategies are not sufficient, and we present an exponential upper bound on memory both for almostsure and positive winning strategies; we show that the problem of deciding the existence of almost-sure and positive winning strategies for player 1 is EXPTIME-complete. (2) For one-sided games with player 2 having partial observation we show that non-elementary memory is both necessary and sufficient for both almost-sure and positive winning strategies. (3) We show that for the general (two-sided) case finite-memory strategies are sufficient for both positive and almost-sure winning, and at least non-elementary memory is required. We establish the equivalence of the almost-sure winning problems for pure strategies and for randomized strategies with actions invisible. Our equivalence result exhibits serious flaws in previous results of the literature: we show a non-elementary memory lower bound for almost-sure winning whereas an exponential upper bound was previously claimed.
TSO Games -- On the decidability of safety games under the total store order semantics

Stephan Spengler,Sanchari Sil

DOI: https://doi.org/10.4204/EPTCS.390.6

2023-10-02

Abstract:We consider an extension of the classical Total Store Order (TSO) semantics by expanding it to turn-based 2-player safety games. During her turn, a player can select any of the communicating processes and perform its next transition. We consider different formulations of the safety game problem depending on whether one player or both of them transfer messages from the process buffers to the shared memory. We give the complete decidability picture for all the possible alternatives.

Computer Science and Game Theory
Zero-determinant strategies of multi-player multi-action repeated games with multiple memories

Yanfei Wang,Changxi Li,Jun-e Feng

DOI: https://doi.org/10.1016/j.sysconle.2024.105727

IF: 2.742

2024-01-24

Systems & Control Letters

Abstract:This paper investigates zero-determinant (ZD) strategies for iterated multi-player multi-action games with multiple memories. First, using the semi-tensor product (STP) of matrices, an equivalent algebraic model for the iterated game is proposed. Based on the algebraic expression, ZD strategies are derived for repeated finite games with multiple memories, allowing players to unilaterally apply a linear relationship among their augmented expected payoffs regardless of their opponents' strategies. Furthermore, ZD strategies for repeated symmetric and skew-symmetric games are considered, based on which the coupling correlations among players' payoffs, as well as the structure of the payoff vectors, are clarified. It is found that in repeated symmetric games, any player can get the same augmented expected payoff by employing a ZD strategy. In repeated skew-symmetric games, it is possible for all participants to achieve a zero-sum outcome. To execute the aforementioned ZD strategies, some identical elements are required in each augmented payoff vector for symmetric games, whereas the payoff vector for skew-symmetric games must contain zero elements.

automation & control systems,operations research & management science
Innocent Strategies are Sheaves over Plays---Deterministic, Non-deterministic and Probabilistic Innocence

Takeshi Tsukada,C.-H. Luke Ong

DOI: https://doi.org/10.48550/arXiv.1409.2764

2014-09-09

Abstract:Although the HO/N games are fully abstract for PCF, the traditional notion of innocence (which underpins these games) is not satisfactory for such language features as non-determinism and probabilistic branching, in that there are stateless terms that are not innocent. Based on a category of P-visible plays with a notion of embedding as morphisms, we propose a natural generalisation by viewing innocent strategies as sheaves over (a site of) plays, echoing a slogan of Hirschowitz and Pous. Our approach gives rise to fully complete game models in each of the three cases of deterministic, nondeterministic and probabilistic branching. To our knowledge, in the second and third cases, ours are the first such factorisation-free constructions.

Programming Languages
Tit-for-Tat Strategy as a Deformed Zero-Determinant Strategy in Repeated Games

Masahiko Ueda

DOI: https://doi.org/10.7566/JPSJ.90.025002

2021-01-20

Abstract:We introduce the concept of deformed zero-determinant strategies in repeated games. We then show that the Tit-for-Tat strategy in the repeated prisoner's dilemma game is a deformed zero-determinant strategy, which unilaterally equalizes the probability distribution functions of payoffs of two players.

Combinatorics,Physics and Society
History-deterministic Timed Automata

Totzke,Patrick

DOI: https://doi.org/10.46298/lmcs-20(4:1)2024

2024-10-11

Logical Methods in Computer Science

Abstract:We explore the notion of history-determinism in the context of timed automata (TA) over infinite timed words. History-deterministic (HD) automata are those in which nondeterminism can be resolved on the fly, based on the run constructed thus far. History-determinism is a robust property that admits different game-based characterisations, and HD specifications allow for game-based verification without an expensive determinization step. We show that the class of timed -languages recognized by HD timed automata strictly extends that of deterministic ones, and is strictly included in those recognised by fully non-deterministic TA. For non-deterministic timed automata it is known that universality is already undecidable for safety/reachability TA. For history-deterministic TA with arbitrary parity acceptance, we show that timed universality, inclusion, and synthesis all remain decidable and are EXPTIME-complete. For the subclass of TA with safety or reachability acceptance, one can decide (in EXPTIME) whether such an automaton is history-deterministic. If so, it can effectively determinized without introducing new automaton states.

computer science, theory & methods,logic
Zero-determinant Strategy: an Underway Revolution in Game Theory

Hao Dong,Rong Zhi-Hai,Zhou Tao

DOI: https://doi.org/10.1088/1674-1056/23/7/078905

2014-01-01

Chinese Physics B

Abstract:Repeated games describe situations where players interact with each other in a dynamic pattern and make decisions according to outcomes of previous stage games. Very recently, Press and Dyson have revealed a new class of zero-determinant（ZD） strategies for the repeated games, which can enforce a fixed linear relationship between expected payoffs of two players, indicating that a smart player can control her unwitting co-player’s payoff in a unilateral way [Proc. Acad. Natl. Sci.USA 109, 10409（2012）]. The theory of ZD strategies provides a novel viewpoint to depict interactions among players,and fundamentally changes the research paradigm of game theory. In this brief survey, we first introduce the mathematical framework of ZD strategies, and review the properties and constrains of two specifications of ZD strategies, called pinning strategies and extortion strategies. Then we review some representative research progresses, including robustness analysis,cooperative ZD strategy analysis, and evolutionary stability analysis. Finally, we discuss some significant extensions to ZD strategies, including the multi-player ZD strategies, and ZD strategies under noise. Challenges in related research fields are also listed.
Strategies Resilient to Delay: Games under Delayed Control vs. Delay Games

Martin Fränzle,Sarah Winter,Martin Zimmermann

DOI: https://doi.org/10.4204/EPTCS.390.14

2023-10-02

Abstract:We compare games under delayed control and delay games, two types of infinite games modelling asynchronicity in reactive synthesis. Our main result, the interreducibility of the existence of sure winning strategies for the protagonist, allows to transfer known complexity results and bounds on the delay from delay games to games under delayed control, for which no such results had been known. We furthermore analyze existence of randomized strategies that win almost surely, where this correspondence between the two types of games breaks down.

Computer Science and Game Theory,Formal Languages and Automata Theory,Logic in Computer Science
Synthesis of Timeline-Based Planning Strategies Avoiding Determinization

Renato Acampora,Dario Della Monica,Luca Geatti,Nicola Gigante,Angelo Montanari,Pietro Sala

DOI: https://doi.org/10.4204/EPTCS.409.5

2024-10-30

Abstract:Qualitative timeline-based planning models domains as sets of independent, but interacting, components whose behaviors over time, the timelines, are governed by sets of qualitative temporal constraints (ordering relations), called synchronization rules. Its plan-existence problem has been shown to be PSPACE-complete; in particular, PSPACE-membership has been proved via reduction to the nonemptiness problem for nondeterministic finite automata. However, nondeterministic automata cannot be directly used to synthesize planning strategies as a costly determinization step is needed. In this paper, we identify a large fragment of qualitative timeline-based planning whose plan-existence problem can be directly mapped into the nonemptiness problem of deterministic finite automata, which can then be exploited to synthesize strategies. In addition, we identify a maximal subset of Allen's relations that fits into such a deterministic fragment.

Formal Languages and Automata Theory,Computational Complexity
A game-theoretic approach to timeline-based planning with uncertainty

Nicola Gigante,Angelo Montanari,Marta Cialdea Mayer,Andrea Orlandini,Mark Reynolds

DOI: https://doi.org/10.4230/LIPIcs.TIME.2018.13

2019-05-27

Abstract:In timeline-based planning, domains are described as sets of independent, but interacting, components, whose behaviour over time (the set of timelines) is governed by a set of temporal constraints. A distinguishing feature of timeline-based planning systems is the ability to integrate planning with execution by synthesising control strategies for flexible plans. However, flexible plans can only represent temporal uncertainty, while more complex forms of nondeterminism are needed to deal with a wider range of realistic problems. In this paper, we propose a novel game-theoretic approach to timeline-based planning problems, generalising the state of the art while uniformly handling temporal uncertainty and nondeterminism. We define a general concept of timeline-based game and we show that the notion of winning strategy for these games is strictly more general than that of control strategy for dynamically controllable flexible plans. Moreover, we show that the problem of establishing the existence of such winning strategies is decidable using a doubly exponential amount of space.

Artificial Intelligence,Computer Science and Game Theory
The Price of History-Independent Strategies in Games with Inter-Temporal Externalities

Yevgeny Tsodikovich,Xavier Venel,Anna Zseleva

DOI: https://doi.org/10.1007/s13235-024-00555-w

2024-03-04

Dynamic Games and Applications

Abstract:In this paper, we compare the value of zero-sum stochastic games under optimal strategies (that are, for single-controller stochastic games, stationary) to the commonly used time-independent strategies ("static strategies"). Our findings are summarized in a series of theorems which provide the lower bound on the optimality of the static strategy under different assumptions. These bounds can be used to assess whether the additional computational complexity is worth the extra payoff gain or, symmetrically, assess the price of playing sub-optimal but simple strategies when stationary ones are forbidden.

mathematics, interdisciplinary applications
The Order Independence of Iterated Dominance in Extensive Games

Jing Chen,Silvio Micali

DOI: https://doi.org/10.3982/te942

2013-01-01

Theoretical Economics

Abstract:Shimoji and Watson (1998) prove that a strategy of an extensive game is rationalizable in the sense of Pearce if and only if it survives the maximal elimination of conditionally dominated strategies. Briefly, this process iteratively eliminates conditionally dominated strategies according to a specific order, which is also the start of an order of elimination of weakly dominated strategies. Since the final set of possible payoff profiles, or terminal nodes, surviving iterated elimination of weakly dominated strategies may be order-dependent, one may suspect that the same holds for conditional dominance.We prove that, although the sets of strategy profiles surviving two arbitrary elimination orders of conditional dominance may be very different from each other, they are equivalent in the following sense: for each player i and each pair of elimination orders, there exists a function phi(i) mapping each strategy of i surviving the first order to a strategy of i surviving the second order, such that, for every strategy profile s surviving the first order, the profile (phi(i)(s(i)))(i) induces the same terminal node as s does.To prove our results, we put forward a new notion of dominance and an elementary characterization of extensive-form rationalizability (EFR) that may be of independent interest. We also establish connections between EFR and other existing iterated dominance procedures, using our notion of dominance and our characterization of EFR.

Strategies in deterministic totally-ordered-time games

On the implementation of zero-determinant strategies in repeated games

Different Strokes in Randomised Strategies: Revisiting Kuhn's Theorem under Finite-Memory Assumptions

Optimal Time-Abstract Schedulers for CTMDPs and Markov Games

Deterministic monotone dynamics and dominated strategies

Game Characterizations of Timed Relations for Timed Automata Processes

Strategic Dominance: A New Preorder for Nondeterministic Processes

Linear algebraic structure of zero-determinant strategies in repeated games

Partial-Observation Stochastic Games: How to Win When Belief Fails

TSO Games -- On the decidability of safety games under the total store order semantics

Zero-determinant strategies of multi-player multi-action repeated games with multiple memories

Innocent Strategies are Sheaves over Plays---Deterministic, Non-deterministic and Probabilistic Innocence

Tit-for-Tat Strategy as a Deformed Zero-Determinant Strategy in Repeated Games

History-deterministic Timed Automata

Zero-determinant Strategy: an Underway Revolution in Game Theory

Strategies Resilient to Delay: Games under Delayed Control vs. Delay Games

Synthesis of Timeline-Based Planning Strategies Avoiding Determinization

A game-theoretic approach to timeline-based planning with uncertainty

The Price of History-Independent Strategies in Games with Inter-Temporal Externalities

The Order Independence of Iterated Dominance in Extensive Games