Diversity of Logical Agents in Games

Johan van Benthem,Fenrong Liu

DOI: https://doi.org/10.4000/philosophiascientiae.571

2004-01-01

Philosophia Scientae

Abstract:Epistemic agents may have different powers of observation and reasoning, and we show how this diversity fits into dynamic update logics.

What problem does this paper attempt to address?

Diversity of Agents and Their Interaction.

Fenrong Liu

DOI: https://doi.org/10.1007/s10849-008-9072-7

2009-01-01

Abstract:Diversity of agents occurs naturally in epistemic logic, and dynamic logics of information update and belief revision. In this paper we provide a systematic discussion of different sources of diversity, such as introspection ability, powers of observation, memory capacity, and revision policies, and we show how these can be encoded in dynamic epistemic logics allowing for individual variation among agents. Next, we explore the interaction of diverse agents by looking at some concrete scenarios of communication and learning, and we propose a logical methodology to deal with these as well. We conclude with some further questions on the logic of diversity and interaction.
Dynamic Update with Probabilities

Johan van Benthem,Jelle Gerbrandy,Barteld Kooi

DOI: https://doi.org/10.1007/s11225-009-9209-y

2009-01-01

Studia Logica

Abstract:Current dynamic-epistemic logics model different types of information change in multi-agent scenarios. We generalize these logics to a probabilistic setting, obtaining a calculus for multi-agent update with three natural slots: prior probability on states, occurrence probabilities in the relevant process taking place, and observation probabilities of events. To match this update mechanism, we present a complete dynamic logic of information change with a probabilistic character. The completeness proof follows a compositional methodology that applies to a much larger class of dynamic-probabilistic logics as well. Finally, we discuss how our basic update rule can be parameterized for different update policies, or learning methods.
Decisions, Actions, and Games: A Logical Perspective

Johan van Benthem

DOI: https://doi.org/10.1007/978-3-540-92701-3_1

2008-01-01

Abstract:Over the past decades, logicians interested in rational agency and intelligent interaction studied major components of these phenomena, such as knowledge, belief, and preference. In recent years, standard ‘static’ logics describing information states of agents have been generalized to dynamic logics describing actions and events that produce information, revise beliefs, or change preferences, as explicit parts of the logical system. [22], [1], [12] are up-to-date accounts of this dynamic trend (the present paper follows Chapter 9 of the latter book). But in reality, concrete rational agency contains all these dynamic processes entangled. A concrete setting for this entanglement are games – and this paper is a survey of their interfaces with logic, both static and dynamic. Games are intriguing also since their analysis brings together two major streams, or tribal communities: ‘hard’ mathematical logics of computation, and ‘soft’ philosophical logics of propositional attitudes. Of course, this hard/soft distinction is spurious, and there is no natural border line between the two sources: it is their congenial mixture that makes current theories of agency so lively.
Game Solution, Epistemic Dynamics and Fixed-Point Logics

Johan van Benthem,Amelie Gheerbrant

DOI: https://doi.org/10.3233/fi-2010-261

2010-01-01

Fundamenta Informaticae

Abstract:Current methods for solving games embody a form of "procedural rationality" that invites logical analysis in its own right. This paper is a brief case study of Backward Induction for extensive games, replacing earlier static logical definitions by stepwise dynamic ones. We consider a number of analysis from recent years that look different conceptually, and find that they are all mathematically equivalent. This shows how an abstract logical perspective can bring out basic invariant structure in games. We then generalize this to an exploration of fixed-point logics on finite trees that best fit game-theoretic equilibria. We end with some open questions that suggest a broader program for merging current computational logics with notions and results from game theory. This paper is largely a program for opening up an area: an extended version of the technical results will be found in the forthcoming dissertation [26].
Merging Observation and Access in Dynamic Logic

Johan van Benthem

2008-01-01

Abstract:Rational agents base their actions on information from observation, inference, introspection, or other sources. But this information comes in different kinds, and it is usually handled by different logical mechanisms. We discuss how to integrate external ‘updating information’ and internal ‘elucidating information’ into one system of dynamic epistemic logic, by distinguishing two basic informational actions: ‘bare seeing’ versus ‘conscious realization’. 1 Rational agency, logic, and the problem of information diversity Logical dynamics in rational agency Was Gödel’s diary kept in German or in English? I can fly to Princeton and check (if Google Earth does not zoom in that close these days), or try to infer the answer in comfort at home from the facts in John Dawson’s biography, or failing all that, I might call some East Coast friend who knows the answer. Rational agents have a great variety of ways for getting new information, and they use it for a great variety of purposes. Observation, inference, and communication all seem equally respectable ways for agents to obtain information, and in the program of ‘logical dynamics’ (van Benthem 1996), they should indeed all be handled on a par. In my paper ‘Tell it Like It Is’ (Journal of Peking University, Humanities and Social Science Edition, No. 1, 2008, pp. 80 – 90), I describe the logical challenges which arise in this way, sketching how current dynamic logics of information update, belief revision, preference change, and strategic interaction all address aspects of this total behaviour of rational agents, which then need to be integrated. 1 In particular, since all these activities are information-driven, our logical systems need to be able to integrate the various kinds of information that are relevant to the above picture. But then, we have a problem of compatibility – and it is of long standing by now: 1 The further paper ‘Logic, Rational Agency, and Intelligent Interaction’, an invited lecture at the 13 International Congress of Logic, Methodology, and Philosophy of Science, Beijing 2007, Proceedings to appear with College Publications, London, lays out the program in greater detail.
Games in Dynamic‐Epistemic Logic

Johan Van Benthem

DOI: https://doi.org/10.1111/1467-8586.00133

2001-01-01

Bulletin of Economic Research

Abstract:The author discusses games of both perfect and imperfect information at two levels of structural detail: players’ local actions, and their global powers for determining outcomes of the game. Matching logical languages are proposed for both. In particular, at the ‘action level’, imperfect information games naturally model a combined ‘dynamic‐epistemic language’– and correspondences are found between special axioms in this language and particular modes of playing games with their information dynamics. At the ‘outcome level’, the paper presents suitable notions of game equivalence, and some simple representation results.
Dynamic epistemic logics for abstract argumentation

Carlo Proietti,Antonio Yuste-Ginel

DOI: https://doi.org/10.1007/s11229-021-03178-5

IF: 1.595

2021-05-15

Synthese

Abstract:Abstract This paper introduces a multi-agent dynamic epistemic logic for abstract argumentation. Its main motivation is to build a general framework for modelling the dynamics of a debate, which entails reasoning about goals, beliefs, as well as policies of communication and information update by the participants. After locating our proposal and introducing the relevant tools from abstract argumentation, we proceed to build a three-tiered logical approach. At the first level, we use the language of propositional logic to encode states of a multi-agent debate. This language allows to specify which arguments any agent is aware of, as well as their subjective justification status. We then extend our language and semantics to that of epistemic logic, in order to model individuals’ beliefs about the state of the debate, which includes uncertainty about the information available to others. As a third step, we introduce a framework of dynamic epistemic logic and its semantics, which is essentially based on so-called event models with factual change. We provide completeness results for a number of systems and show how existing formalisms for argumentation dynamics and unquantified uncertainty can be reduced to their semantics. The resulting framework allows reasoning about subtle epistemic and argumentative updates—such as the effects of different levels of trust in a source—and more in general about the epistemic dimensions of strategic communication.

history & philosophy of science
Modelling Behavioural Diversity for Learning in Open-Ended Games

Nicolas Perez Nieves,Yaodong Yang,Oliver Slumbers,David Henry Mguni,Ying Wen,Jun Wang

DOI: https://doi.org/10.48550/arXiv.2103.07927

2021-06-10

Abstract:Promoting behavioural diversity is critical for solving games with non-transitive dynamics where strategic cycles exist, and there is no consistent winner (e.g., Rock-Paper-Scissors). Yet, there is a lack of rigorous treatment for defining diversity and constructing diversity-aware learning dynamics. In this work, we offer a geometric interpretation of behavioural diversity in games and introduce a novel diversity metric based on determinantal point processes (DPP). By incorporating the diversity metric into best-response dynamics, we develop diverse fictitious play and diverse policy-space response oracle for solving normal-form games and open-ended games. We prove the uniqueness of the diverse best response and the convergence of our algorithms on two-player games. Importantly, we show that maximising the DPP-based diversity metric guarantees to enlarge the gamescape -- convex polytopes spanned by agents' mixtures of strategies. To validate our diversity-aware solvers, we test on tens of games that show strong non-transitivity. Results suggest that our methods achieve at least the same, and in most games, lower exploitability than PSRO solvers by finding effective and diverse strategies.

Artificial Intelligence,Computer Science and Game Theory,Multiagent Systems
On logic of belief-disagreement among agents

Tian-Qun Pan

DOI: https://doi.org/10.1007/978-3-642-24130-7_33

2011-01-01

Abstract:Epistemic disagreement and agreement between two agents have been considered by game theorists and logicians[1][2]. But they are discussed only from the view of knowledge.
A New Game Equivalence, Its Logic and Algebra

Johan van Benthem,Nick Bezhanishvili,Sebastian Enqvist

DOI: https://doi.org/10.1007/s10992-018-9489-7

2018-01-01

Journal of Philosophical Logic

Abstract:We present a new notion of game equivalence that captures basic powers of interacting players. We provide a representation theorem, a complete logic, and a new game algebra for basic powers. In doing so, we establish connections with imperfect information games and epistemic logic. We also identify some new open problems concerning logic and games.
Logics for Information Update

Johan van Benthem

2001-01-01

Abstract:Logical languages define propositions that describe states of the world, represented by some suitably chosen model. The typical format for this is a semantic truth definition M, s &vDash;&phis; saying that formula &phis; is true at state s of model M. In terms of this schema, one can then define valid reasoning as all steps from formulas to formulas that preserve truth. The usual systems of epistemic logic follow this set-up, and the resulting account of reasoning is useful and well-known. But there is also a limitation to this perspective. It leaves out the 'logical dynamics' of many natural processes, such as communicating information. In that case, the basic phenomena are actions which change information states of speakers and hearers, and the locus of 'meaning' for a proposition is not its static content, but the dynamic change it induces from one model M, viewed as an information state for logical agents, to another: announcing &phis; changes M, s into N, t. One now becomes interested in cognitive actions like informing, questioning, answering - with inference as an important, but by no means the only example. This Dynamic Turn has emerged in many areas: linguistics (Kamp, Heim, Groenendijk & Stokhof), philosophy and AI (Gärdenfors, Harman), computational linguistics (Gross & Sidner, Gabbay, Kempson & Meyer Viol) and computer science (Fagin/Halpern/Moses/Vardi, Abramsky, Reiter). This tutorial presents an overview of update logics for communicative actions. The basic tool is: Hintikka-Kripke models for epistemic languages. The difficult questions are twofold. First, what precise updates are induced by various types of communicative action? One line in the literature has looked at examples of increasing complexity. Models and update procedures are simple for questions/answers, or public announcements, but they get much more complex as communication gets more 'private'. We follow one such line in current research, referring to work by Veltman, Groeneveld & Gerbrandy, and Baltag, Solecki & Moss on information update in conversation and games, whose current challenges include more complex linguistic expressions, defaults and cryptographic communication. This requires building sophisticated models in harmony with the observed phenomena. Our second topic concerns new logical issues in this setting. In a way, all relevant dynamics is contained in existing epistemic logics cum temporal models. But this observation is no more useful than saying we can do most of modern logic inside first-order logic, and all of it inside set theory. Instead, we survey new questions beyond the usual agenda. Examples are: (a) relating model-theoretic to syntactic views of update, (b) (non-)persistence of assertions under update, (c) calculi for short-term dynamic 'local inference', and connections with longer-term 'global inference'. References for the general program (1) J. van Benthem, 1996, "Exploring Logical Dynamics", CSLI Publications, Stanford. (2) R. Muskens & A. Visser, 'Dynamics', in J. van Benthem & A. ter Meulen, eds., 1997, "Hand-book of Logic & Language", Elsevier, Amsterdam. (3) J. van Benthem, 2000, 'Update Delights', http://turing.wins.uva.nl/~johan/Update.Delights.ps, ILLC, University of Amsterdam - for proofs and details. The rest of this paper is a brief tour of some technical issues in update logic, starting with a simple card game, which highlights some essential questions. The tutorial at TARK itself will be example-oriented.
Natural Language and Logic of Agency

Johan van Benthem

DOI: https://doi.org/10.1007/s10849-014-9188-x

2014-01-01

Journal of Logic Language and Information

Abstract:This light piece reflects on analogies between two often disjoint streams of research: the logical semantics and pragmatics of natural language and dynamic logics of general information-driven agency. The two areas show significant overlap in themes and tools, and yet, the focus seems subtly different in each, defying a simple comparison. We discuss some unusual questions that emerge when the two are put side by side, without any pretense at covering the whole literature or at reaching definitive conclusions.
Open Problems in Logical Dynamics

Johan van Benthem

DOI: https://doi.org/10.1007/0-387-31072-x_3

2006-01-01

Abstract:In recent years, a number of 'dynamic epistemic logics' have been developed for dealing with information, communication, and interaction. This paper is a survey of conceptual issues and open mathematical problems emanating from this development. 1 Logical Dynamics The traditional paradigm of logic is drawing a conclusion from some given premises. But derivation from data already at our disposal is just one way in which information can be obtained. We can also observe new facts, or just ask some better-informed person whom we trust. Concomitantly with all this information flow, our knowledge and beliefs change, and this adaptation process may even be triggered by further cues. Such cognitive actions are of logical interest per se, and their explicit study and its various repercussions has been described as a 'Dynamic Turn' in logic (van Benthem 1996). In particular, relevant actions in this broader setting need not be single-agent tasks such as drawing a conclusion or observing some fact. After all, perhaps the simplest logical scenario for getting or giving information is asking a question. But this essentially involves information flow between two agents, and their mutual epistemic and 'social' interactions as the question is asked and an answer is given. An excellent framework for multi-agent dynamic behaviour in communication is epistemic logic (introduced in Section 2), suitably 'dynamified' by using ideas from the dynamic logic of actions. Section 3 is about the best-explored system of this kind, viz. the dynamic logic of public announcements. Section 4 generalizes this to general dynamic-epistemic logic of actions or events whose observation conveys information. The resulting technical questions here blend into issues about more classical logical systems, which are discussed in Section 5 on first-order and fixed-point logics. But knowledge and ignorance are not the only attitudes of participants in a conversation. They also have beliefs about their current situation and expectations about the future. These are revised as observation and communication take place. Thus, epistemic dynamics runs into belief revision. Section 6 is devoted to links between dynamicepistemic logic and belief revision theory as developed in AI and related areas.
Rational Dynamics and Epistemic Logic in Games

Johan van Benthem

DOI: https://doi.org/10.1142/s0219198907001254

2003-01-01

Abstract:Game-theoretic solution concepts describe sets of strategy profiles that are optimal for all players in some plausible sense. Such sets are often found by recursive algorithms like iterated removal of strictly dominated strategies in strategic games, or backward induction in extensive games. Standard logical analyses of solution sets use assumptions about players in fixed epistemic models for a given game, such as mutual knowledge of rationality. In this paper, we propose a different perspective, analyzing solution algorithms as processes of learning which change game models. Thus, strategic equilibrium gets linked to fixed-points of operations of repeated announcement of suitable epistemic statements. This dynamic stance provides a new look at the current interface of games, logic, and computation.
Logic in Games

Johan van Benthem

DOI: https://doi.org/10.7551/mitpress/9674.001.0001

2014-01-01

Abstract:A comprehensive examination of the interfaces of logic, computer science, and game theory, drawing on twenty years of research on logic and games.This book draws on ideas from philosophical logic, computational logic, multi-agent systems, and game theory to offer a comprehensive account of logic and games viewed in two complementary ways. It examines the logic of games: the development of sophisticated modern dynamic logics that model information flow, communication, and interactive structures in games. It also examines logic as games: the idea that logical activities of reasoning and many related tasks can be viewed in the form of games.In doing so, the book takes up the “intelligent interaction” of agents engaging in competitive or cooperative activities and examines the patterns of strategic behavior that arise. It develops modern logical systems that can analyze information-driven changes in players' knowledge and beliefs, and introduces the “Theory of Play” that emerges from the combination of logic and game theory. This results in a new view of logic itself as an interactive rational activity based on reasoning, perception, and communication that has particular relevance for games.Logic in Games, based on a course taught by the author at Stanford University, the University of Amsterdam, and elsewhere, can be used in advanced seminars and as a resource for researchers.
Modelling Simultaneous Games in Dynamic Logic

Johan van Benthem,Sujata Ghosh,Fenrong Liu

DOI: https://doi.org/10.1007/s11229-008-9390-y

IF: 1.595

2008-01-01

Synthese

Abstract:We make a proposal for formalizing simultaneous games at the abstraction level of player’s powers, combining ideas from dynamic logic of sequential games and concurrent dynamic logic. We prove completeness for a new system of ‘concurrent game logic’ CDGL with respect to finite non-determined games. We also show how this system raises new mathematical issues, and throws light on branching quantifiers and independence-friendly evaluation games for first-order logic.
A New Game Equivalence and Its Modal Logic.

Johan van Benthem,Nick Bezhanishvili,Sebastian Enqvist

DOI: https://doi.org/10.4204/eptcs.251.5

2017-01-01

Abstract:We revisit the crucial issue of natural game equivalences, and semantics of game logics based on these. We present reasons for investigating finer concepts of game equivalence than equality of standard powers, though staying short of modal bisimulation. Concretely, we propose a more finegrained notion of equality of "basic powers" which record what players can force plus what they leave to others to do, a crucial feature of interaction. This notion is closer to game-theoretic strategic form, as we explain in detail, while remaining amenable to logical analysis. We determine the properties of basic powers via a new representation theorem, find a matching "instantial neighborhood game logic", and show how our analysis can be extended to a new game algebra and dynamic game logic.
Discrete Preference Games with Logic-Based Agents: Formal Framework, Complexity, and Islands of Tractability

Gianluigi Greco,Marco Manna

DOI: https://doi.org/10.1016/j.artint.2024.104131

IF: 14.4

2024-04-10

Artificial Intelligence

Abstract:Analyzing and predicting the dynamics of opinion formation in the context of social environments are problems that attracted much attention in literature. While grounded in social psychology, these problems are nowadays popular within the artificial intelligence community, where opinion dynamics are often studied via game-theoretic models in which individuals/agents hold opinions taken from a fixed set of discrete alternatives, and where the goal is to find those configurations where the opinions expressed by the agents emerge as a kind of compromise between their innate opinions and the social pressure they receive from the environments. As a matter of facts, however, these studies are based on very high-level and sometimes simplistic formalizations of the social environments, where the mental state of each individual is typically encoded as a variable taking values from a Boolean domain. To overcome these limitations, the paper proposes a framework generalizing such discrete preference games by modeling the reasoning capabilities of agents in terms of weighted propositional logics. It is shown that the framework easily encodes different kinds of earlier approaches and fits more expressive scenarios populated by conformist and dissenter agents. Problems related to the existence and computation of stable configurations are studied, under different theoretical assumptions on the structural shape of the social interactions and on the class of logic formulas that are allowed. Remarkably, during its trip to identify some relevant tractability islands, the paper devises a novel technical machinery whose significance goes beyond the specific application to analyzing opinion formation and diffusion, since it significantly enlarges the class of Integer Linear Programs that were known to be tractable so far.

computer science, artificial intelligence
A Unified Diversity Measure for Multiagent Reinforcement Learning

Zongkai Liu,Chao Yu,Yaodong Yang,peng sun,Zifan Wu,Yuan Li

2022-01-01

Abstract:Promoting behavioural diversity is of critical importance in multi-agent reinforcement learning, since it helps the agent population maintain robust performance when encountering unfamiliar opponents at test time, or, when the game is highly non-transitive in the strategy space (e.g., Rock-Paper-Scissor). While a myriad of diversity metrics have been proposed, there are no widely accepted or unified definitions in the literature, making the consequent diversity-aware learning algorithms difficult to evaluate and the insights elusive. In this work, we propose a novel metric called the Unified Diversity Measure (UDM) that offers a unified view for existing diversity metrics. Based on UDM, we design the UDM-Fictitious Play (UDM-FP) and UDM-Policy Space Response Oracle (UDM-PSRO) algorithms as efficient solvers for normal-form games and open-ended games. In theory, we prove that UDM-based methods can enlarge the gamescape by increasing the response capacity of the strategy pool, and have convergence guarantee to two-player Nash equilibrium. We validate our algorithms on games that show strong non-transitivity, and empirical results show that our algorithms achieve better performances than strong PSRO baselines in terms of the exploitability and population effectivity.
Toward a Theory of Play: A Logical Perspective on Games and Interaction.

Johan van Benthem,Eric Pacuit,Olivier Roy

DOI: https://doi.org/10.3390/g2010052

2011-01-01

Games

Abstract:Logic and game theory have had a few decades of contacts by now, with the classical results of epistemic game theory as major high-lights. In this paper, we emphasize a recent new perspective toward “logical dynamics”, designing logical systems that focus on the actions that change information, preference, and other driving forces of agency. We show how this dynamic turn works out for games, drawing on some recent advances in the literature. Our key examples are the long-term dynamics of information exchange, as well as the much-discussed issue of extensive game rationality. Our paper also proposes a new broader interpretation of what is happening here. The combination of logic and game theory provides a fine-grained perspective on information and interaction dynamics, and we are witnessing the birth of something new which is not just logic, nor just game theory, but rather a Theory of Play.

Diversity of Logical Agents in Games

Diversity of Agents and Their Interaction.

Dynamic Update with Probabilities

Decisions, Actions, and Games: A Logical Perspective

Game Solution, Epistemic Dynamics and Fixed-Point Logics

Merging Observation and Access in Dynamic Logic

Games in Dynamic‐Epistemic Logic

Dynamic epistemic logics for abstract argumentation

Modelling Behavioural Diversity for Learning in Open-Ended Games

On logic of belief-disagreement among agents

A New Game Equivalence, Its Logic and Algebra

Logics for Information Update

Natural Language and Logic of Agency

Open Problems in Logical Dynamics

Rational Dynamics and Epistemic Logic in Games

Logic in Games

Modelling Simultaneous Games in Dynamic Logic

A New Game Equivalence and Its Modal Logic.

Discrete Preference Games with Logic-Based Agents: Formal Framework, Complexity, and Islands of Tractability

A Unified Diversity Measure for Multiagent Reinforcement Learning

Toward a Theory of Play: A Logical Perspective on Games and Interaction.