Abstract:It is well-known that acting in an individually rational manner, according to the principles of classical game theory, may lead to sub-optimal solutions in a class of problems named social dilemmas. In contrast, humans generally do not have much difficulty with social dilemmas, as they are able to balance personal benefit and group benefit. As agents in multi-agent systems are regularly confronted with social dilemmas, for instance in tasks such as resource allocation, these agents may benefit from the inclusion of mechanisms thought to facilitate human fairness. Although many of such mechanisms have already been implemented in a multi-agent systems context, their application is usually limited to rather abstract social dilemmas with a discrete set of available strategies (usually two). Given that many real-world examples of social dilemmas are actually continuous in nature, we extend this previous work to more general dilemmas, in which agents operate in a continuous strategy space. The social dilemma under study here is the well-known Ultimatum Game, in which an optimal solution is achieved if agents agree on a common strategy. We investigate whether a scale-free interaction network facilitates agents to reach agreement, especially in the presence of fixed-strategy agents that represent a desired (e.g. human) outcome. Moreover, we study the influence of rewiring in the interaction network. The agents are equipped with continuous-action learning automata and play a large number of random pairwise games in order to establish a common strategy. From our experiments, we may conclude that results obtained in discrete-strategy games can be generalized to continuous-strategy games to a certain extent: a scale-free interaction network structure allows agents to achieve agreement on a common strategy, and rewiring in the interaction network greatly enhances the agents ability to reach agreement. However, it also becomes clear that some alternative mechanisms, such as reputation and volunteering, have many subtleties involved and do not have convincing beneficial effects in the continuous case.

How individuals learn to take turns: Emergence of alternating cooperation in a congestion game and the prisoner's dilemma

Cycles of cooperation and defection in imperfect learning

To Optimize Human-in-the-loop Learning in Repeated Routing Games

What Drives People's Choices in Turn-Taking Games, if not Game-Theoretic Rationality?

Intrinsic fluctuations of reinforcement learning promote cooperation

From Altruism to Non-Cooperation in Routing Games

Predicting Human Cooperation

An Experimental Study on Learning Correlated Equilibrium in Routing Games

Inequity aversion improves cooperation in intertemporal social dilemmas

Learning to Reach Agreement in a Continuous Ultimatum Game

Evolutionary prisoner's dilemma games with optional participation

Counter-Intuitive Effects of Q-Learning Exploration in a Congestion Dilemma

Social Learning in Nonatomic Routing Games

Inducing Social Optimality in Games via Adaptive Incentive Design

Human-in-the-loop Learning for Dynamic Congestion Games

Cooperation, Norms, and Revolutions: A Unified Game-Theoretical Approach

Network Characteristics Control Social Dilemmas in a Public Good Game: A Mechanical Framework

Learning dynamics explains human behavior in Prisoner's Dilemma on networks

Behavioural strategies in simultaneous and alternating prisoner's dilemma games with/without voluntary participation

Universal Effect of Dynamical Reinforcement Learning Mechanism in Spatial Evolutionary Games

Competition and partnership between conformity and payoff-based imitations in social dilemmas