The Multi-player Nonzero-sum Dynkin Game in Continuous Time

Hamadene Said,Hassani Mohammed

DOI: https://doi.org/10.48550/arXiv.1110.5889

2011-09-29

Abstract:In this paper we study the N-player nonzero-sum Dynkin game ($N\geq 3$) in continuous time, which is a non-cooperative game where the strategies are stopping times. We show that the game has a Nash equilibrium point for general payoff processes.

Computer Science and Game Theory,Probability

What problem does this paper attempt to address?

The Continuous Time Nonzero-sum Dynkin Game Problem and Application in Game Options

Said Hamadene,Jianfeng Zhang

DOI: https://doi.org/10.48550/arXiv.0810.5698

2008-10-31

Abstract:In this paper we study the nonzero-sum Dynkin game in continuous time which is a two player non-cooperative game on stopping times. We show that it has a Nash equilibrium point for general stochastic processes. As an application, we consider the problem of pricing American game contingent claims by the utility maximization approach.

Pricing of Securities,Probability
Multi-player stopping games in continuous time

Zhou Zhou

DOI: https://doi.org/10.48550/arXiv.1509.03950

2015-09-14

Optimization and Control

Abstract:We consider multi-player stopping games in continuous time. Unlike Dynkin games, in our games the payoff of each player is revealed after all the players stop. Moreover, each player can adjust her own stopping strategy by observing other players' behaviors. Assuming the continuity of the payoff functions in time, we show that there always exists an $\eps$-Nash equilibrium in pure stopping strategies for any $\eps>0$.
Non-zero-sum stopping games in discrete time

Zhou Zhou

DOI: https://doi.org/10.48550/arXiv.1508.06032

2015-08-25

Abstract:We consider two-player non-zero-sum stopping games in discrete time. Unlike Dynkin games, in our games the payoff of each player is revealed after both players stop. Moreover, each player can adjust her own stopping strategy according to the other player's action. In the first part of the paper, we consider the game where players act simultaneously at each stage. We show that there exists a Nash equilibrium in mixed stopping strategies. In the second part, we assume that one player has to act first at each stage. In this case, we show the existence of a Nash equilibrium in pure stopping strategies.

Optimization and Control,Mathematical Finance
Non-linear non-zero-sum Dynkin games with Bermudan strategies

Miryana Grigorova,Marie-Claire Quenez,Yuan Peng

2023-11-02

Abstract:In this paper, we study a non-zero-sum game with two players, where each of the players plays what we call Bermudan strategies and optimizes a general non-linear assessment functional of the pay-off. By using a recursive construction, we show that the game has a Nash equilibrium point.

Optimization and Control,Probability,Computational Finance
Non-zero-sum stopping games in continuous time

Zhou Zhou

DOI: https://doi.org/10.48550/arXiv.1508.03921

2015-08-17

Abstract:On a filtered probability space $(\Omega ,\mathcal{F}, (\mathcal{F}_t)_{t\in[0,\infty]}, \mathbb{P})$, we consider the two-player non-zero-sum stopping game $u^i := \mathbb{E}[U^i(\rho,\tau)],\ i=1,2$, where the first player choose a stopping strategy $\rho$ to maximize $u^1$ and the second player chose a stopping strategy $\tau$ to maximize $u^2$. Unlike the Dynkin game, here we assume that $U(s,t)$ is $\mathcal{F}_{s\vee t}$-measurable. Assuming the continuity of $U^i$ in $(s,t)$, we show that there exists an $\epsilon$-Nash equilibrium for any $\epsilon>0$.

Optimization and Control
A Dynkin Game with Independent Processes and Incomplete Information

Georgy Gaitsgori,Richard Groenewald

2023-10-05

Abstract:We analyze a two-player, nonzero-sum Dynkin game of stopping with incomplete information. We assume that each player observes his own Brownian motion, which is not only independent of the other player's Brownian motion but also not observable by the other player. The player who stops first receives a payoff that depends on the stopping position. Under appropriate growth conditions on the payoff function, we show that there are infinitely many Nash equilibria in which both players have infinite expected payoffs. In contrast, the only equilibrium with finite expected payoffs mandates immediate stopping by at least one of the players.

Probability
Unilaterally Competitive Multi-Player Stopping Games

Ivan Guo

DOI: https://doi.org/10.48550/arXiv.1211.4113

2012-11-17

Abstract:A multi-player competitive Dynkin stopping game is constructed. Each player can either exit the game for a fixed payoff, determined a priori, or stay and receive an adjusted payoff depending on the decision of other players. The single period case is shown to be "weakly unilaterally competitive". We present an explicit construction of the unique value at which Nash and optimal equilibria are attained. Multiple period generalisations are explored. The game has interpretations in economic and financial contexts, for example, as a consumption model with bounded resources. It also serves as a starting point to the construction of multi-person financial game options. In particular, the concept of optimal equilibria becomes pivotal in the pricing of the game options via super-replication.

Computer Science and Game Theory,Optimization and Control
Nonzero-sum games of optimal stopping and generalised Nash equilibrium

Randall Martyr,John Moriarty

DOI: https://doi.org/10.1137/18M119803X

2017-09-07

Abstract:In the nonzero-sum setting, we establish a connection between Nash equilibria in games of optimal stopping (Dynkin games) and generalised Nash equilibrium problems (GNEP). In the Dynkin game this reveals novel equilibria of threshold type and of more complex types, and leads to novel uniqueness and stability results.

Probability,Optimization and Control
Zero-sum Dynkin games under common and independent Poisson constraints

David Hobson,Gechun Liang,Edward Wang

2024-11-12

Abstract:Zero-sum Dynkin games under the Poisson constraint have been studied widely in the recent literature. In such a game the players are only allowed to stop at the event times of a Poisson process. The constraint can be modelled in two different ways: either both players share the same Poisson process (the common constraint) or each player has her own Poisson process (the independent constraint). In the Markovian case where the payoff is given by a pair of functions of an underlying diffusion, we give sufficient conditions under which the solution of the game (the value function, and the optimal stopping sets for each player) under the common (respectively, independent) constraint is also the solution of the game under the independent (respectively, common) constraint. Roughly speaking, if the stopping sets of the maximiser and minimiser in the game under the common constraint are disjoint, then the solution to the game is the same under both the common and the independent constraint. However, the fact that the stopping sets are disjoint in the game under the independent constraint, is not sufficient to guarantee that the solution of the game under the independent constraint is also the solution under the common constraint.

Optimization and Control,Probability
Mixed-strategy Nash equilibrium for a discontinuous symmetric $N$-player game

H.J.Hilhorst,C.Appert-Rolland

DOI: https://doi.org/10.1088/1751-8121/aaa883

2017-10-13

Abstract:We consider a game in which each player must find a compromise between more daring strategies that carry a high risk for him to be eliminated, and more cautious ones that, however, reduce his final score. For two symmetric players this game was originally formulated in 1961 by Dresher, who modeled a duel between two opponents. The game has also been of interest in the description of athletic competitions. We extend here the two-player game to an arbitrary number $N$ of symmetric players. We show that there is a mixed-strategy Nash equilibrium and find its exact analytic expression, which we analyze in particular in the limit of large $N$, where mean-field behavior occurs. The original game with $N=2$ arises as a singular limit of the general case.

Optimization and Control,Physics and Society
Two-Player Zero-Sum Hybrid Games

Santiago J. Leudo,Ricardo G. Sanfelice

2024-07-25

Abstract:In this paper, we formulate a two-player zero-sum game under dynamic constraints defined by hybrid dynamical equations. The game consists of a min-max problem involving a cost functional that depends on the actions and resulting solutions to the hybrid system, defined as functions of hybrid time and, hence, can flow or jump. A terminal set conviniently defined allows to recast both finite and infinite horizon problems. We present sufficient conditions given in terms of Hamilton-Jacobi-Bellman-Isaacs-like equations to guarantee to attain a solution to the game. It is shown that when the players select the optimal strategy, the value function can be evaluated without computing solutions to the hybrid system. Under additional conditions, we show that the optimal state-feedback laws render a set of interest asymptotically stable for the resulting hybrid closed-loop system. Applications of this problem, as presented here, include a disturbance rejection scenario for which the effect of the perturbation is upper bounded, and a security scenario in which we formulate an optimal control problem under the presence of a maximizing attack.

Optimization and Control,Systems and Control
Continuous-time Distributed Nash Strategy over Switching Topologies with Gain Adaptation

Hangning Dong,Jianqing Li,Chaoyong Li,Donglian Qi

DOI: https://doi.org/10.1016/j.sysconle.2021.104955

IF: 2.742

2021-01-01

Systems & Control Letters

Abstract:This paper investigates the Nash equilibrium seeking problem among networked multi-player game over directed and switching topologies. To this end, a fully distributive gain adaptation strategy is proposed to make sure all players are updated without global information or initialization, and it is proved rigorously that the proposed scheme works well under a switching digraph and admits global convergence to the Nash equilibrium.
Zero-sum and nonzero-sum differential games without Isaacs condition

Juan Li,Wenqiang Li

DOI: https://doi.org/10.1051/cocv/2016044

2017-05-12

Abstract:In this paper we study differential games without Isaacs condition. The objective is to investigate on one hand zero-sum games with asymmetric information on the pay-off, and on the other hand, for the case of symmetric information but now for a non-zero sum differential game, the existence of a Nash equilibrium pay-off. Our results extend those by Buckdahn, Cardaliaguet and Rainer [SIAM J. Control Optim. 43 (2004) 624–642], to the case without Isaacs condition. To overcome the absence of Isaacs condition, randomization of the non-anticipative strategies with delay of the both players are considered. They differ from those in Buckdahn, Quincampoix, Rainer and Xu [Int. J. Game Theory 45 (2016) 795–816]. Unlike in [Int. J. Game Theory 45 (2016) 795–816], our definition of NAD strategies for a game over the time interval [ t,T ] (0 ≤ t ≤ T) guarantees that a randomized strategy along a partition π of [ 0,T ] remains a randomized NAD strategy with respect to any finer partition π′ (π ⊂ π′). This allows to study the limit behavior of upper and lower value functions defined for games in which the both players use also different partitions.
Solving finite time horizon Dynkin games by optimal switching

Randall Martyr

DOI: https://doi.org/10.1017/jpr.2016.57

2016-01-05

Abstract:This paper uses recent results on continuous-time finite-horizon optimal switching problems with negative switching costs to prove the existence of a saddle point in an optimal stopping (Dynkin) game. Sufficient conditions for the game's value to be continuous with respect to the time horizon are obtained using recent results on norm estimates for doubly reflected backward stochastic differential equations. This theory is then demonstrated numerically for the special cases of cancellable call and put options in a Black-Scholes market.

Optimization and Control,Probability,Mathematical Finance
Approximate N-Player Nonzero-Sum Game Solution for an Uncertain Continuous Nonlinear System

Marcus Johnson,Rushikesh Kamalapurkar,Shubhendu Bhasin,Warren E Dixon

DOI: https://doi.org/10.1109/TNNLS.2014.2350835

Abstract:An approximate online equilibrium solution is developed for an N -player nonzero-sum game subject to continuous-time nonlinear unknown dynamics and an infinite horizon quadratic cost. A novel actor-critic-identifier structure is used, wherein a robust dynamic neural network is used to asymptotically identify the uncertain system with additive disturbances, and a set of critic and actor NNs are used to approximate the value functions and equilibrium policies, respectively. The weight update laws for the actor neural networks (NNs) are generated using a gradient-descent method, and the critic NNs are generated by least square regression, which are both based on the modified Bellman error that is independent of the system dynamics. A Lyapunov-based stability analysis shows that uniformly ultimately bounded tracking is achieved, and a convergence analysis demonstrates that the approximate control policies converge to a neighborhood of the optimal solutions. The actor, critic, and identifier structures are implemented in real time continuously and simultaneously. Simulations on two and three player games illustrate the performance of the developed method.
Long-Time Behavior of Zero-Sum Linear-Quadratic Stochastic Differential Games

Jingrui Sun,Jiongmin Yong

2024-06-04

Abstract:The paper investigates the long-time behavior of zero-sum linear-quadratic stochastic differential games, aiming to demonstrate that, under appropriate conditions, both the saddle strategy and the optimal state process exhibit the exponential turnpike property. Namely, for the majority of the time horizon, the distributions of the saddle strategy and the optimal state process closely stay near certain (time-invariant) distributions $\nu_1^*$, $\nu_2^*$ and $\mu^*$, respectively. Additionally, as a byproduct, we solve the infinite horizon version of the differential game and derive closed-loop representations for its open-loop saddle strategy, which has not been proved in the literature.

Optimization and Control
On zero-sum game formulation of non zero-sum game

Yasuhito Tanaka

DOI: https://doi.org/10.48550/arXiv.1809.02984

2018-09-09

Abstract:We consider a formulation of a non zero-sum n players game by an n+1 players zero-sum game. We suppose the existence of the n+1-th player in addition to n players in the main game, and virtual subsidies to the n players which is provided by the n+1-th player. Its strategic variable affects only the subsidies, and does not affect choice of strategies by the n players in the main game. His objective function is the opposite of the sum of the payoffs of the n players. We will show 1) The minimax theorem by Sion (Sion(1958)) implies the existence of Nash equilibrium in the n players non zero-sum game. 2) The maximin strategy of each player in {1, 2, \dots, n} with the minimax strategy of the n+1-th player is equivalent to the Nash equilibrium strategy of the n players non zero-sum game. 3) The existence of Nash equilibrium in the n players non zero-sum game implies Sion's minimax theorem for pairs of each of the n players and the n+1-th player.

Optimization and Control,Computer Science and Game Theory
Zero-sum Risk-sensitive Stochastic Games for Continuous Time Markov Chains

Mrinal K. Ghosh,K. Suresh Kumar,Chandan Pal

DOI: https://doi.org/10.48550/arXiv.1603.02400

2016-03-08

Abstract:We study infinite horizon discounted-cost and ergodic-cost risk-sensitive zero-sum stochastic games for controlled continuous time Markov chains on a countable state space. For the discounted-cost game we prove the existence of value and saddle-point equilibrium in the class of Markov strategies under nominal conditions. For the ergodic-cost game we prove the existence of values and saddle point equilibrium by studying the corresponding Hamilton-Jacobi-Isaacs equation under a certain Lyapunov condition.

Optimization and Control
A Zero-Sum Differential Game with Exit Time

Ekaterina Kolpakova

2024-05-01

Abstract:The paper is concerned with a zero-sum differential game in the case where a payoff is determined by the exit time, that is, the first time when the system leaves the game domain. Additionally, we assume that a part of domain's boundary is a lifeline where the payoff is infinite. Hereby, the examined problem generalizes the well-known time-optimal problem as well as time-optimal problem with lifeline. The main result of the paper relies on the solution to the Direchlet problem for the Hamilton-Jacobi equation associated with the game with exit time. We prove the existence of the value function for examined problem and construct suboptimal feedback strategies under assumption that the associated Dirichlet problem for the Hamilton-Jacobi equation admits a viscosity/minimax solution. Additionally, we derive a sufficient condition of existence result to this Dirichlet problem.

Optimization and Control,Analysis of PDEs
Nash, Conley, and Computation: Impossibility and Incompleteness in Game Dynamics

Jason Milionis,Christos Papadimitriou,Georgios Piliouras,Kelly Spendlove

DOI: https://doi.org/10.48550/arXiv.2203.14129

2022-03-26

Computer Science and Game Theory

Abstract:Under what conditions do the behaviors of players, who play a game repeatedly, converge to a Nash equilibrium? If one assumes that the players' behavior is a discrete-time or continuous-time rule whereby the current mixed strategy profile is mapped to the next, this becomes a problem in the theory of dynamical systems. We apply this theory, and in particular the concepts of chain recurrence, attractors, and Conley index, to prove a general impossibility result: there exist games for which any dynamics is bound to have starting points that do not end up at a Nash equilibrium. We also prove a stronger result for $\epsilon$-approximate Nash equilibria: there are games such that no game dynamics can converge (in an appropriate sense) to $\epsilon$-Nash equilibria, and in fact the set of such games has positive measure. Further numerical results demonstrate that this holds for any $\epsilon$ between zero and $0.09$. Our results establish that, although the notions of Nash equilibria (and its computation-inspired approximations) are universally applicable in all games, they are also fundamentally incomplete as predictors of long term behavior, regardless of the choice of dynamics.

The Multi-player Nonzero-sum Dynkin Game in Continuous Time

The Continuous Time Nonzero-sum Dynkin Game Problem and Application in Game Options

Multi-player stopping games in continuous time

Non-zero-sum stopping games in discrete time

Non-linear non-zero-sum Dynkin games with Bermudan strategies

Non-zero-sum stopping games in continuous time

A Dynkin Game with Independent Processes and Incomplete Information

Unilaterally Competitive Multi-Player Stopping Games

Nonzero-sum games of optimal stopping and generalised Nash equilibrium

Zero-sum Dynkin games under common and independent Poisson constraints

Mixed-strategy Nash equilibrium for a discontinuous symmetric $N$-player game

Two-Player Zero-Sum Hybrid Games

Continuous-time Distributed Nash Strategy over Switching Topologies with Gain Adaptation

Zero-sum and nonzero-sum differential games without Isaacs condition

Solving finite time horizon Dynkin games by optimal switching

Approximate N-Player Nonzero-Sum Game Solution for an Uncertain Continuous Nonlinear System

Long-Time Behavior of Zero-Sum Linear-Quadratic Stochastic Differential Games

On zero-sum game formulation of non zero-sum game

Zero-sum Risk-sensitive Stochastic Games for Continuous Time Markov Chains

A Zero-Sum Differential Game with Exit Time

Nash, Conley, and Computation: Impossibility and Incompleteness in Game Dynamics