Characterization of Feedback Nash Equilibrium for Differential Games

Yurii Averboukh
DOI: https://doi.org/10.48550/arXiv.1005.0101
2010-05-05
Abstract:We investigate the set of Nash equilibrium payoffs for two person differential games. The main result of the paper is the characterization of the set of Nash equilibrium payoffs in the terms of nonsmooth analysis. Also we obtain the sufficient conditions for a pair of continuous function to provide a Nash equilibrium. This result generalizes the method of system of Hamilton-Jacobi equations.
Optimization and Control
What problem does this paper attempt to address?
The problem that this paper attempts to solve is about the characterization of Nash equilibrium payoffs in two - person differential games. Specifically, the author aims to characterize the Nash equilibrium payoff set by means of non - smooth analysis methods and give a pair of continuous functions to provide sufficient conditions for Nash equilibrium. This result generalizes the traditional methods based on the Hamilton - Jacobi equation system. ### Main contributions of the paper: 1. **Characterization of Nash equilibrium payoff set**: The author uses non - smooth analysis methods to describe the Nash equilibrium payoff set in two - person differential games. 2. **Sufficient conditions**: Proposes a pair of continuous functions to provide sufficient conditions for Nash equilibrium. 3. **Generalize existing methods**: This research generalizes the traditional methods based on the Hamilton - Jacobi equation system and is applicable to a wider range of situations. ### Formula representation: - Differential system: \[ \dot{x}=f(t, x, u, v), \quad t\in[t_0, \vartheta_0], \quad x\in\mathbb{R}^n, \quad u\in P, \quad v\in Q \] where \(u\) and \(v\) are the control variables of Player I and Player II respectively. - Hamiltonians: \[ H_1(t, x, s)=\max_{u\in P}\min_{v\in Q}\langle s, f(t, x, u, v)\rangle \] \[ H_2(t, x, s)=\max_{v\in Q}\min_{u\in P}\langle s, f(t, x, u, v)\rangle \] - Viscosity solution conditions: \[ \frac{\partial c_i}{\partial t}+H_i(t, x, \nabla c_i) = 0 \] ### Key conclusions: - Proposes the closeness and compactness conditions of the multi - valued mapping \(T\), and proves that under these conditions \(T(t, x)\subset N(t, x)\), where \(N(t, x)\) is the Nash equilibrium payoff set. - Gives that when a pair of continuous functions \((c_1, c_2)\) satisfy the viscosity solution conditions and the directional derivative conditions, they can be sufficient conditions for Nash equilibrium payoffs. ### Application example: The paper also shows the effectiveness of the proposed method through an example of a specific two - person non - zero - sum differential game and verifies the correctness of the theoretical results. In conclusion, by introducing non - smooth analysis methods, this paper provides new perspectives and tools for understanding and calculating Nash equilibria in two - person differential games.