Abstract:Stackelberg games originate where there are market leaders and followers, and the actions of leaders influence the behavior of the followers. Mathematical modelling of such games results in what's called a Bilevel Optimization problem. There is an entire area of research dedicated to analyzing and solving Bilevel Optimization problems which are often complex, and finding solutions for such problems is known to be NP-Hard. A generalization of Stackelberg games is a Multilevel Stackelberg game where we may have nested leaders and followers, such that a follower is, in turn, a leader for all lower-level players. These problems are much more difficult to solve, and existing solution approaches typically require extensive cooperation between the players (which generally can't be assumed) or make restrictive assumptions about the structure of the problem. In this paper, we present a stochastic algorithm to approximate the local equilibrium solutions for these Multilevel games. We then construct a few examples of such Multilevel problems, including: a) a nested toll-setting problem; and b) an adversarial initial condition determination problem for Robust Trajectory Optimization. We test our algorithm on our constructed problems as well as some trilevel problems from the literature, and show that it is able to approximate the optimum solutions for these problems within a reasonable error margin. We also provide an asymptotic proof for the convergence of the algorithm and empirically analyze its accuracy and convergence speed for different parameters. Lastly, we compare it with existing solution strategies from the literature and demonstrate that it outperforms them.
What problem does this paper attempt to address?
This paper attempts to solve the optimization problems in multi - level Stackelberg games. Specifically, multi - level Stackelberg games involve multiple levels of leaders and followers, and the decisions at each level will affect the behavior of the next level. Mathematically, this kind of game can be modeled as a multi - level optimization problem, whose complexity far exceeds that of bi - level optimization problems and is generally considered to be NP - hard.
### Core problems of the paper
1. **Complexity of multi - level Stackelberg games**:
- Multi - level Stackelberg games involve multiple levels of leaders and followers, and the decisions at each level will affect the behavior of the next level.
- This kind of game is mathematically modeled as a multi - level optimization problem, whose complexity far exceeds that of bi - level optimization problems and is generally considered to be NP - hard.
2. **Limitations of existing methods**:
- Existing methods for solving such problems usually require extensive cooperation among participants or make strict assumptions about the problem structure, which are often unrealistic in practical applications.
- For example, the fuzzy set method assumes a certain degree of cooperation among lower - level participants; meta - heuristic - based methods such as genetic algorithms can only handle problems with bounded variables.
3. **Proposed new method**:
- This paper proposes a stochastic algorithm based on Monte Carlo sampling (Monte Carlo Multilevel Optimization, MCMO) to approximately solve the local equilibrium solutions of multi - level Stackelberg games.
- This algorithm generates samples in the neighborhood of a given solution and passes these samples layer by layer. Eventually, it uses a solver to obtain the optimal solution at the bottom layer and then returns the result to the upper layer for evaluation and selection.
### Main contributions
- Propose a simple yet powerful Monte Carlo method to solve multi - level optimization problems.
- Model the adversarial initial condition determination problem and the nested toll setting problem as multi - level optimization problems and obtain solutions through the proposed algorithm.
### Formula representation
The mathematical model of multi - level Stackelberg games can be represented by the following formulas:
For the \( l \) - th layer:
\[ \min_{x_l, x_{l + 1}, \ldots, x_L} f_l(X) \]
\[ \text{s.t. } g_l(X) \geq 0 \]
\[ (x_{l + 1}, \ldots, x_L) \in \arg \min_{x_{l + 1}, \ldots, x_L} f_{l + 1}(X) \]
\[ \text{s.t. } g_{l + 1}(X) \geq 0 \]
where \( X = [x_1, x_2, \ldots, x_L] \), \( f_l: \mathbb{R}^n \to \mathbb{R} \) is the objective function, and \( g_l: \mathbb{R}^n \to \mathbb{R}^{m_l} \) is the constraint condition.
### Conclusion
By introducing the MCMO algorithm, this paper provides a new and more general method to solve the optimization problems in multi - level Stackelberg games, especially for those complex problems that are difficult to be solved by traditional methods.