Inverse learning of black-box aggregator for robust Nash equilibrium

Guanpu Chen,Gehui Xu,Fengxiang He,Dacheng Tao,Thomas Parisini,Karl Henrik Johansson

2024-03-17

Abstract:In this note, we investigate the robustness of Nash equilibria (NE) in multi-player aggregative games with coupling constraints. There are many algorithms for computing an NE of an aggregative game given a known aggregator. When the coupling parameters are affected by uncertainty, robust NE need to be computed. We consider a scenario where players' weight in the aggregator is unknown, making the aggregator kind of "a black box". We pursue a suitable learning approach to estimate the unknown aggregator by proposing an inverse variational inequality-based relationship. We then utilize the counterpart to reconstruct the game and obtain first-order conditions for robust NE in the worst case. Furthermore, we characterize the generalization property of the learning methodology via an upper bound on the violation probability. Simulation experiments show the effectiveness of the proposed inverse learning approach.

Computer Science and Game Theory,Systems and Control,Optimization and Control

What problem does this paper attempt to address?

### Problems the paper attempts to solve

This paper aims to solve the problem of how to find the robust Nash equilibrium (rGNE) in multi - player aggregative games when the weights of the aggregator are unknown and there is uncertainty in the parameters.

Specifically:

1. **Problem background**:
- In multi - player aggregative games, each player's payoff depends not only on their own strategy but also on the aggregated result of all players' weighted strategies.
- When system parameters (such as the parameter \(\alpha\) in coupling constraints) are affected by uncertainty, traditional Nash equilibrium algorithms may lose their robustness.
- If the weights \(\beta\) of the aggregator are unknown, that is, the aggregator becomes a "black box", then existing robust optimization methods cannot be directly applied to deal with this uncertainty.

2. **Research objectives**:
- Develop a learning method to estimate the weights \(\beta\) in the black - box aggregator through existing data points (including the perturbed parameter \(\alpha\) and the calculated virtual Nash equilibrium \(x^*_\alpha\)).
- Use the estimated weights to reconstruct the problem and solve for the robust Nash equilibrium \(x^*\) so that it is still valid in the worst - case scenario.

3. **Main contributions**:
- Propose a reverse learning method based on inverse variational inequalities to estimate the weights \(\beta\) in the black - box aggregator.
- Solve the robust Nash equilibrium problem by transforming the recovered aggregative game into a deterministic worst - case model and give the first - order conditions of the robust Nash equilibrium.
- Provide generalization performance guarantees for the learning method and evaluate its performance on new data through the upper bound of the violation probability.

### Formula summary

- **Aggregator definition**:
\[
\sigma(x)=\sum_{i = 1}^{N}\beta_i x_i
\]
where \(\beta_i\) is the weight of player \(i\) and \(x_i\) is the strategy of player \(i\).

- **Coupling constraint set**:
\[
\Omega_\alpha=\left\{x\in\mathbb{R}^{Nn}_+:\sum_{i = 1}^{N}\alpha_i^T x_i\leq b\right\}
\]

- **Inverse variational inequality relationship**:
\[
F(x^*_\alpha)^T(x - x^*_\alpha)\geq0,\quad\forall x\in\Omega_\alpha
\]

- **Optimization problem of the learning model**:
\[
\min_{\beta,\gamma,\delta}\|\delta\|
\]
Subject to:
\[
F(x^*_\alpha[k];\beta)^T x^*_\alpha[k]-\gamma[k]b\leq\delta[k],\quad\gamma[k]\leq0,
\]
\[
F_i(x^*_\alpha[k];\beta)-\gamma[k]\alpha_i[k]\geq0,\quad\forall i\in I
\]

- **Deterministic model of robust Nash equilibrium**:
\[
\min_{x_i\in\mathbb{R}^n_+,y_i\in\mathbb{R}^{m_i}_+}J_i(x_i,\hat{\sigma}(x))
\]
Subject to:
\[
\sum_{i = 1}^{N}y_i^T d_i\leq b,\quad D_i^T y_i - x_i = 0_n,\quad\forall i\in I