Abstract:The Stackelberg game depicts a leader-follower relationship wherein decisions are made sequentially, and the Stackelberg equilibrium represents an expected optimal solution when the leader can anticipate the rational response of the follower. Motivated by control of network systems with two levels of decision-making hierarchy, such as the management of energy networks and power coordination at cellular networks, a networked multi-leaders and multi-followers Stackelberg game is proposed. Due to the constraint of limited information interaction among players, a clustered information structure is assumed that each leader can only communicate with a portion of overall followers, namely its subordinated followers, and also only with its local neighboring leaders. In this case, the leaders cannot fully anticipate the collective rational response of all followers with its local information. To address Stackelberg equilibrium seeking under this partial information structure, we propose a distributed seeking algorithm based on implicit gradient estimation and network consensus mechanisms. We rigorously prove the convergence of the algorithm for both diminishing and constant step sizes under strict and strong monotonicity conditions, respectively. Furthermore, the model and the algorithm can also incorporate linear equality and inequality constraints into the followers' optimization problems, with the approach of the interior point barrier function. Finally, we present numerical simulations in applications to corroborate our claims on the proposed framework.

A Stackelberg Game Model of Flocking

Cucker-Smale Flocking Behavior for Multiagent Networks With Coopetition Interactions and Communication Delays

Flocking Control for Discrete-Time Cucker-Smale Model on Cooperation Networks*

Emergence of bipartite flocking behavior for Cucker-Smale model on cooperation-competition networks with time-varying delays

Stackelberg Strategic Guidance for Heterogeneous Robots Collaboration

Model Predictive Flocking Control for Second-Order Multi-Agent Systems with Input Constraints

Distributed Stackelberg Equilibrium Seeking for Networked Multi-Leader Multi-Follower Games with A Clustered Information Structure

Multi-Agent Bipartite Flocking Control Over Cooperation-Competition Networks With Asynchronous Communications

Stackelberg vs. Nash in the Lottery Colonel Blotto Game

A Model Predictive Stackelberg Solution to Orbital Pursuit-Evasion Game

Bipartite Flocking Control for Multi-Agent Systems with Switching Topologies and Time Delays under Coopetition Interactions

A Linear-quadratic Mean-Field Stochastic Stackelberg Differential Game with Random Exit Time

Solving Strongly Convex and Smooth Stackelberg Games Without Modeling the Follower

Who Plays First? Optimizing the Order of Play in Stackelberg Games with Many Robots

Flocking analysis and control of a nonlinear collective migration model

Efficient Stackelberg Strategies for Finitely Repeated Games

Linear-Quadratic Stochastic Stackelberg Games of N Players for Time-Delay Systems and Related FBSDEs

Evolutionary Prisoner’s Dilemma Game in Flocks

Cucker-Smale flocking over cooperation-competition networks

On Repeated Stackelberg Security Game with the Cooperative Human Behavior Modelfor Wildlife Protection.

Birds of a Feather Flock Together: A Close Look at Cooperation Emergence via Multi-Agent RL