Abstract:We study a Stackelberg game to examine how two agents determine to cooperate while competing with each other. Each selects an arrival time to a destination, the earlier one fetching a higher reward. There is, however, an inherent penalty in arriving too early as well as a risk in traveling alone. This gives rise to the possibility of the agents cooperating by traveling together while competing for the reward. In our prior work [1] we studied this problem as a sequential game among a set of $N$ competing agents in continuous time, and defined the formation of a group traveling together as arriving at exactly the same time. In the present study, we relax this definition to allow arrival times within a small window, and study a 2-agent game in both continuous and discrete time, referred to as the flock formation game. We derive and examine the properties of the subgame perfect equilibrium (SPE) of this game.
What problem does this paper attempt to address?
The problem that this paper attempts to solve is: how to decide cooperation and competition between two agents in order to determine the optimal time for each to reach their destinations. Each agent selects an arrival time, and the earlier arrival can obtain a higher reward, but arriving too early will bring inherent penalties and the risk of traveling alone. Therefore, these two agents may cooperate by traveling together while competing for rewards.
Specifically, the paper studies the Stackelberg game model to explore the following issues:
1. **Balance between cooperation and competition**: How do the two agents find a balance between cooperation (i.e., traveling together to reduce risks) and competition (i.e., striving to arrive earlier to obtain higher rewards)?
2. **Selection of arrival time**: How does each agent select its arrival time to maximize its own benefits?
3. **Impact of group formation**: The impact of relaxing the group definition (allowing arrivals within a certain time window to be regarded as a group) on agent decisions and equilibrium results.
### Main contributions of the paper
1. **Relaxing the group definition**: Compared with previous studies, this paper relaxes the group definition, allowing agents to be regarded as a group when arriving within a certain time window, rather than having to arrive at the same time.
2. **Continuous - time and discrete - time models**: The sub - game perfect equilibrium (SPE) in two time models is studied, and the equilibrium types under different conditions are analyzed.
3. **Change in the intensity of competition**: Due to the relaxation of the group definition, the competition among agents becomes more intense. Especially in the continuous - time model, weak agents can obtain better resources and group welfare by arriving slightly earlier.
### Mathematical model
The utility function of agent \(i\) is:
\[ u_i(t) = e_i(t) - c_i(t_i) - \bar{p}_i(t) \]
where:
- \( e_i(t) \) is the reward obtained by agent \(i\) from the acquired territory:
- If \( t_i < t_{-i} \), then \( e_i(t) = E_1 \)
- If \( t_i > t_{-i} \), then \( e_i(t) = E_2 \)
- If \( t_i = t_{-i} \), according to the priority rule, the strong agent obtains \( E_1 \), and the weak agent obtains \( E_2 \)
- \( c_i(t_i) \) is the travel cost, which depends on the time selected by the agent:
\[ c_i(t_i) = \frac{1}{\beta_i}(t_i - t_0)^2 + c_{i0} \]
where \( t_0 \) is the optimal arrival time, \(\beta_i\) is the strength parameter of the agent, and \( c_{i0}\) is the fixed cost.
- \(\bar{p}_i(t)\) is the predation risk term:
\[ \bar{p}_i(t) = r \left| \left\{ j : |t_j - t_i| \leq w \right\} \right| \]
where \( r\) is the nominal risk of a single individual, and \( w\) is the size of the time window.
### Main conclusions
1. **Continuous - time model**: There are three types of pure - strategy SPE, and the weak agent always arrives later than the strong agent.
2. **Discrete - time model**: There are five types of pure - strategy SPE, and the weak agent may arrive earlier than the strong agent.
3. **Comparison with the strict group model**: After relaxing the group definition, the competition is more intense, and the strict group is no longer the only SPE.
Through these studies, the paper reveals how the relaxation of the group definition affects the cooperation and competition behaviors of agents and provides more abundant types of sub - game perfect equilibrium.