Game-theoretic Distributed Learning Approach for Heterogeneous-cost Task Allocation with Budget Constraints

Weiyi Yang,Xiaolu Liu,Lei He,Yonghao Du,Yingwu Chen
2024-04-05
Abstract:This paper investigates heterogeneous-cost task allocation with budget constraints (HCTAB), wherein heterogeneity is manifested through the varying capabilities and costs associated with different agents for task execution. Different from the centralized optimization-based method, the HCTAB problem is solved using a fully distributed framework, and a coalition formation game is introduced to provide a theoretical guarantee for this distributed framework. To solve the coalition formation game, a convergence-guaranteed log-linear learning algorithm based on heterogeneous cost is proposed. This algorithm incorporates two improvement strategies, namely, a cooperative exchange strategy and a heterogeneous-cost log-linear learning strategy. These strategies are specifically designed to be compatible with the heterogeneous cost and budget constraints characteristic of the HCTAB problem. Through ablation experiments, we demonstrate the effectiveness of these two improvements. Finally, numerical results show that the proposed algorithm outperforms existing task allocation algorithms and learning algorithms in terms of solving the HCTAB problem.
Computer Science and Game Theory
What problem does this paper attempt to address?
The problem that this paper attempts to solve is the Heterogeneous - Cost Task Allocation under Budget Constraints (HCTAB) problem. Specifically, the HCTAB problem involves different agents having different capabilities and costs when performing tasks, and these agents are subject to predefined budget limitations, such as storage limitations or battery limitations, etc. Therefore, how to efficiently assign tasks to appropriate agents while satisfying budget constraints has become an urgent problem to be solved. ### Core Challenges of the Problem 1. **Heterogeneity**: The capabilities and costs of each agent for performing different tasks are all different. 2. **Budget Constraints**: The total cost of all agents performing tasks cannot exceed the given budget. 3. **Distributed Decision - making**: In order to improve the robustness and scalability of the system, it is necessary to design a fully distributed framework to solve the problem instead of relying on a centralized controller. ### Main Contributions of the Paper 1. **Introduction of the Coalition - Formation Game (CFG)**: By constructing the CFG model, the global objective function is decomposed into the local utility functions of each agent, thereby providing a theoretically - guaranteed distributed framework. 2. **Proposal of the Log - Linear Learning Algorithm Based on Heterogeneous Costs (LLH)**: This algorithm combines two improvement strategies - the Cooperative Exchange Strategy (CE) and the Heterogeneous - Cost Log - Linear Learning Strategy (HLL) to adapt to the heterogeneous costs and budget constraints in the HCTAB problem. 3. **Experimental Verification**: Through numerical experiments, it is proved that the LLH algorithm is superior to existing algorithms in terms of solution quality and efficiency. ### Summary of Mathematical Formulas - **Task Reward**: \[ R_j=\sum_{k \in w_j} \max_{i \in S_j} h_{ik} \] where \(R_j\) is the reward of task \(j\), \(w_j\) is the set of capacities required for task \(j\), \(S_j\) is the set of agents assigned to task \(j\), and \(h_{ik}\) is the capability of agent \(i\) on capacity \(k\). - **Optimization Objective**: \[ \max \sum_{j \in T} R_j=\sum_{j \in T} \sum_{k \in w_j} \max_{i \in N} h_{ik}x_{ij} \] Constraints: \[ \sum_{j \in T} x_{ij} \leq 1 \quad \forall i \in N \] \[ \sum_{i \in N} \sum_{j \in T} c_{ij}x_{ij} \leq B \] where \(x_{ij}\) is a binary decision variable indicating whether agent \(i\) is assigned to task \(j\), \(c_{ij}\) is the cost of agent \(i\) performing task \(j\), and \(B\) is the budget. - **Coalition Value**: \[ v(C_j)=r(C_j)-c(C_j) \] where \(r(C_j)\) is the revenue function of coalition \(C_j\), representing the reward of task \(j\); \(c(C_j)\) is the cost function of coalition \(C_j\), ensuring that the budget constraints are satisfied. Through these methods and formulas, the paper successfully solves the problem of heterogeneous - cost task allocation under budget constraints and provides an efficient distributed solution.