A Distributed Incentive Mechanism to Balance Demand and Communication Overhead for Multiple Federated Learning Tasks in IoV

Yuchuan Fu,Mengyuan Dong,Lingling Zhou,Changle Li,F. Richard Yu,Nan Cheng
DOI: https://doi.org/10.1109/jiot.2024.3510561
IF: 10.6
2024-01-01
IEEE Internet of Things Journal
Abstract:Federated Learning (FL), as a typical distributed machine learning framework, has been effectively applied to traffic flow optimization, driving behavior analysis, and other areas. However, the stability and efficiency of FL systems heavily rely on the quality and cooperation of participants. If participants find no profit in the FL process, they may reduce their willingness to participate due to energy consumption and limited resources. To bridge these gaps, this paper proposes a demand-balanced incentive mechanism for multiple FL tasks. Firstly, considering the time-varying channel characteristics in the Internet of Vehicles (IoV) scenario, two optimization problems are constructed: maximizing task-matching satisfaction and minimizing communication energy consumption. Secondly, these problems are transformed into a distributed incentive mechanism based on a Multi-Leader Multi-Follower (MLMF) Stackelberg game, and a bi-level Alternating Direction Method of Multipliers (ADMM) algorithm is proposed to solve for the optimal resource allocation and reward schemes that balance the demands of all parties. Furthermore, this paper designs a multi-agent deep reinforcement learning-based method to solve the incentive problem, thereby avoiding the impact of information asymmetry. Simulation results verify that the proposed scheme not only balances the demands of all parties but also enhances user participation without being affected by the number of participants, making it suitable for IoV environments.
What problem does this paper attempt to address?