Adaptive Incentivize for Cross-Silo Federated Learning in IIoT: A Multi-agent Reinforcement Learning Approach

Shijing Yuan,Beiyu Dong,Hongtao Lvy,Hongze Liu,Hongyang Chen,Chentao Wu,Song Guo,Yue Ding,Jie Li
DOI: https://doi.org/10.1109/jiot.2023.3315770
IF: 10.6
2023-01-01
IEEE Internet of Things Journal
Abstract:In the Industrial Internet of Things (IIoT), Cross-Silo Federated Learning (CSFL) enables entities such as manufacturers and suppliers to train global models for optimizing production processes while ensuring data privacy. A well-designed incentive mechanism is essential to persuade clients to contribute data resources. However, existing methodologies overlook the dynamic nature of the training process, where the accuracy of the globally trained model and the clients data ownership change over time. Furthermore, the majority of previous research assumes a defined functional relationship between the data contribution and the model accuracy, which is infeasible in realistic and dynamic training environments. To address these challenges, we design a novel adaptive mechanism for CSFL that inspires organizations to contribute data resources in a dynamic training environment with the aim of maximizing their long-term payoffs. This mechanism leverages multi-agent reinforcement learning (MARL) to ascertain near-optimal data contribution strategies from potential game histories without necessitating private organizational information or a precise accuracy function. Experimental results indicate that our mechanism achieves adaptive incentive in dynamic environments and effectively enhances the long-term payoffs of organizations.
computer science, information systems,telecommunications,engineering, electrical & electronic
What problem does this paper attempt to address?