Abstract:Nowadays, the industrial Internet of Things (IIoT) has played an integral role in Industry 4.0 and produced massive amounts of data for industrial intelligence. These data locate on decentralized devices in modern factories. To protect the confidentiality of industrial data, federated learning (FL) was introduced to collaboratively train shared machine learning models. However, the local data collected by different devices skew in class distribution and degrade industrial FL performance. This challenge has been widely studied at the mobile edge, but they ignored the rapidly changing streaming data and clustering nature of factory devices, and more seriously, they may threaten data security. In this paper, we propose FedGS, which is a hierarchical cloud-edge-end FL framework for 5G empowered industries, to improve industrial FL performance on non-i.i.d. data. Taking advantage of naturally clustered factory devices, FedGS uses a gradient-based binary permutation algorithm (GBP-CS) to select a subset of devices within each factory and build homogeneous super nodes participating in FL training. Then, we propose a compound-step synchronization protocol to coordinate the training process within and among these super nodes, which shows great robustness against data heterogeneity. The proposed methods are time-efficient and can adapt to dynamic environments, without exposing confidential industrial data in risky manipulation. We prove that FedGS has better convergence performance than FedAvg and give a relaxed condition under which FedGS is more communication-efficient. Extensive experiments show that FedGS improves accuracy by 3.5% and reduces training rounds by 59% on average, confirming its superior effectiveness and efficiency on non-i.i.d. data.

Federated Learning on 5G Edge for Industrial Internet of Things

Federated Learning for 6G Edge Intelligence - Concepts, Challenges and Solutions.

Federated Learning in Mobile Edge Computing: An Edge-Learning Perspective for Beyond 5G

Federated Learning-Oriented Edge Computing Framework for the IIoT

Hierarchical Federated Edge Learning with Adaptive Clustering in Internet of Things

Computational Intelligence and Deep Learning for Next-Generation Edge-Enabled Industrial IoT

Federated Transfer Learning for IIoT Devices with Low Computing Power Based on Blockchain and Edge Computing

Communication-Efficient Federated Learning for Digital Twin Edge Networks in Industrial IoT

Data Heterogeneity-Robust Federated Learning via Group Client Selection in Industrial IoT

An Efficient Industrial Federated Learning Framework for AIoT: A Face Recognition Application

In-Edge AI: Intelligentizing Mobile Edge Computing, Caching and Communication by Federated Learning

Towards Communication-Efficient and Attack-Resistant Federated Edge Learning for Industrial Internet of Things

Blockchain and Federated Learning for 5G Beyond

A Survey on Federated Learning and its Applications for Accelerating Industrial Internet of Things

Survey: federated learning data security and privacy-preserving in edge-Internet of Things

Federated Reinforcement Learning-Based Resource Allocation for D2D-Aided Digital Twin Edge Networks in 6G Industrial IoT

Robust Federated Learning for Edge-Intelligent Networks

Federated Learning for Industrial Internet of Things in Future Industries

SCOF: Security-Aware Computation Offloading Using Federated Reinforcement Learning in Industrial Internet of Things with Edge Computing

Edge-assisted U-Shaped Split Federated Learning with Privacy-preserving for Internet of Things