Abstract:Combination of the industrial Internet of Things (IIoT) and federated learning (FL) is deemed as a promising solution to realizing Industry 4.0 and beyond. In this paper, we focus on a hierarchical collaborative FL architecture over the IIoT systems, where the three-layer architectural design is conceived for supporting the training process. To effectively balance among the learning speed, energy consumption, and packet error rate for edge aggregation with regard to the participating IIoT devices, a weighted learning utility function is developed from the perspective of the fusing multiple performance metrics. An optimization problem is formulated to maximize the weighted learning utility by jointly optimizing the edge association as well as the allocations of resource block (RB), computation capacity, and transmit power of each IIoT device, under the practical constraints of the FL training process. The resulting problem is a non-convex and mixed integer optimization problem, and consequently it is difficult to solve. By resorting to the block coordinate descent method, we propose an overall alternating optimization algorithm to solve this problem in an iterative way. Specifically, in each iteration, for given transmit power and computation capacity, the sub-problem of joint RB assignment and edge association is transformed to a three-uniform weighted hypergraph model, which is solved by the local search-based three-dimensional hypergraph matching algorithm. Second, given RB assignment, edge association, and computation capacity, we employ the successive convex approximation method to tackle the sub-problem for optimizing the transmit power by turning it into a convex approximation problem. After the proposed alternating optimization algorithm converges to a tolerance threshold, a locally optimal solution of the original problem can be found. Numerical results reveal that our proposed joint optimization scheme can increase the system-wide learning utility and achieve significant performance gains over the four benchmark schemes.

Grouped federated learning for time-sensitive tasks in industrial IoTs

Data Heterogeneity-Robust Federated Learning via Group Client Selection in Industrial IoT

Hierarchical Federated Edge Learning with Adaptive Clustering in Internet of Things

Federated Learning over the Industrial Internet of Things: A Joint Optimization of Edge Association and Resource Allocation

Federated Learning with Unsourced Random Access.

Joint Device Selection and Bandwidth Allocation for Cost-Efficient Federated Learning in Industrial Internet of Things

Efficient Adaptive Federated Optimization of Federated Learning for IoT

Privacy-Preserving Asynchronous Grouped Federated Learning for IoT

Optimizing Tradeoff Between Learning Speed and Cost for Federated Learning-Enabled Industrial IoT

Hybrid IoT Device Selection with Knowledge Transfer for Federated Learning

Towards Fast and Accurate Federated Learning with Non-Iid Data for Cloud-Based IoT Applications

Device Scheduling and Assignment in Hierarchical Federated Learning for Internet of Things

A Survey on Federated Learning and its Applications for Accelerating Industrial Internet of Things

Efficient Adaptive Federated Learning in Resource-Constrained IoT Environments

Optimizing Federated Learning in Distributed Industrial IoT: A Multi-Agent Approach.

FCBAFL: an Energy-Conserving Federated Learning Approach in Industrial Internet of Things

Client Scheduling for Multi-Server Federated Learning in Industrial IoT With Unreliable Communications

Resource Efficient Asynchronous Federated Learning for Digital Twin Empowered IoT Network

Computation and Communication Efficient Adaptive Federated Optimization of Federated Learning for Internet of Things

Adaptive Federated Learning and Digital Twin for Industrial Internet of Things

Heterogeneity-aware device selection for clustered federated learning in IoT