Abstract:Combination of the industrial Internet of Things (IIoT) and federated learning (FL) is deemed as a promising solution to realizing Industry 4.0 and beyond. In this paper, we focus on a hierarchical collaborative FL architecture over the IIoT systems, where the three-layer architectural design is conceived for supporting the training process. To effectively balance among the learning speed, energy consumption, and packet error rate for edge aggregation with regard to the participating IIoT devices, a weighted learning utility function is developed from the perspective of the fusing multiple performance metrics. An optimization problem is formulated to maximize the weighted learning utility by jointly optimizing the edge association as well as the allocations of resource block (RB), computation capacity, and transmit power of each IIoT device, under the practical constraints of the FL training process. The resulting problem is a non-convex and mixed integer optimization problem, and consequently it is difficult to solve. By resorting to the block coordinate descent method, we propose an overall alternating optimization algorithm to solve this problem in an iterative way. Specifically, in each iteration, for given transmit power and computation capacity, the sub-problem of joint RB assignment and edge association is transformed to a three-uniform weighted hypergraph model, which is solved by the local search-based three-dimensional hypergraph matching algorithm. Second, given RB assignment, edge association, and computation capacity, we employ the successive convex approximation method to tackle the sub-problem for optimizing the transmit power by turning it into a convex approximation problem. After the proposed alternating optimization algorithm converges to a tolerance threshold, a locally optimal solution of the original problem can be found. Numerical results reveal that our proposed joint optimization scheme can increase the system-wide learning utility and achieve significant performance gains over the four benchmark schemes.

Client Scheduling for Multi-Server Federated Learning in Industrial IoT With Unreliable Communications

Joint Client Scheduling and Wireless Resource Allocation for Heterogeneous Federated Edge Learning with Non-IID Data

Client Scheduling in Wireless Federated Learning Based on Channel and Learning Qualities

Online Client Scheduling for Fast Federated Learning

Federated Learning over Wireless IoT Networks with Optimized Communication and Resources

Communication Efficient Federated Learning With Heterogeneous Structured Client Models

Optimizing Federated Learning in Distributed Industrial IoT: A Multi-Agent Approach.

Federated-Learning-Based Client Scheduling for Low-Latency Wireless Communications

Online Client Scheduling and Resource Allocation for Efficient Federated Edge Learning

Optimizing Tradeoff Between Learning Speed and Cost for Federated Learning-Enabled Industrial IoT

Realizing the Heterogeneity: A Self-Organized Federated Learning Framework for IoT

Federated Learning over the Industrial Internet of Things: A Joint Optimization of Edge Association and Resource Allocation

Evaluation and Optimization of Distributed Machine Learning Techniques for Internet of Things

Low-Latency Federated Learning With DNN Partition in Distributed Industrial IoT Networks

Communication-efficient hierarchical federated learning for IoT heterogeneous systems with imbalanced data

Learner Referral for Cost-Effective Federated Learning over Hierarchical IoT Networks.

Grouped federated learning for time-sensitive tasks in industrial IoTs

Communication-Efficient Semihierarchical Federated Analytics in IoT Networks

Device Scheduling and Assignment in Hierarchical Federated Learning for Internet of Things

TRAIL: Trust-Aware Client Scheduling for Semi-Decentralized Federated Learning

Jointly Optimizing Client Selection and Resource Management in Wireless Federated Learning for Internet of Things