Abstract:Federated Learning (FL) empowers Industrial Internet of Things (IIoT) with distributed intelligence of industrial automation thanks to its capability of distributed machine learning without any raw data exchange. However, it is rather challenging for lightweight IIoT devices to perform computation-intensive local model training over large-scale deep neural networks (DNNs). Driven by this issue, we develop a communication-computation efficient FL framework for resource-limited IIoT networks that integrates DNN partition technique into the standard FL mechanism, wherein IIoT devices perform local model training over the bottom layers of the objective DNN, and offload the top layers to the edge gateway side. Considering imbalanced data distribution, we derive the device-specific participation rate to involve the devices with better data distribution in more communication rounds. Upon deriving the device-specific participation rate, we propose to minimize the training delay under the constraints of device-specific participation rate, energy consumption and memory usage. To this end, we formulate a joint optimization problem of device scheduling and resource allocation (i.e. DNN partition point, channel assignment, transmit power, and computation frequency), and solve the long-term min-max mixed integer non-linear programming based on the Lyapunov technique. In particular, the proposed dynamic device scheduling and resource allocation (DDSRA) algorithm can achieve a trade-off to balance the training delay minimization and FL performance. We also provide the FL convergence bound for the DDSRA algorithm with both convex and non-convex settings. Experimental results demonstrate the derived device-specific participation rate in terms of feasibility, and show that the DDSRA algorithm outperforms baselines in terms of test accuracy and convergence time.

Adaptive Decentralized Federated Learning in Resource-Constrained IoT Networks

Efficient Adaptive Federated Learning in Resource-Constrained IoT Environments

Adaptive Decentralized Federated Learning in Energy and Latency Constrained Wireless Networks

Enhancing Decentralized Federated Learning with Model Pruning and Adaptive Communication

Federated Learning over Wireless IoT Networks with Optimized Communication and Resources

Secure Federated Learning with Model Compression.

Computation and Communication Efficient Adaptive Federated Optimization of Federated Learning for Internet of Things

Performance Analysis for Resource Constrained Decentralized Federated Learning Over Wireless Networks

Decentralized Federated Learning with Intermediate Results in Mobile Edge Computing

Decentralized Federated Learning with Data Feature Transmission and Neighbor Selection.

Communication-Efficient Federated Learning with Adaptive Compression under Dynamic Bandwidth

Low-Latency Federated Learning With DNN Partition in Distributed Industrial IoT Networks

Decentralized Federated Learning on the Edge over Wireless Mesh Networks

Efficient Adaptive Federated Optimization of Federated Learning for IoT

A Flexible Model Compression and Resource Allocation Scheme for Federated Learning

Federated Learning over Wireless Device-to-Device Networks: Algorithms and Convergence Analysis

Quantized Distributed Federated Learning for Industrial Internet of Things

Hierarchically Federated Learning in Wireless Networks: D2D Consensus and Inter-Cell Aggregation

Energy-Efficient Federated Learning in IoT Networks

Decentralized Federated Learning: Balancing Communication and Computing Costs

A Survey on Federated Learning for Resource-Constrained IoT Devices