Abstract:Federated Learning (FL) empowers Industrial Internet of Things (IIoT) with distributed intelligence of industrial automation thanks to its capability of distributed machine learning without any raw data exchange. However, it is rather challenging for lightweight IIoT devices to perform computation-intensive local model training over large-scale deep neural networks (DNNs). Driven by this issue, we develop a communication-computation efficient FL framework for resource-limited IIoT networks that integrates DNN partition technique into the standard FL mechanism, wherein IIoT devices perform local model training over the bottom layers of the objective DNN, and offload the top layers to the edge gateway side. Considering imbalanced data distribution, we derive the device-specific participation rate to involve the devices with better data distribution in more communication rounds. Upon deriving the device-specific participation rate, we propose to minimize the training delay under the constraints of device-specific participation rate, energy consumption and memory usage. To this end, we formulate a joint optimization problem of device scheduling and resource allocation (i.e. DNN partition point, channel assignment, transmit power, and computation frequency), and solve the long-term min-max mixed integer non-linear programming based on the Lyapunov technique. In particular, the proposed dynamic device scheduling and resource allocation (DDSRA) algorithm can achieve a trade-off to balance the training delay minimization and FL performance. We also provide the FL convergence bound for the DDSRA algorithm with both convex and non-convex settings. Experimental results demonstrate the derived device-specific participation rate in terms of feasibility, and show that the DDSRA algorithm outperforms baselines in terms of test accuracy and convergence time.

Adaptive Federated Learning for Battery-powered IIoT Devices with Non-IID Data

Optimize Scheduling of Federated Learning on Battery-powered Mobile Devices

Hierarchical Federated Learning with Adaptive Clustering on Non-IID Data

Adaptive Federated Learning on Non-IID Data with Resource Constraint

Joint User Association and Resource Allocation for Wireless Hierarchical Federated Learning with IID and Non-IID Data

Federated Split Learning for Distributed Intelligence with Resource-Constrained Devices

Efficient and Flexible Management for Industrial Internet of Things: A Federated Learning Approach.

Deep Reinforcement Learning for Energy Efficiency Maximization in SWIPT-Based Over-the-Air Federated Learning

Over-the-air Learning Rate Optimization for Federated Learning

Federated Learning in Multi-RIS-Aided Systems

Low-Latency Federated Learning With DNN Partition in Distributed Industrial IoT Networks

Energy Efficient Federated Learning in Internet of Vehicles: A Game Theoretic Scheme

Resource Efficient Asynchronous Federated Learning for Digital Twin Empowered IoT Network

Resources-efficient Adaptive Federated Learning for Digital Twin-Enabled IIoT

Optimizing Tradeoff Between Learning Speed and Cost for Federated Learning-Enabled Industrial IoT

Federated Split Learning for Edge Intelligence in Resource-Constrained Wireless Networks

Experience-Driven Computational Resource Allocation of Federated Learning by Deep Reinforcement Learning

Age-of-Information Minimization in Federated Learning based Networks with Non-IID Dataset

Federated Learning-Oriented Edge Computing Framework for the IIoT

FedSR: A Semi-Decentralized Federated Learning Algorithm for Non-IIDness in IoT System

Towards Fast and Accurate Federated Learning with Non-Iid Data for Cloud-Based IoT Applications