Abstract:Federated Learning (FL) empowers Industrial Internet of Things (IIoT) with distributed intelligence of industrial automation thanks to its capability of distributed machine learning without any raw data exchange. However, it is rather challenging for lightweight IIoT devices to perform computation-intensive local model training over large-scale deep neural networks (DNNs). Driven by this issue, we develop a communication-computation efficient FL framework for resource-limited IIoT networks that integrates DNN partition technique into the standard FL mechanism, wherein IIoT devices perform local model training over the bottom layers of the objective DNN, and offload the top layers to the edge gateway side. Considering imbalanced data distribution, we derive the device-specific participation rate to involve the devices with better data distribution in more communication rounds. Upon deriving the device-specific participation rate, we propose to minimize the training delay under the constraints of device-specific participation rate, energy consumption and memory usage. To this end, we formulate a joint optimization problem of device scheduling and resource allocation (i.e. DNN partition point, channel assignment, transmit power, and computation frequency), and solve the long-term min-max mixed integer non-linear programming based on the Lyapunov technique. In particular, the proposed dynamic device scheduling and resource allocation (DDSRA) algorithm can achieve a trade-off to balance the training delay minimization and FL performance. We also provide the FL convergence bound for the DDSRA algorithm with both convex and non-convex settings. Experimental results demonstrate the derived device-specific participation rate in terms of feasibility, and show that the DDSRA algorithm outperforms baselines in terms of test accuracy and convergence time.

Resource Efficient Federated Learning and DAG Blockchain with Sharding in Digital Twin Driven Industrial IoT

Resource Efficient Asynchronous Federated Learning for Digital Twin Empowered IoT Network

Adaptive Federated Learning and Digital Twin for Industrial Internet of Things

Low-Latency Federated Learning and Blockchain for Edge Association in Digital Twin Empowered 6G Networks

Cooperative Federated Learning and Model Update Verification in Blockchain Empowered Digital Twin Edge Networks

Optimizing Federated Learning With Deep Reinforcement Learning for Digital Twin Empowered Industrial IoT

Dual-Driven Resource Management for Sustainable Computing in the Blockchain-Supported Digital Twin IoT

Sustainable Resource Allocation and Reduce Latency Based on Federated-Learning-Enabled Digital Twin in IoT Devices

Swarm Learning for Secure and Effective Industrial Federated Big Data Analytics

Communication-Efficient Federated Learning and Permissioned Blockchain for Digital Twin Edge Networks

Communication-Efficient Federated Learning for Digital Twin Edge Networks in Industrial IoT

Digital Twin Empowered Industrial IoT Based on Credibility-weighted Swarm Learning

Over-the-Air Federated Learning in Digital Twins Empowered UAV Swarms

Efficient Ring-topology Decentralized Federated Learning with Deep Generative Models for Industrial Artificial Intelligent

Federated Transfer Learning for IIoT Devices with Low Computing Power Based on Blockchain and Edge Computing

Blockchain-Enabled Service Optimizations in Supply Chain Digital Twin

Federated Reinforcement Learning-Based Resource Allocation for D2D-Aided Digital Twin Edge Networks in 6G Industrial IoT

Trustworthy DNN Partition for Blockchain-enabled Digital Twin in Wireless IIoT Networks

DRL-based Adaptive Sharding for Blockchain-based Federated Learning

A Survey on Digital Twin for Industrial Internet of Things: Applications, Technologies and Tools

Low-Latency Federated Learning With DNN Partition in Distributed Industrial IoT Networks