Abstract:This paper studies an edge intelligence-based IoT network in which a set of edge servers learn a shared model using federated learning (FL) based on the datasets uploaded from a multi-technology-supported IoT network. The data uploading performance of IoT network and the computational capacity of edge servers are entangled with each other in influencing the FL model training process. We propose a novel framework, called federated edge intelligence (FEI), that allows edge servers to evaluate the required number of data samples according to the energy cost of the IoT network as well as their local data processing capacity and only request the amount of data that is sufficient for training a satisfactory model. We evaluate the energy cost for data uploading when two widely-used IoT solutions: licensed band IoT (e.g., 5G NB-IoT) and unlicensed band IoT (e.g., Wi-Fi, ZigBee, and 5G NR-U) are available to each IoT device. We prove that the cost minimization problem of the entire IoT network is separable and can be divided into a set of subproblems, each of which can be solved by an individual edge server. We also introduce a mapping function to quantify the computational load of edge servers under different combinations of three key parameters: size of the dataset, local batch size, and number of local training passes. Finally, we adopt an Alternative Direction Method of Multipliers (ADMM)-based approach to jointly optimize energy cost of the IoT network and average computing resource utilization of edge servers. We prove that our proposed algorithm does not cause any data leakage nor disclose any topological information of the IoT network. Simulation results show that our proposed framework significantly improves the resource efficiency of the IoT network and edge servers with only a limited sacrifice on the model convergence performance.

Efficient Federated Learning in Resource-Constrained Edge Intelligence Networks using Model Compression

Efficient Federated Learning with Adaptive Channel Pruning for Edge Devices

Efficient federated learning on resource-constrained edge devices based on model pruning

Cost-Efficient Federated Learning for Edge Intelligence in Multi-Cell Networks

Secure Federated Learning with Model Compression.

Optimizing Resource-Efficiency for Federated Edge Intelligence in IoT Networks

Adaptive Network Pruning for Wireless Federated Learning

An Efficient Asynchronous Federated Learning Protocol for Edge Devices

To Talk or to Work: Flexible Communication Compression for Energy Efficient Federated Learning over Heterogeneous Mobile Edge Devices

Secure Federated Learning over Wireless Communication Networks with Model Compression

IoT Device Friendly and Communication Efficient Federated Learning via Joint Model Pruning and Quantization

Snowball: Energy Efficient and Accurate Federated Learning with Coarse-to-Fine Compression over Heterogeneous Wireless Edge Devices

Joint Resource Allocation for Efficient Federated Learning in Internet of Things Supported by Edge Computing.

Joint Model Pruning and Device Selection for Communication-Efficient Federated Edge Learning

Toward efficient resource utilization at edge nodes in federated learning

Accelerating Decentralized Federated Learning in Heterogeneous Edge Computing

AnycostFL: Efficient On-Demand Federated Learning over Heterogeneous Edge Devices

Communication-Efficient Federated Learning with Adaptive Compression under Dynamic Bandwidth

Federated Learning With Client Selection and Gradient Compression in Heterogeneous Edge Systems

Model Pruning-enabled Federated Split Learning for Resource-constrained Devices in Artificial Intelligence Empowered Edge Computing Environment

Efficient Model Compression via Global Sparsification for Over-the-Air Federated Learning.