Abstract:Federated learning (FL) enables edge nodes to collaboratively contribute to constructing a global model without sharing their data. This is accomplished by devices computing local, private model updates that are then aggregated by a server. However, computational resource constraints and network communication can become a severe bottleneck for larger model sizes typical for deep learning applications. Edge nodes tend to have limited hardware resources (RAM, CPU), and the network bandwidth and reliability at the edge is a concern for scaling federated fleet applications. In this paper, we propose and evaluate a FL strategy inspired by transfer learning in order to reduce resource utilization on devices, as well as the load on the server and network in each global training round. For each local model update, we randomly select layers to train, freezing the remaining part of the model. In doing so, we can reduce both server load and communication costs per round by excluding all untrained layer weights from being transferred to the server. The goal of this study is to empirically explore the potential trade-off between resource utilization on devices and global model convergence under the proposed strategy. We implement the approach using the federated learning framework FEDn. A number of experiments were carried out over different datasets (CIFAR-10, CASA, and IMDB), performing different tasks using different deep-learning model architectures. Our results show that training the model partially can accelerate the training process, efficiently utilizes resources on-device, and reduce the data transmission by around 75% and 53% when we train 25%, and 50% of the model layers, respectively, without harming the resulting global model accuracy.

Parameter-Efficient Federated Learning for Edge Computing with End Devices Resource Limitation

Edge-cloud Collaborative Learning with Federated and Centralized Features

Energy-Aware, Device-to-Device Assisted Federated Learning in Edge Computing.

Toward Resource-Efficient Federated Learning in Mobile Edge Computing

Energy-Constrained D2D Assisted Federated Learning in Edge Computing

EdgeFed: Optimized Federated Learning Based on Edge Computing

Importance-Aware Data Selection and Resource Allocation in Federated Edge Learning System.

Parameters Compressed Mechanism in Federated Learning for Edge Computing

Adaptive Federated Learning in Resource Constrained Edge Computing Systems

FLEE: A Hierarchical Federated Learning Framework for Distributed Deep Neural Network over Cloud, Edge, and End Device

An Efficient Asynchronous Federated Learning Protocol for Edge Devices

Toward efficient resource utilization at edge nodes in federated learning

Efficient federated learning on resource-constrained edge devices based on model pruning

Federated Edge Learning with Blurred or Pseudo Data Sharing

Privacy-Preserving Asynchronous Federated Learning Mechanism for Edge Network Computing

Semi-Decentralized Federated Edge Learning with Data and Device Heterogeneity

Federated Learning in Mobile Edge Computing: An Edge-Learning Perspective for Beyond 5G

EdgeLD: Locally Distributed Deep Learning Inference on Edge Device Clusters

Accelerating DNN Training in Wireless Federated Edge Learning Systems

Towards Federated Learning Under Resource Constraints via Layer-wise Training and Depth Dropout

Energy-Aware Edge Association for Cluster-based Personalized Federated Learning