Abstract:Federated learning (FL) is a distributed machine learning technology for next-generation AI systems that allows a number of workers, i.e., edge devices, collaboratively learn a shared global model while keeping their data locally to prevent privacy leakage. Enabling FL over wireless multi-hop networks can democratize AI and make it accessible in a cost-effective manner. However, the noisy bandwidth-limited multi-hop wireless connections can lead to delayed and nomadic model updates, which significantly slows down the FL convergence speed. To address such challenges, this paper aims to accelerate FL convergence over wireless edge by optimizing the multi-hop federated networking performance. In particular, the FL convergence optimization problem is formulated as a Markov decision process (MDP). To solve such MDP, multi-agent reinforcement learning (MA-RL) algorithms along with domain-specific action space refining schemes are developed, which online learn the delay-minimum forwarding paths to minimize the model exchange latency between the edge devices (i.e., workers) and the remote server. To validate the proposed solutions, EdgeML is developed and implemented, which is the first experimental framework in the literature for FL over multi-hop wireless edge computing networks. EdgeML allows us to fast prototype, deploy, and evaluate novel FL algorithms along with RL-based system optimization methods in real wireless devices. Moreover, a physical experimental testbed is implemented by customizing the widely adopted Linux wireless routers and ML computing nodes. Such testbed can provide valuable insights into the practical performance of FL in the field. Finally, our experimentation results on the testbed show that the proposed network-accelerated FL system can practically and significantly improve FL convergence speed, compared to the FL system empowered by the production-grade commercially-available wireless networking protocol, BATMAN-Adv.

Federated Learning for Wireless Applications: A Prototype

Asynchronous Federated Learning over Wireless Communication Networks.

FedAir: Towards Multi-hop Federated Learning Over-the-Air

EdgeML: Towards network-accelerated federated learning over wireless edge

Federated Learning over Wireless Fading Channels

Federated Learning in Multi-RIS-Aided Systems

Decentralized Federated Learning on the Edge over Wireless Mesh Networks

Energy Efficient Federated Learning over Heterogeneous Mobile Devices via Joint Design of Weight Quantization and Wireless Transmission

Over-the-Air Federated Learning In Broadband Communication

Over-The-Air Clustered Wireless Federated Learning

Federated Learning over Wireless IoT Networks with Optimized Communication and Resources

Towards Scalable Wireless Federated Learning: Challenges and Solutions

FedBroadcast: Exploit Broadcast Channel for Fast Convergence in Wireless Federated Learning

Federated Learning over Wireless Networks: Convergence Analysis and Resource Allocation

Online-Score-Aided Federated Learning: Taming the Resource Constraints in Wireless Networks

Seeing is Believing: A Federated Learning Based Prototype to Detect Wireless Injection Attacks

A Joint Learning and Communications Framework for Federated Learning over Wireless Networks

Deep Reinforcement Learning-Empowered Federated Learning for Wireless Clients with Energy and Bandwidth Constraints

The Role of Federated Learning in a Wireless World with Foundation Models

Federated Learning over Wireless Networks: Optimization Model Design and Analysis

Robust Design of Federated Learning for Edge-Intelligent Networks