Abstract:To leverage massive distributed data and computation resources, machine learning in the network edge is considered to be a promising technique, especially for large-scale model training. Federated learning (FL), as a paradigm of collaborative learning techniques, has obtained increasing research attention with the benefits of communication efficiency and improved data privacy. Due to the lossy communication channels and limited communication resources (e.g., bandwidth and power), it is of interest to investigate fast responding and accurate FL schemes over wireless systems. Hence, we investigate the problem of jointly optimized communication efficiency and resources for FL over wireless Internet of Things (IoT) networks. To reduce complexity, we divide the overall optimization problem into two subproblems, i.e., the client scheduling problem and the resource allocation problem. To reduce the communication costs for FL in wireless IoT networks, a new client scheduling policy is proposed by reusing stale local model parameters. To maximize successful information exchange over networks, a Lagrange multiplier method is first leveraged by decoupling variables, including power variables, bandwidth variables, and transmission indicators. Then, a linear-search-based power and bandwidth allocation method is developed. Given appropriate hyperparameters, we show that the proposed communication-efficient FL (CEFL) framework converges at a strong linear rate. Through extensive experiments, it is revealed that the proposed CEFL framework substantially boosts both the communication efficiency and learning performance of both training loss and test accuracy for FL over wireless IoT networks compared to a basic FL approach with uniform resource allocation.

Flexible LAN-WAN Orchestration for Communication Efficient Federated Learning over Large-Scale Mobile Devices

Hierarchical Federated Learning through LAN-WAN Orchestration

Asynchronous Federated Learning over Wireless Communication Networks.

Federated Learning with Unsourced Random Access.

Efficient and Less Centralized Federated Learning

Personalized Wireless Federated Learning for Large Language Models

Federated Learning with Flexible Architectures

Over-the-Air Federated Learning and Optimization

FLARE: A New Federated Learning Framework with Adjustable Learning Rates over Resource-Constrained Wireless Networks

Federated Learning over Wireless IoT Networks with Optimized Communication and Resources

Federated Learning with Additional Mechanisms on Clients to Reduce Communication Costs

Reconfigurable Intelligent Surface Enabled Federated Learning: A Unified Communication-Learning Design Approach

WHALE-FL: Wireless and Heterogeneity Aware Latency Efficient Federated Learning over Mobile Devices via Adaptive Subnetwork Scheduling

Communication-Efficient Federated Learning in Channel Constrained Internet of Things

Adaptive Hierarchical Federated Learning Over Wireless Networks

Bandwidth Constrained Client Selection and Scheduling for Federated Learning over SD-WAN

CELLM: An Efficient Communication in Large Language Models Training for Federated Learning

Conquering the Communication Constraints to Enable Large Pre-Trained Models in Federated Learning

Intelligent Reflecting Surface-Assisted Low-Latency Federated Learning over Wireless Networks

Decentralized Federated Learning with Intermediate Results in Mobile Edge Computing

Towards Scalable Wireless Federated Learning: Challenges and Solutions