Abstract:The data heterogeneity across devices and the limited communication resources, e.g., bandwidth and energy, are two of the main bottlenecks for wireless federated learning (FL). To tackle these challenges, we first devise a novel FL framework with partial model aggregation (PMA). This approach aggregates the lower layers of neural networks, responsible for feature extraction, at the parameter server while keeping the upper layers, responsible for complex pattern recognition, at devices for personalization. The proposed PMA-FL is able to address the data heterogeneity and reduce the transmitted information in wireless channels. Then, we derive a convergence bound of the framework under a non-convex loss function setting to reveal the role of unbalanced data size in the learning performance. On this basis, we maximize the scheduled data size to minimize the global loss function through jointly optimize the device scheduling, bandwidth allocation, computation and communication time division policies with the assistance of Lyapunov optimization. Our analysis reveals that the optimal time division is achieved when the communication and computation parts of PMA-FL have the same power. We also develop a bisection method to solve the optimal bandwidth allocation policy and use the set expansion algorithm to address the device scheduling policy. Compared with the benchmark schemes, the proposed PMA-FL improves 3.13\% and 11.8\% accuracy on two typical datasets with heterogeneous data distribution settings, i.e., MINIST and CIFAR-10, respectively. In addition, the proposed joint dynamic device scheduling and resource management approach achieve slightly higher accuracy than the considered benchmarks, but they provide a satisfactory energy and time reduction: 29\% energy or 20\% time reduction on the MNIST; and 25\% energy or 12.5\% time reduction on the CIFAR-10.

Partial Synchronization to Accelerate Federated Learning over Relay-Assisted Edge Networks

FedPSE: Personalized Sparsification with Element-wise Aggregation for Federated Learning

Asynchronous Federated Learning over Wireless Communication Networks.

No One Idles: Efficient Heterogeneous Federated Learning with Parallel Edge and Server Computation.

An Efficient Asynchronous Federated Learning Protocol for Edge Devices

Enhancing Edge-Assisted Federated Learning with Asynchronous Aggregation and Cluster Pairing

Federated Learning in Multi-RIS-Aided Systems

Deep Learning Based Coded Over-the-Air Computation for Personalized Federated Learning

Towards Efficient Asynchronous Federated Learning in Heterogeneous Edge Environments

Accelerating Asynchronous Federated Learning Convergence via Opportunistic Mobile Relaying

FedRelay: Federated Relay Learning for 6G Mobile Edge Intelligence

Accelerating Decentralized Federated Learning in Heterogeneous Edge Computing

Device Scheduling for Relay-assisted Over-the-Air Aggregation in Federated Learning

Efficient Wireless Federated Learning with Partial Model Aggregation

Efficient and Less Centralized Federated Learning

Scalable and Low-Latency Federated Learning with Cooperative Mobile Edge Networking

Computation and Communication Efficient Federated Learning With Adaptive Model Pruning

AEDFL: Efficient Asynchronous Decentralized Federated Learning with Heterogeneous Devices

ParallelSFL: A Novel Split Federated Learning Framework Tackling Heterogeneity Issues

Split-FL: An Efficient Online Federated Learning Framework with Constrained Computation and Streaming Data

Relay-Assisted Federated Edge Learning: Performance Analysis and System Optimization