Abstract:In this paper, the optimization of network performance to support the deployment of federated learning (FL) is investigated. In particular, in the considered model, each user owns a machine learning (ML) model by training through its own dataset, and then transmits its ML parameters to a base station (BS) which aggregates the ML parameters to obtain a global ML model and transmits it to each user. Due to limited radio frequency (RF) resources, the number of users that participate in FL is restricted. Meanwhile, each user uploading and downloading the FL parameters may increase communication costs thus reducing the number of participating users. To this end, we propose to introduce visible light communication (VLC) as a supplement to RF and use compression methods to reduce the resources needed to transmit FL parameters over wireless links so as to further improve the communication efficiency and simultaneously optimize wireless network through user selection and resource allocation. This user selection and bandwidth allocation problem is formulated as an optimization problem whose goal is to minimize the training loss of FL. We first use a model compression method to reduce the size of FL model parameters that are transmitted over wireless links. Then, the optimization problem is separated into two subproblems. The first subproblem is a user selection problem with a given bandwidth allocation, which is solved by a traversal algorithm. The second subproblem is a bandwidth allocation problem with a given user selection, which is solved by a numerical method. The ultimate user selection and bandwidth allocation are obtained by iteratively compressing the model and solving these two subproblems. Simulation results show that the proposed FL algorithm can improve the accuracy of object recognition by up to 16.7% and improve the number of selected users by up to 68.7%, compared to a conventional FL algorithm using only RF.

FWC: Fitting Weight Compression Method for Reducing Communication Traffic for Federated Learning

Understanding the Training Dynamics in Federated Deep Learning via Aggregation Weight Optimization

FedPSE: Personalized Sparsification with Element-wise Aggregation for Federated Learning

Secure Federated Learning with Model Compression.

Secure Federated Learning over Wireless Communication Networks with Model Compression

Bandwidth-Aware and Overlap-Weighted Compression for Communication-Efficient Federated Learning

Communication-Efficient Federated Learning through Adaptive Weight Clustering and Server-Side Distillation

Communication-Efficient Federated Learning with Adaptive Compression under Dynamic Bandwidth

Efficient Model Compression for Hierarchical Federated Learning

Federated learning compression designed for lightweight communications

Wireless Network Optimization for Federated Learning with Model Compression in Hybrid VLC/RF Systems

Adaptive Batchsize Selection and Gradient Compression for Wireless Federated Learning

Conquering the Communication Constraints to Enable Large Pre-Trained Models in Federated Learning

Fed-CVLC: Compressing Federated Learning Communications with Variable-Length Codes

Communication Optimization in Large Scale Federated Learning using Autoencoder Compressed Weight Updates

Joint Compression and Deadline Optimization for Wireless Federated Learning

Efficient Model Compression via Global Sparsification for Over-the-Air Federated Learning.

A Communication-Efficient Hierarchical Federated Learning Framework via Shaping Data Distribution at Edge

Expediting In-Network Federated Learning by Voting-Based Consensus Model Compression

Snowball: Energy Efficient and Accurate Federated Learning with Coarse-to-Fine Compression over Heterogeneous Wireless Edge Devices

Stochastic Controlled Averaging for Federated Learning with Communication Compression