Abstract:In this paper, the optimization of network performance to support the deployment of federated learning (FL) is investigated. In particular, in the considered model, each user owns a machine learning (ML) model by training through its own dataset, and then transmits its ML parameters to a base station (BS) which aggregates the ML parameters to obtain a global ML model and transmits it to each user. Due to limited radio frequency (RF) resources, the number of users that participate in FL is restricted. Meanwhile, each user uploading and downloading the FL parameters may increase communication costs thus reducing the number of participating users. To this end, we propose to introduce visible light communication (VLC) as a supplement to RF and use compression methods to reduce the resources needed to transmit FL parameters over wireless links so as to further improve the communication efficiency and simultaneously optimize wireless network through user selection and resource allocation. This user selection and bandwidth allocation problem is formulated as an optimization problem whose goal is to minimize the training loss of FL. We first use a model compression method to reduce the size of FL model parameters that are transmitted over wireless links. Then, the optimization problem is separated into two subproblems. The first subproblem is a user selection problem with a given bandwidth allocation, which is solved by a traversal algorithm. The second subproblem is a bandwidth allocation problem with a given user selection, which is solved by a numerical method. The ultimate user selection and bandwidth allocation are obtained by iteratively compressing the model and solving these two subproblems. Simulation results show that the proposed FL algorithm can improve the accuracy of object recognition by up to 16.7% and improve the number of selected users by up to 68.7%, compared to a conventional FL algorithm using only RF.

Model-Based Reinforcement Learning for Quantized Federated Learning Performance Optimization

Deep Reinforcement Learning-based Quantization for Federated Learning

Quantization Bits Allocation for Wireless Federated Learning

FedAQ: Communication-Efficient Federated Edge Learning via Joint Uplink and Downlink Adaptive Quantization

Quantization Robust Federated Learning for Efficient Inference on Heterogeneous Devices

Training Time Minimization for Federated Edge Learning with Optimized Gradient Quantization and Bandwidth Allocation

FedFQ: Federated Learning with Fine-Grained Quantization

Communication-Efficient Design for Quantized Decentralized Federated Learning

Distributed Deep Reinforcement Learning Based Gradient Quantization for Federated Learning Enabled Vehicle Edge Computing

Wireless Network Optimization for Federated Learning with Model Compression in Hybrid VLC/RF Systems

Green, Quantized Federated Learning over Wireless Networks: An Energy-Efficient Design

Fed-QSSL: A Framework for Personalized Federated Learning under Bitwidth and Data Heterogeneity

Mixed-Precision Quantization for Federated Learning on Resource-Constrained Heterogeneous Devices

Wireless Federated Learning with Asynchronous and Quantized Updates

Joint Accuracy and Latency Optimization for Quantized Federated Learning in Vehicular Networks

Energy Efficient Federated Learning over Heterogeneous Mobile Devices via Joint Design of Weight Quantization and Wireless Transmission

On the Tradeoff between Energy, Precision, and Accuracy in Federated Quantized Neural Networks

Delay Minimization for Federated Learning Over Wireless Communication Networks

Ensemble Distillation based Adaptive Quantization for Supporting Federated Learning in Wireless Networks

A Federated Reinforcement Learning Method with Quantization for Cooperative Edge Caching in Fog Radio Access Networks