Abstract:In the traditional vehicular network, computing tasks generated by the vehicles are usually uploaded to the cloud for processing. However, since task offloading toward the cloud will cause a large delay, vehicular edge computing (VEC) is introduced to avoid such a problem and improve the whole system performance, where a roadside unit (RSU) with certain computing capability is used to process the data of vehicles as an edge entity. Owing to the privacy and security issues, vehicles are reluctant to upload local data directly to the RSU, and thus federated learning (FL) becomes a promising technology for some machine learning tasks in VEC, where vehicles only need to upload the local model hyperparameters instead of transferring their local data to the nearby RSU. Furthermore, as vehicles have different local training time due to various sizes of local data and their different computing capabilities, asynchronous federated learning (AFL) is employed to facilitate the RSU to update the global model immediately after receiving a local model to reduce the aggregation delay. However, in AFL of VEC, different vehicles may have different impact on the global model updating because of their various local training delay, transmission delay and local data sizes. Also, if there are bad nodes among the vehicles, it will affect the global aggregation quality at the RSU. To solve the above problem, we shall propose a deep reinforcement learning (DRL) based vehicle selection scheme to improve the accuracy of the global model in AFL of vehicular network. In the scheme, we present the model including the state, action and reward in the DRL based to the specific problem. Simulation results demonstrate our scheme can effectively remove the bad nodes and improve the aggregation accuracy of the global model.

Asynchronous Federated Learning-Based Resource Management in URLLC-IoV Networks

Two-Timescale Resource Management for Ultrareliable and Low-Latency Vehicular Communications

Asynchronous Federated Learning for Resource Allocation in Software Defined Internet of UAVs

Resource Management and Optimization in Internet of Vehicles for Hierarchical Federated Learning

Joint Resource Management for Mobility Supported Federated Learning in Internet of Vehicles

Resource Allocation in Vehicular Networks Based on Federated Multi-Agent Reinforcement Learning

URLLC-Awared Resource Allocation for Heterogeneous Vehicular Edge Computing

Joint URLLC Traffic Scheduling and Resource Allocation for Semantic Communication Systems

Federated-Reinforcement-Learning-Enabled Joint Communication, Sensing, and Computing Resources Allocation in Connected Automated Vehicles Networks

Deep Reinforcement Learning Based Vehicle Selection for Asynchronous Federated Learning Enabled Vehicular Edge Computing

Federated Learning Assisted Intelligent IoV Mobile Edge Computing

Federated Multi-Agent Deep Reinforcement Learning for Resource Allocation of Vehicle-to-Vehicle Communications

Vehicle Selection and Resource Allocation for Federated Learning-Assisted Vehicular Network

Cross-domain Resources Optimization for Hybrid Edge Computing Networks: Federated DRL Approach

Deep Reinforcement Learning-based Computing Offloading and Resource Allocation Algorithm in Internet of Vehicles

Resource Allocation for Delay-Sensitive Vehicle-to-Multi-Edges (v2es) Communications in Vehicular Networks: A Multi-Agent Deep Reinforcement Learning Approach.

Deep Reinforcement Learning Empowered Resource Allocation in Vehicular Fog Computing

Intelligent Resource Allocation Management for Vehicles Network: an A3C Learning Approach.

Mobility-Aware Asynchronous Federated Learning for Edge-Assisted Vehicular Networks.

Federated Learning for Ultra-Reliable Low-Latency V2V Communications

Resource Allocation in Software-defined and Information-Centric Vehicular Networks with Mobile Edge Computing