Abstract:The high-speed mobile networks offer great potentials to many future intelligent applications, such as autonomous vehicles in smart transportation systems. Such networks provide the possibility to interconnect mobile devices to achieve fast knowledge sharing for efficient collaborative learning and operations, especially with the help of distributed machine learning, e.g., Federated Learning (FL), and modern digital technologies, e.g., Digital Twin (DT) systems. Typically, FL requires a fixed group of participants that have Independent and Identically Distributed (IID) data for accurate and stable model training, which is highly unlikely in real-world mobile network scenarios. In this paper, in order to facilitate the lightweight model training and real-time processing in high-speed mobile networks, we design and introduce an end-edge-cloud structured three-layer Federated Reinforcement Learning (FRL) framework, incorporated with an edge-cloud structured DT system. A dual-Reinforcement Learning (dual-RL) scheme is devised to support optimizations of client node selection and global aggregation frequency during FL via a cooperative decision-making strategy, which is assisted by a two-layer DT system deployed in the edge-cloud for real-time monitoring of mobile devices and environment changes. A model pruning and federated bidirectional distillation (Bi-distillation) mechanism is then developed locally for the lightweight model training, while a model splitting scheme with a lightweight data augmentation mechanism is developed globally to separately optimize the aggregation weights based on a splitted neural network structure (i.e., the encoder and classifier) in a more targeted manner, which can work together to effectively reduce the overall communication cost and improve the non-IID problem. Experiment and evaluation results compared with three baseline methods using two different real-world datasets demonstrate the usefulness and outstanding performance of our proposed FRL model in communication-efficient model training and non-IID issue alleviation for high-speed mobile network scenarios.

Digital Twin-Assisted Federated Learning Service Provisioning over Mobile Edge Networks

Computation Offloading and Resource Allocation Based on DT-MEC-Assisted Federated Learning Framework

Digital Twin Enhanced Federated Reinforcement Learning with Lightweight Knowledge Distillation in Mobile Networks

Federated Learning with Dynamic Epoch Adjustment and Collaborative Training in Mobile Edge Computing

D2D-Assisted Federated Learning in Mobile Edge Computing Networks

Multicore Federated Learning for Mobile-Edge Computing Platforms

Digital Twin-driven Federated Learning for Converged Computing and Networking at the Edge

Energy-Efficient Dynamic Asynchronous Federated Learning in Mobile Edge Computing Networks.

Hierarchical Federated Learning with Adaptive Clustering on Non-IID Data

Resource Efficient Asynchronous Federated Learning for Digital Twin Empowered IoT Network

Traffic Prediction-Assisted Federated Deep Reinforcement Learning for Service Migration in Digital Twins-Enabled MEC Networks

Digital Twins-Enabled Federated Learning in Mobile Networks: From the Perspective of Communication-Assisted Sensing

Multi-Edge Server-Assisted Dynamic Federated Learning With an Optimized Floating Aggregation Point

To Talk or to Work: Dynamic Batch Sizes Assisted Time Efficient Federated Learning Over Future Mobile Edge Devices

Cloud-Edge-Client Collaborative Learning in Digital Twin Empowered Mobile Networks

Resources-efficient Adaptive Federated Learning for Digital Twin-Enabled IIoT

Federated Deep Reinforcement Learning for Task Offloading in Digital Twin Edge Networks

Accelerating Federated Learning Over Reliability-Agnostic Clients in Mobile Edge Computing Systems

When Deep Reinforcement Learning Meets Federated Learning: Intelligent Multitimescale Resource Management for Multiaccess Edge Computing in 5G Ultradense Network

Worker-Centric Model Allocation for Federated Learning in Mobile Edge Computing

Digital Twin-Assisted, SFC-Enabled Service Provisioning in Mobile Edge Computing