Abstract:Edge Intelligence (EI) allows Artificial Intelligence (AI) applications to run at the edge, where data analysis and decision-making can be performed in real-time and close to data sources. To protect data privacy and unify data silos distributed among end devices in EI, Federated Learning (FL) is proposed for collaborative training of shared AI models across multiple devices without compromising data privacy. However, the prevailing FL approaches cannot guarantee model generalization and adaptation on heterogeneous clients. Recently, Personalized Federated Learning (PFL) has drawn growing awareness in EI, as it enables a productive balance between local-specific training requirements inherent in devices and global-generalized optimization objectives for satisfactory performance. However, most existing PFL methods are based on the Parameters Interaction-based Architecture (PIA) represented by FedAvg, which suffers from unaffordable communication burdens due to large-scale parameters transmission between devices and the edge server. In contrast, Logits Interaction-based Architecture (LIA) allows to update model parameters with logits transfer and gains the advantages of communication lightweight and heterogeneous on-device model allowance compared to PIA. Nevertheless, previous LIA methods attempt to achieve satisfactory performance either relying on unrealistic public datasets or increasing communication overhead for additional information transmission other than logits. To tackle this dilemma, we propose a knowledge cache-driven PFL architecture, named FedCache, which reserves a knowledge cache on the server for fetching personalized knowledge from the samples with similar hashes to each given on-device sample. During the training phase, ensemble distillation is applied to on-device models for constructive optimization with personalized knowledge transferred from the server-side knowledge cache. Empirical experiments on four datasets demonstrate that FedCache achieves comparable performance with state-of-art PFL approaches, with more than two orders of magnitude improvements in communication efficiency. Our code and DEMO are available at https://github.com/wuzhiyuan2000/FedCache.

Personalized Collaborative Edge Caching with Federated Transfer Deep Reinforcement Learning

Deep Reinforcement Learning for Cooperative Coded Caching Strategy in Fog Radio Access Network

Cooperative Edge Caching Based on Elastic Federated and Multi-Agent Deep Reinforcement Learning in Next-Generation Network

Cooperative Edge Caching Based on Elastic Federated and Multi-Agent Deep Reinforcement Learning in Next-Generation Networks

Deep Learning Based Coded Over-the-Air Computation for Personalized Federated Learning

A Federated Reinforcement Learning Method with Quantization for Cooperative Edge Caching in Fog Radio Access Networks

Edge-cloud Collaborative Learning with Federated and Centralized Features

A Federated Deep Reinforcement Learning-based Low-power Caching Strategy for Cloud-edge Collaboration

Efficient Federated DRL-Based Cooperative Caching for Mobile Edge Networks

Asynchronous Federated Learning for Vehicular Edge Caching of Consumer Content

User Preference Learning Based Edge Caching for Fog Radio Access Network

Computation Offloading and Resource Allocation in F-RANs: A Federated Deep Reinforcement Learning Approach

A Joint Reinforcement-Learning Enabled Caching and Cross-Layer Network Code in F-RAN with D2D Communications

Federated Distributed Deep Reinforcement Learning for Recommendation-enabled Edge Caching

MECC: A Mobile Edge Collaborative Caching Framework Empowered by Deep Reinforcement Learning

Cooperative caching algorithm for mobile edge networks based on multi-agent meta reinforcement learning

Enhanced Hybrid Hierarchical Federated Edge Learning Over Heterogeneous Networks

Cooperative Cache in Cognitive Radio Networks: A Heterogeneous Multi-Agent Learning Approach

A Joint Reinforcement-Learning Enabled Caching and Cross-Layer Network Code for Sum-Rate Maximization in F-RAN with D2D Communications

Leveraging Federated Learning and Edge Computing for Recommendation Systems within Cloud Computing Networks

FedCache: A Knowledge Cache-Driven Federated Learning Architecture for Personalized Edge Intelligence