Leveraging Federated Learning and Edge Computing for Recommendation Systems within Cloud Computing Networks

Yaqian Qi,Yuan Feng,Xiangxiang Wang,Hanzhe Li,Jingxiao Tian

2024-03-13

Abstract:To enable large-scale and efficient deployment of artificial intelligence (AI), the combination of AI and edge computing has spawned Edge Intelligence, which leverages the computing and communication capabilities of end devices and edge servers to process data closer to where it is generated. A key technology for edge intelligence is the privacy-protecting machine learning paradigm known as Federated Learning (FL), which enables data owners to train models without having to transfer raw data to third-party servers. However, FL networks are expected to involve thousands of heterogeneous distributed devices. As a result, communication efficiency remains a key bottleneck. To reduce node failures and device exits, a Hierarchical Federated Learning (HFL) framework is proposed, where a designated cluster leader supports the data owner through intermediate model aggregation. Therefore, based on the improvement of edge server resource utilization, this paper can effectively make up for the limitation of cache capacity. In order to mitigate the impact of soft clicks on the quality of user experience (QoE), the authors model the user QoE as a comprehensive system cost. To solve the formulaic problem, the authors propose a decentralized caching algorithm with federated deep reinforcement learning (DRL) and federated learning (FL), where multiple agents learn and make decisions independently

Artificial Intelligence

What problem does this paper attempt to address?

The paper attempts to address the issue of how to utilize Federated Learning (FL) and Edge Computing to improve the performance and efficiency of recommendation systems in cloud computing networks while protecting user data privacy. Specifically, the paper focuses on the following aspects: 1. **Communication Efficiency**: In federated learning networks, communication efficiency becomes a critical bottleneck due to the involvement of thousands of heterogeneous distributed devices. The paper proposes a Hierarchical Federated Learning (HFL) framework that aggregates model parameters through intermediate nodes, reducing the impact of node failures and device dropouts, thereby improving communication efficiency. 2. **Cache Optimization**: To mitigate the impact of soft clicks on the Quality of Experience (QoE) for users, the authors model the user's QoE as a comprehensive system cost and propose a decentralized caching algorithm based on Federated Deep Reinforcement Learning (DRL) and federated learning. Multiple agents independently learn and make decisions to minimize long-term system costs. 3. **Personalized Recommendation**: The paper proposes a Decentralized Personalized Model with Neighbor selection (DPMN) algorithm that combines model pruning and neighbor selection to balance model quality and communication efficiency. Experimental results show that the DPMN algorithm outperforms other decentralized training methods on multiple datasets, significantly reducing bandwidth resource consumption and improving model accuracy. 4. **Privacy Protection**: By performing model training directly on edge devices without transmitting raw data to a centralized server, the combination of federated learning and edge computing significantly reduces privacy risks and concerns about data leakage. In summary, through technological innovation and algorithm optimization, this paper aims to enhance the performance of recommendation systems in cloud computing networks while ensuring the security and privacy of user data.

Leveraging Federated Learning and Edge Computing for Recommendation Systems within Cloud Computing Networks

Edge-cloud Collaborative Learning with Federated and Centralized Features

Enhanced Hybrid Hierarchical Federated Edge Learning Over Heterogeneous Networks

Importance-aware Data Selection and Resource Allocation for Hierarchical Federated Edge Learning

FEL: High Capacity Learning for Recommendation and Ranking via Federated Ensemble Learning

Importance-Aware Data Selection and Resource Allocation in Federated Edge Learning System.

Federated Distributed Deep Reinforcement Learning for Recommendation-enabled Edge Caching

In-Edge AI: Intelligentizing Mobile Edge Computing, Caching and Communication by Federated Learning

A split-federated learning and edge-cloud based efficient and privacy-preserving large-scale item recommendation model

Reputation-Driven Asynchronous Federated Learning for Optimizing Communication Efficiency in Big Data Labeling Systems

Federated Learning as a Service for Hierarchical Edge Networks with Heterogeneous Models

Energy-Aware Edge Association for Cluster-based Personalized Federated Learning

FedRL: A Reinforcement Learning Federated Recommender System for Efficient Communication Using Reinforcement Selector and Hypernet Generator

An Efficient Asynchronous Federated Learning Protocol for Edge Devices

Optimizing Training Efficiency and Cost of Hierarchical Federated Learning in Heterogeneous Mobile-Edge Cloud Computing

User-Distribution-Aware Federated Learning for Efficient Communication and Fast Inference

Cost-Efficient Federated Learning for Edge Intelligence in Multi-Cell Networks

Resource-Efficient Federated Learning with Hierarchical Aggregation in Edge Computing.

Experimental Evaluation and Analysis of Federated Learning in Edge Computing Environments

High-Precision Cluster Federated Learning for Smart Home: An Edge-Cloud Collaboration Approach