Abstract:Federated recommendation aims to collect global knowledge by aggregating local models from massive devices, to provide recommendations while ensuring privacy. Current methods mainly leverage aggregation functions invented by federated vision community to aggregate parameters from similar clients, e.g., clustering aggregation. Despite considerable performance, we argue that it is suboptimal to apply them to federated recommendation directly. This is mainly reflected in the disparate model architectures. Different from structured parameters like convolutional neural networks in federated vision, federated recommender models usually distinguish itself by employing one-to-one item embedding table. Such a discrepancy induces the challenging embedding skew issue, which continually updates the trained embeddings but ignores the non-trained ones during aggregation, thus failing to predict future items accurately. To this end, we propose a personalized Federated recommendation model with Composite Aggregation (FedCA), which not only aggregates similar clients to enhance trained embeddings, but also aggregates complementary clients to update non-trained embeddings. Besides, we formulate the overall learning process into a unified optimization algorithm to jointly learn the similarity and complementarity. Extensive experiments on several real-world datasets substantiate the effectiveness of our proposed model. The source codes are available at <a class="link-external link-https" href="https://github.com/hongleizhang/FedCA" rel="external noopener nofollow">this https URL</a>.

What problem does this paper attempt to address?

### Problems the paper attempts to solve This paper aims to solve the **embedding skew problem** in Federated Recommendation (FR) caused by differences in model architectures. Specifically, existing federated recommendation methods mainly draw on aggregation functions in the federated vision field (such as weighted aggregation, clustering aggregation, and attention aggregation), and these methods aggregate parameters through similarity assumptions. However, federated recommendation models usually use one - to - one item embedding tables, which are different from structured parameters such as convolutional neural networks. Therefore, during the aggregation process, trained embedding items are continuously updated, while non - trained embedding items are ignored, resulting in the inability to accurately predict future items. To solve this problem, the author proposes a personalized federated recommendation model (FedCA) based on a composite aggregation mechanism. This model not only aggregates similar clients to enhance trained embedding items but also aggregates complementary clients to update non - trained embedding items. By jointly learning similarity and complementarity, FedCA can more effectively meet the heterogeneity and personalization requirements in federated recommendation tasks. ### Key point summary 1. **Limitations of existing methods**: - Existing federated recommendation methods mainly rely on aggregation functions based on similarity assumptions. These functions perform well in the federated vision field but have an embedding skew problem in federated recommendation. - Different clients may involve different subsets of interaction items, resulting in different trained rows in each client's embedding table, thus causing embedding skew. 2. **Proposed solutions**: - A personalized federated recommendation model (FedCA) based on a composite aggregation mechanism is proposed. - This model enhances trained embedding items and updates non - trained embedding items simultaneously by aggregating similar clients and complementary clients. - The entire learning process is formulated as a unified optimization algorithm to jointly learn similarity and complementarity. 3. **Experimental verification**: - Extensive experiments were carried out on multiple real - world datasets, and the results show that the FedCA model is significantly superior to existing methods in predicting future items. In this way, FedCA effectively alleviates the embedding skew problem in federated recommendation tasks and improves the performance and accuracy of the recommendation system.

Beyond Similarity: Personalized Federated Recommendation with Composite Aggregation

FedPSE: Personalized Sparsification with Element-wise Aggregation for Federated Learning

Towards Communication Efficient and Fair Federated Personalized Sequential Recommendation

Dual Personalization on Federated Recommendation

HeteFedRec: Federated Recommender Systems with Model Heterogeneity

Personalized Federated Recommendation via Joint Representation Learning, User Clustering, and Model Adaptation

Federated Recommendation with Additive Personalization

Personalized Item Representations in Federated Multimodal Recommendation

FedRec: Federated Recommendation With Explicit Feedback

Heterogeneous federated collaborative filtering using FAIR: Federated Averaging in Random Subspaces

Efficient and Robust Regularized Federated Recommendation

Personalized Federated Collaborative Filtering: A Variational AutoEncoder Approach

Balancing Similarity and Complementarity for Federated Learning

Decentralized Personalized Online Federated Learning

Pfedsim: Similarity-Aware Model Aggregation Towards Personalized Federated Learning.

Cluster-driven Personalized Federated Recommendation with Interest-aware Graph Convolution Network for Multimedia

FedAA: A Reinforcement Learning Perspective on Adaptive Aggregation for Fair and Robust Federated Learning

PerFedRec++: Enhancing Personalized Federated Recommendation with Self-Supervised Pre-Training

Cali3F: Calibrated Fast Fair Federated Recommendation System

Semi-global sequential recommendation via EM-like federated training

DA-PFL: Dynamic Affinity Aggregation for Personalized Federated Learning