Vertical Federated Graph Neural Network for Recommender System

Peihua Mai,Yan Pang
2024-08-27
Abstract:Conventional recommender systems are required to train the recommendation model using a centralized database. However, due to data privacy concerns, this is often impractical when multi-parties are involved in recommender system training. Federated learning appears as an excellent solution to the data isolation and privacy problem. Recently, Graph neural network (GNN) is becoming a promising approach for federated recommender systems. However, a key challenge is to conduct embedding propagation while preserving the privacy of the graph structure. Few studies have been conducted on the federated GNN-based recommender system. Our study proposes the first vertical federated GNN-based recommender system, called VerFedGNN. We design a framework to transmit: (i) the summation of neighbor embeddings using random projection, and (ii) gradients of public parameter perturbed by ternary quantization mechanism. Empirical studies show that VerFedGNN has competitive prediction accuracy with existing privacy preserving GNN frameworks while enhanced privacy protection for users' interaction information.
Cryptography and Security
What problem does this paper attempt to address?
The paper aims to address the issues of data isolation and privacy protection in recommendation systems. Specifically, traditional recommendation systems require training models in a centralized database, but this approach is often impractical in multi-party scenarios due to data privacy concerns. Federated learning, as a solution, can address data isolation and privacy issues. However, existing Graph Neural Networks (GNNs) may leak graph structure information when propagating neighbor embeddings in a federated learning environment. Therefore, this paper proposes a vertical federated graph neural network framework (VerFedGNN) for recommendation systems, which enables cross-organization data collaboration while protecting the privacy of user interaction information. This method transmits neighbor embedding aggregation results through random projection and perturbs public parameter gradients using a ternary quantization mechanism, thereby enhancing user privacy protection while ensuring prediction accuracy. Additionally, the paper proposes a de-anonymization attack against existing federated GNN frameworks and demonstrates the effectiveness of the proposed method through experiments.