Abstract:Federated Knowledge Graph Embedding (FKGE) has recently garnered considerable interest due to its capacity to extract expressive representations from distributed knowledge graphs, while concurrently safeguarding the privacy of individual clients. Existing FKGE methods typically harness the arithmetic mean of entity embeddings from all clients as the global supplementary knowledge, and learn a replica of global consensus entities embeddings for each client. However, these methods usually neglect the inherent semantic disparities among distinct clients. This oversight not only results in the globally shared complementary knowledge being inundated with too much noise when tailored to a specific client, but also instigates a discrepancy between local and global optimization objectives. Consequently, the quality of the learned embeddings is compromised. To address this, we propose Personalized Federated knowledge graph Embedding with client-wise relation Graph (PFedEG), a novel approach that employs a client-wise relation graph to learn personalized embeddings by discerning the semantic relevance of embeddings from other clients. Specifically, PFedEG learns personalized supplementary knowledge for each client by amalgamating entity embedding from its neighboring clients based on their "affinity" on the client-wise relation graph. Each client then conducts personalized embedding learning based on its local triples and personalized supplementary knowledge. We conduct extensive experiments on four benchmark datasets to evaluate our method against state-of-the-art models and results demonstrate the superiority of our method.

Low-Dimensional Federated Knowledge Graph Embedding via Knowledge Distillation

DistilE: Distiling Knowledge Graph Embeddings for Faster and Cheaper Reasoning

Federated Knowledge Graph Completion Via Embedding-Contrastive Learning

Personalized Federated Knowledge Graph Embedding with Client-Wise Relation Graph

Heterogeneous Federated Knowledge Graph Embedding Learning and Unlearning

FedE: Embedding Knowledge Graphs in Federated Setting

Differentially Private Federated Knowledge Graphs Embedding

Communication-Efficient Federated Knowledge Graph Embedding with Entity-Wise Top-K Sparsification

Towards Data-Independent Knowledge Transfer in Model-Heterogeneous Federated Learning

FedCKE: Cross-Domain Knowledge Graph Embedding in Federated Learning

A Prototype-Based Knowledge Distillation Framework for Heterogeneous Federated Learning

MulDE: Multi-teacher Knowledge Distillation for Low-dimensional Knowledge Graph Embeddings

A Federated Graph to Embedding Approach for Knowledge Graph Completion

FEDGKD: Toward Heterogeneous Federated Learning Via Global Knowledge Distillation

FedKD: Communication Efficient Federated Learning Via Knowledge Distillation

DualDE: Dually Distilling Knowledge Graph Embedding for Faster and Cheaper Reasoning

FedGKD: Towards Heterogeneous Federated Learning via Global Knowledge Distillation

Multi-teacher Knowledge Distillation for Knowledge Graph Completion.

STDE: A Single-Senior-Teacher Knowledge Distillation Model for High-Dimensional Knowledge Graph Embeddings

Local-Global Knowledge Distillation in Heterogeneous Federated Learning with Non-IID Data

Handling Data Heterogeneity in Federated Learning via Knowledge Distillation and Fusion