Heterogeneous Hypergraph Embedding for Recommendation Systems

Darnbi Sakong,Viet Hung Vu,Thanh Trung Huynh,Phi Le Nguyen,Hongzhi Yin,Quoc Viet Hung Nguyen,Thanh Tam Nguyen
2024-07-04
Abstract:Recent advancements in recommender systems have focused on integrating knowledge graphs (KGs) to leverage their auxiliary information. The core idea of KG-enhanced recommenders is to incorporate rich semantic information for more accurate recommendations. However, two main challenges persist: i) Neglecting complex higher-order interactions in the KG-based user-item network, potentially leading to sub-optimal recommendations, and ii) Dealing with the heterogeneous modalities of input sources, such as user-item bipartite graphs and KGs, which may introduce noise and inaccuracies. To address these issues, we present a novel Knowledge-enhanced Heterogeneous Hypergraph Recommender System (KHGRec). KHGRec captures group-wise characteristics of both the interaction network and the KG, modeling complex connections in the KG. Using a collaborative knowledge heterogeneous hypergraph (CKHG), it employs two hypergraph encoders to model group-wise interdependencies and ensure explainability. Additionally, it fuses signals from the input graphs with cross-view self-supervised learning and attention mechanisms. Extensive experiments on four real-world datasets show our model's superiority over various state-of-the-art baselines, with an average 5.18\% relative improvement. Additional tests on noise resilience, missing data, and cold-start problems demonstrate the robustness of our KHGRec framework. Our model and evaluation datasets are publicly available at \url{<a class="link-external link-https" href="https://github.com/viethungvu1998/KHGRec" rel="external noopener nofollow">this https URL</a>}.
Information Retrieval,Artificial Intelligence,Machine Learning,Social and Information Networks
What problem does this paper attempt to address?
The paper attempts to address two main challenges in recommendation systems: 1. **Ignoring complex high-order interactions**: Existing knowledge graph (KG)-based user-item network recommendation systems often overlook complex high-order interactions, which may lead to suboptimal recommendations. 2. **Handling heterogeneous modal input sources**: Recommendation systems need to handle different types of input sources, such as user-item bipartite graphs and knowledge graphs. These different data sources may introduce noise and inaccuracies. To tackle these challenges, the paper proposes a new model called Knowledge-enhanced Heterogeneous Hypergraph Recommendation System (KHGRec). KHGRec addresses the issues in the following ways: - **Capturing group characteristics**: KHGRec uses a Collaborative Knowledge Heterogeneous Hypergraph (CKHG) to model group characteristics in the user-item interaction network and the knowledge graph, thereby capturing complex connections. - **Relation-aware hypergraph encoder**: KHGRec employs two hypergraph encoders to model dependencies among groups and ensure the interpretability of recommendations. - **Cross-view self-supervised learning and attention mechanism**: KHGRec integrates signals from the input graphs by aligning similar entities in different latent spaces through cross-view self-supervised learning and attention mechanisms. Specifically, the main contributions of KHGRec include: - Proposing KHGRec, the first method to combine the group characteristics of hypergraphs with the interpretability of knowledge-enhanced recommendation systems to improve recommendation quality. - Introducing a method to construct a Collaborative Knowledge Heterogeneous Hypergraph, which unifies input graphs without introducing noise and facilitates subsequent representation learning. - Designing a novel relation-aware hypergraph neural network to mine high-order interactions of nodes and using attention mechanisms to highlight the importance of nodes in hyperedges. - Seamlessly integrating signals extracted from the two input graphs using attention mechanisms and cross-view self-supervised learning mechanisms. Through these innovations, experimental results on multiple real-world datasets show that KHGRec outperforms various state-of-the-art baseline models with an average relative improvement rate of 5.18%. Additionally, KHGRec demonstrates excellent performance in noise robustness, missing data, and cold start problems.