Abstract:<p>Knowledge graphs (KGs) can provide rich, structured information for recommendation systems as well as increase accuracy and perform explicit reasoning. Deep reinforcement learning (RL) has also sparked great interest in personalized recommendations. The combination of the two holds promise in carrying out interpretable causal inference procedures and improving the performance of graph-structured recommendation. However, most KG -based recommendation focus on rich semantic relationships between entities in a heterogeneous knowledge graph, and thus fail to fully make use of the image information corresponding to an entity. In order to address these issues, we proposed a novel Multi-modal Knowledge-aware Reinforcement Learning Network (MKRLN), which couples recommendation and interpretability by providing actual paths in multi-modal KG (MKG). The MKRLN can generate path representation by composing the structural and visual information of entities, and infers the underlying rational of agent-MKG interactions by leveraging the sequential dependencies within a path from the MKG. In addition, as KGs have too many attributes and entities, their combination with RL leads to too many action spaces and states in the reinforcement learning space, which complicates the search of action spaces. Furthermore, in order to solve this problem, we proposed a new hierarchical attention-path, which makes users focus their attention on the items they are interested in. This reduces the relations and entities in the KGs, which in turn reduces the action space and state in RL, shortens the path to the target entity, and improves the accuracy of recommendation. Our model has explicit explanation ability in knowledge and images. Finally, we extensively evaluated our model on several large-scale real-world benchmark datasets, and it yielded favorable results compared with state-of-the-art methods.</p>

RLPath: a knowledge graph link prediction method using reinforcement learning based attentive relation path searching and representation learning

Generalized Relation Learning with Semantic Correlation Awareness for Link Prediction

Path Ranking Model for Entity Prediction.

Representation Learning with Ordered Relation Paths for Knowledge Graph Completion.

Heterogeneous Relational Reasoning in Knowledge Graphs with Reinforcement Learning

Temporal link prediction via reinforcement learning

KPRLN: deep knowledge preference-aware reinforcement learning network for recommendation

HackRL: Reinforcement learning with hierarchical attention for cross-graph knowledge fusion and collaborative reasoning

Multi-modal Knowledge-aware Reinforcement Learning Network for Explainable Recommendation

Modeling Path Information for Knowledge Graph Completion

Dynamic relation learning for link prediction in knowledge hypergraphs

Meta Relational Learning for Few-Shot Link Prediction in Knowledge Graphs

A Representation Learning Method of Knowledge Graph Integrating Ordered Relation Path and Entity Description Information

ReInform: Selecting paths with reinforcement learning for contextualized link prediction

Multi-level Recommendation Reasoning over Knowledge Graphs with Reinforcement Learning

Modeling Relation Paths for Representation Learning of Knowledge Bases

Path-based reasoning with K-nearest neighbor and position embedding for knowledge graph completion

Multi-hop reasoning over paths in temporal knowledge graphs using reinforcement learning

RLAT: Multi-hop temporal knowledge graph reasoning based on reinforcement learning and attention mechanism

ARL: analogical reinforcement learning for knowledge graph reasoning

Generative Graph Neural Networks for Link Prediction