Abstract:Knowledge graph reasoning (KGR) aims to infer new knowledge or detect noises, which is essential for improving the quality of knowledge graphs. Recently, various KGR techniques, such as symbolic- and embedding-based methods, have been proposed and shown strong reasoning ability. Symbolic-based reasoning methods infer missing triples according to predefined rules or ontologies. Although rules and axioms have proven effective, it is difficult to obtain them. Embedding-based reasoning methods represent entities and relations as vectors, and complete KGs via vector computation. However, they mainly rely on structural information and ignore implicit axiom information not predefined in KGs but can be reflected in data. That is, each correct triple is also a logically consistent triple and satisfies all axioms. In this paper, we propose a novel NeuRal Axiom Network (NeuRAN) framework that combines explicit structural and implicit axiom information without introducing additional ontologies. Specifically, the framework consists of a KG embedding module that preserves the semantics of triples and five axiom modules that encode five kinds of implicit axioms. These axioms correspond to five typical object property expression axioms defined in OWL2, including ObjectPropertyDomain, ObjectPropertyRange, DisjointObjectProperties, IrreflexiveObjectProperty and AsymmetricObjectProperty. The KG embedding module and axiom modules compute the scores that the triple conforms to the semantics and the corresponding axioms, respectively. Compared with KG embedding models and CKRL, our method achieves comparable performance on noise detection and triple classification and achieves significant performance on link prediction. Compared with TransE and TransH, our method improves the link prediction performance on the Hits@1 metric by 22.0% and 20.8% on WN18RR-10% dataset, respectively.

A Hybrid Neural Network Model for Commonsense Reasoning

Hybrid Reasoning Network for Video-based Commonsense Captioning

Unsupervised Deep Structured Semantic Models for Commonsense Reasoning.

Towards Human-like Perception: Learning Structural Causal Model in Heterogeneous Graph

Neural-Symbolic Commonsense Reasoner with Relation Predictors

Towards Neural Network-based Reasoning

UNcommonsense Reasoning: Abductive Reasoning about Uncommon Situations

Align, Mask and Select: A Simple Method for Incorporating Commonsense Knowledge into Language Representation Models

Commonsense Knowledge Transfer for Pre-trained Language Models

Teaching Pretrained Models with Commonsense Reasoning: A Preliminary KB-Based Approach

LINKED: Eliciting, Filtering and Integrating Knowledge in Large Language Model for Commonsense Reasoning

Neural Axiom Network for Knowledge Graph Reasoning

Evaluating Commonsense in Pre-trained Language Models

A Generative-Symbolic Model for Logical Reasoning in NLU

CommonsenseVIS: Visualizing and Understanding Commonsense Reasoning Capabilities of Natural Language Models

Probabilistic Reasoning Via Deep Learning: Neural Association Models

AHNN: an Attention-Based Hybrid Neural Network for Sentence Modeling

A Neural-Symbolic Approach to Natural Language Understanding

Improving Question Answering by Commonsense-Based Pre-training

Exploring Multi-hop Reasoning Process in NLU from the View of Bayesian Probability

A Framework for the General Design and Computation of Hybrid Neural Networks