Abstract:Commonsense knowledge graph completion is a new challenge for commonsense knowledge graph construction and application. In contrast to factual knowledge graphs such as Freebase and YAGO, commonsense knowledge graphs (CSKGs; e.g., ConceptNet) utilize free-form text to represent named entities, short phrases, and events as their nodes. Such a loose structure results in large and sparse CSKGs, which makes the semantic understanding of these nodes more critical for learning rich commonsense knowledge graph embedding. While current methods leverage semantic similarities to increase the graph density, the semantic plausibility of the nodes and their relations are under-explored. Previous works adopt conceptual abstraction to improve the consistency of modeling (event) plausibility, but they are not scalable enough and still suffer from data sparsity. In this paper, we propose to adopt textual entailment to find implicit entailment relations between CSKG nodes, to effectively densify the subgraph connecting nodes within the same conceptual class, which indicates a similar level of plausibility. Each node in CSKG finds its top entailed nodes using a finetuned transformer over natural language inference (NLI) tasks, which sufficiently capture textual entailment signals. The entailment relation between these nodes are further utilized to: 1) build new connections between source triplets and entailed nodes to densify the sparse CSKGs; 2) enrich the generalization ability of node representations by comparing the node embeddings with a contrastive loss. Experiments on two standard CSKGs demonstrate that our proposed framework EntailE can improve the performance of CSKG completion tasks under both transductive and inductive settings.

Knowledge-aware Textual Entailment with Graph Attention Network

Knowledge-aware textual entailment with graph attention network

Mixed Geometry Message and Trainable Convolutional Attention Network for Knowledge Graph Completion

EntailE: Introducing Textual Entailment in Commonsense Knowledge Graph Completion

Contextualized Knowledge-aware Attentive Neural Network: Enhancing Answer Selection with Knowledge

KGAnet: a Knowledge Graph Attention Network for Enhancing Natural Language Inference

Attention-Based Relational Graph Convolutional Network for Knowledge Graph Reasoning

Neural Knowledge Acquisition via Mutual Attention Between Knowledge Graph and Text.

A Model of Text-Enhanced Knowledge Graph Representation Learning with Mutual Attention.

TeKo: Text-Rich Graph Neural Networks with External Knowledge

Knowledge-aware adaptive graph network for commonsense question answering

Knowledge Graph Embedding Via Graph Attenuated Attention Networks

Text-Enhanced Knowledge Representation Learning Based on Gated Convolutional Networks

A knowledge-enhanced interactive graph convolutional network for aspect-based sentiment analysis

TKGAT: Temporal Knowledge Graph Representation Learning Using Attention Network.

Knowledge-Enhanced Graph Attention Network for Fact Verification

Recognizing Textual Entailment via Multi-task Knowledge Assisted LSTM.

Learning graph attention-aware knowledge graph embedding

Entailment Graph Learning with Textual Entailment and Soft Transitivity

Towards Knowledge Enhanced Language Model for Machine Reading Comprehension

Text-Enhanced Representation Learning for Knowledge Graph.