Abstract:Text matching is the task of matching two texts and determining the relationship between them, which has extensive applications in natural language processing tasks such as reading comprehension, and Question-Answering systems. The mainstream approach is to compute text representations or to interact with the text through attention mechanism, which is effective in text matching tasks. However, the performance of these models is insufficient for texts that require commonsense knowledge-based reasoning. To this end, in this paper, We introduce a new model for text matching called the Knowledge Enhanced Text Matching model (KETM), to enrich contextual representations with real-world common-sense knowledge from external knowledge sources to enhance our model understanding and reasoning. First, we use Wiktionary to retrieve the text word definitions as our external knowledge. Secondly, we feed text and knowledge to the text matching module to extract their feature vectors. The text matching module is used as an interaction module by integrating the encoder layer, the co-attention layer, and the aggregation layer. Specifically, the interaction process is iterated several times to obtain in-depth interaction information and extract the feature vectors of text and knowledge by multi-angle pooling. Then, we fuse text and knowledge using a gating mechanism to learn the ratio of text and knowledge fusion by a neural network that prevents noise generated by knowledge. After that, experimental validation on four datasets are carried out, and the experimental results show that our proposed model performs well on all four datasets, and the performance of our method is improved compared to the base model without adding external knowledge, which validates the effectiveness of our proposed method. The code is available at https://github.com/1094701018/KETM

A Corpus-based Evaluation of Lexical Components of a Domainspecific Text to Knowledge Mapping Prototype

A Corpus-based Evaluation of a Domain-specific Text to Knowledge Mapping Prototype

Development of a Conceptual Structure for a Domain-Specific Corpus

Knowledge-based Document Embedding for Cross-Domain Text Classification

Keyphrase Based Evaluation of Automatic Text Summarization

KETM:A Knowledge-Enhanced Text Matching method

Understood in Translation, Transformers for Domain Understanding

CorpusBrain: Pre-train a Generative Retrieval Model for Knowledge-Intensive Language Tasks

A Corpus and Evaluation Framework for Deeper Understanding of Commonsense Stories

Evaluating User Knowledge in Large Scale Online Knowledge Communities

KoRC: Knowledge oriented Reading Comprehension Benchmark for Deep Text Understanding

Improving Knowledge-Aware Dialogue Response Generation by Using Human-Written Prototype Dialogues.

Customized Information and Domain-centric Knowledge Graph Construction with Large Language Models

What’s in an Index: Extracting Domain-specific Knowledge Graphs from Textbooks

Improving Domain Adaptation through Extended-Text Reading Comprehension

The Comprehensive Language Knowledge Base and Its Prospect

Adapter-based Approaches to Knowledge-enhanced Language Models -- A Survey

Evaluating Language Models for Knowledge Base Completion

Un mod{è}le de base de connaissances terminologiques

Mapping the Knowledge Domain of Text Inferencing

CorpusLM: Towards a Unified Language Model on Corpus for Knowledge-Intensive Tasks