Abstract:Knowledge representation and reasoning (KRR) systems represent knowledge as collections of facts and rules. Like databases, KRR systems contain information about domains of human activities like industrial enterprises, science, and business. KRRs can represent complex concepts and relations, and they can query and manipulate information in sophisticated ways. Unfortunately, the KRR technology has been hindered by the fact that specifying the requisite knowledge requires skills that most domain experts do not have, and professional knowledge engineers are hard to find. One solution could be to extract knowledge from English text, and a number of works have attempted to do so (OpenSesame, Google's Sling, etc.). Unfortunately, at present, extraction of logical facts from unrestricted natural language is still too inaccurate to be used for reasoning, while restricting the grammar of the language (so-called controlled natural language, or CNL) is hard for the users to learn and use. Nevertheless, some recent CNL-based approaches, such as the Knowledge Authoring Logic Machine (KALM), have shown to have very high accuracy compared to others, and a natural question is to what extent the CNL restrictions can be lifted. In this paper, we address this issue by transplanting the KALM framework to a neural natural language parser, mStanza. Here we limit our attention to authoring facts and queries and therefore our focus is what we call factual English statements. Authoring other types of knowledge, such as rules, will be considered in our followup work. As it turns out, neural network based parsers have problems of their own and the mistakes they make range from part-of-speech tagging to lemmatization to dependency errors. We present a number of techniques for combating these problems and test the new system, KALMFL (i.e., KALM for factual language), on a number of benchmarks, which show KALMFL achieves correctness in excess of 95%.

Knowledge Acquisition for Content Selection

Acquiring Correct Knowledge for Natural Language Generation

Generative Knowledge Selection for Knowledge-Grounded Dialogues

A Systematic Investigation of Knowledge Retrieval and Selection for Retrieval Augmented Generation

Well Begun is Half Done: Generator-agnostic Knowledge Pre-Selection for Knowledge-Grounded Dialogue

Aggregated Knowledge Model: Enhancing Domain-Specific QA with Fine-Tuned and Retrieval-Augmented Generation Models

Knowledge Authoring with Factual English

Select, Extend, and Generate: Generative Knowledge Selection for Open-Domain Dialogue Response Generation.

A New Algorithm for the Acquisition of Knowledge from Scientific Literature in Specific Fields Based on Natural Language Comprehension.

Automated Generation and Tagging of Knowledge Components from Multiple-Choice Questions

Knowledge Graph for NLG in the context of conversational agents

Teach Me What to Say and I Will Learn What to Pick: Unsupervised Knowledge Selection Through Response Generation with Pretrained Generative Models

Exploring In-Context Learning for Knowledge Grounded Dialog Generation

Knowledge Authoring with Factual English, Rules, and Actions

Document Knowledge Graph to Enhance Question Answering with Retrieval Augmented Generation

Estimating Knowledge in Large Language Models Without Generating a Single Token

Querying Knowledge via Multi-Hop English Questions

Knowledge As A Bridge: Improving Cross-domain Answer Selection with External Knowledge.

Improving Knowledge-Aware Dialogue Response Generation by Using Human-Written Prototype Dialogues.

Prompting Large Language Models with Knowledge Graphs for Question Answering Involving Long-tail Facts

Chain-of-Knowledge: Grounding Large Language Models via Dynamic Knowledge Adapting over Heterogeneous Sources