Enhance the Automatic Acquisition of Knowledge

Lu Ruqian

DOI: https://doi.org/10.1007/bf02943111

1989-01-01

Abstract:The first part of this paper gives a short review of the research work done in the field of knowledge acquisition. The second and third parts describe two sets of tools for knowledge, which are designed and implemented by a research group led by the author.

What problem does this paper attempt to address?

A Review of Knowledge Transfer Based on Foreign Studies

林枫,徐金发

DOI: https://doi.org/10.3969/j.issn.1008-5831.2010.05.009

2010-01-01

Abstract:The creation and transfer of knowledge are a basis of competitive advantage in firms.This article generalizes and integrates the extant literatures examining the knowledge transfer.It analyzes the connotation of knowledge,the definition of knowledge transfer,and the theoretical basis and perspectives,process,domain,measurement and evaluation of knowledge transfer.Based on the review,the paper proposes some limitations and future orientations,and specifies the further directions of knowledge transfer.
A Multi-Disciplinary Review of Knowledge Acquisition Methods: From Human to Autonomous Eliciting Agents

George Leu,Hussein Abbass

DOI: https://doi.org/10.48550/arXiv.1802.09669

IF: 14.4

2018-02-27

Artificial Intelligence

Abstract:This paper offers a multi-disciplinary review of knowledge acquisition methods in human activity systems. The review captures the degree of involvement of various types of agencies in the knowledge acquisition process, and proposes a classification with three categories of methods: the human agent, the human-inspired agent, and the autonomous machine agent methods. In the first two categories, the acquisition of knowledge is seen as a cognitive task analysis exercise, while in the third category knowledge acquisition is treated as an autonomous knowledge-discovery endeavour. The motivation for this classification stems from the continuous change over time of the structure, meaning and purpose of human activity systems, which are seen as the factor that fuelled researchers' and practitioners' efforts in knowledge acquisition for more than a century. We show through this review that the KA field is increasingly active due to the higher and higher pace of change in human activity, and conclude by discussing the emergence of a fourth category of knowledge acquisition methods, which are based on red-teaming and co-evolution.
On knowledge based intelligence

Ruqian Lu

DOI: https://doi.org/10.1109/ICIMA.2004.1384138

2004-01-01

Abstract:There have been controversial ideas about whether it is possible to implement intelligent machines and how to do that. People differentiate between three major approaches: the symbolic intelligence, the computational intelligence and the behavioral intelligence. The fourth approach, knowledge based intelligence, has a tight relation, but not equal, to the first one. Since more than 20 years ago, we have started our research on knowledge based intelligence and have taken automatic knowledge acquisition and automatic application sohare prototyping as a test stone. This talk will show our practice done and experiences obtained in this area. In order to let computer acquire knowledge automatically, we have developed a technique of pseudo-natural language understanding. Based on this technique, knowledge can be acquired, sorted, analyzed, merged and organized automatically. It makes the automatic generation of application sofiware possible. We have applied this technique in automatic generation of expert systems, ICAI systems, management information systems and computer animations.
KICE: A Knowledge Consolidation and Expansion Framework for Relation Extraction.

Yilin Lu,Xiaoqiang Wang,Haofeng Yang,Siliang Tang

DOI: https://doi.org/10.1609/aaai.v37i11.26565

2023-01-01

Proceedings of the AAAI Conference on Artificial Intelligence

Abstract:Machine Learning is often challenged by insufficient labeled data. Previous methods employing implicit commonsense knowledge of pre-trained language models (PLMs) or pattern-based symbolic knowledge have achieved great success in mitigating manual annotation efforts. In this paper, we focus on the collaboration among different knowledge sources and present KICE, a K nowledge-evolving framework by I terative C onsolidation and E xpansion with the guidance of PLMs and rule-based patterns. Specifically, starting with limited labeled data as seeds, KICE first builds a Rule Generator by prompt-tuning to stimulate the rich knowledge distributed in PLMs, generate seed rules, and initialize the rules set. Afterwards, based on the rule-labeled data, the task model is trained in a self-training pipeline where the knowledge in rules set is consolidated with self-learned high-confidence rules. Finally, for the low-confidence rules, KICE solicits human-enlightened understanding and expands the knowledge coverage for better task model training. Our framework is verified on relation extraction (RE) task, and the experiments on TACRED show that the model performance ( F 1 ) grows from 33.24% to 79.84% with the enrichment of knowledge, outperforming all the baselines including other knowledgeable methods.
Enabling Knowledge Refinement Upon New Concepts in Abductive Learning.

Yu-Xuan Huang,Wang-Zhou Dai,Yuan Jiang,Zhi-Hua Zhou

DOI: https://doi.org/10.1609/aaai.v37i7.25959

2023-01-01

Proceedings of the AAAI Conference on Artificial Intelligence

Abstract:Recently there are great efforts on leveraging machine learning and logical reasoning. Many approaches start from a given knowledge base, and then try to utilize the knowledge to help machine learning. In real practice, however, the given knowledge base can often be incomplete or even noisy, and thus, it is crucial to develop the ability of knowledge refinement or enhancement. This paper proposes to enable the Abductive learning (ABL) paradigm to have the ability of knowledge refinement/enhancement. In particular, we focus on the problem that, in contrast to closed-environment tasks where a fixed set of symbols are enough to represent the concepts in the domain, in open-environment tasks new concepts may emerge. Ignoring those new concepts can lead to significant performance decay, whereas it is challenging to identify new concepts and add them to the existing knowledge base with potential conflicts resolved. We propose the ABL nc approach which exploits machine learning in ABL to identify new concepts from data, exploits knowledge graph to match them with entities, and refines existing knowledge base to resolve conflicts. The refined/enhanced knowledge base can then be used in the next loop of ABL and help improve the performance of machine learning. Experiments on three neuro-symbolic learning tasks verified the effectiveness of the proposed approach.
Benchmarking Knowledge-driven Zero-shot Learning

Yuxia Geng,Jiaoyan Chen,Xiang Zhuang,Zhuo Chen,Jeff Z. Pan,Juan Li,Zonggang Yuan,Huajun Chen

DOI: https://doi.org/10.1016/j.websem.2022.100757

IF: 2.77

2022-01-01

Journal of Web Semantics

Abstract:External knowledge (a.k.a. side information) plays a critical role in zero-shot learning (ZSL) which aims to predict with unseen classes that have never appeared in training data. Several kinds of external knowledge, such as text and attribute, have been widely investigated, but they alone are limited with incomplete semantics. Some very recent studies thus propose to use Knowledge Graph (KG) due to its high expressivity and compatibility for representing kinds of knowledge. However, the ZSL community is still in short of standard benchmarks for studying and comparing different external knowledge settings and different KG-based ZSL methods. In this paper, we proposed six resources covering three tasks, i.e., zero-shot image classification (ZS-IMGC), zero-shot relation extraction (ZS-RE), and zero-shot KG completion (ZS-KGC). Each resource has a normal ZSL benchmark and a KG containing semantics ranging from text to attribute, from relational knowledge to logical expressions. We have clearly presented these resources including their construction, statistics, data formats and usage cases w.r.t. different ZSL methods. More importantly, we have conducted a comprehensive benchmarking study, with a few classic and state-of-the-art methods for each task, including a method with KG augmented explanation. We discussed and compared different ZSL paradigms w.r.t. different external knowledge settings, and found that our resources have great potential for developing more advanced ZSL methods and more solutions for applying KGs for augmenting machine learning. All the resources are available at https://github.com/China-UK-ZSL/Resources_for_KZSL.
Shaping in Reinforcement Learning by Knowledge Transferred from Human-Demonstrations of a Simple Similar Task.

Guo-Fang Wang,Zhou Fang,Ping Li

DOI: https://doi.org/10.3233/jifs-17052

2018-01-01

Journal of Intelligent & Fuzzy Systems

Abstract:Reusing knowledge obtained in other related but different tasks to accelerate the learning procedure of reinforcement learning (RL) has attracted more and more attention and expert knowledge transfer is the root cause of positive effect. Nevertheless, compared with acquiring knowledge by RL trainin g in source tasks, this paper proposes to transfer knowledge contained in human-demonstrations of source tasks. Based on this, three specific forms of knowledge in total are mined from demonstration trajectories to be reused in the target task to shape RL and all of them are closely associated with the similarity between states of different tasks which can be measured by Euclidean distance via human-supplied inter-task mappings. In more detail, the similarity between the target state and the most similar state in source samples, the proportion of different actions among the k-NN of the target state in source samples and the proportion of different actions under a constant similarity with the target state in source samples are respectively selected to initialize the value of state-action function. Simulation experiments of mountain car problems with different difficulties and different dimensions suggest that all the three shaping methods could obviously speed up RL. In comparison, it can also be found that the two latter methods are more robust and efficient to the quality of human demonstrations as it takes more source samples’ information into consideration.
The Recursive Theory of Knowledge Augmentation: Integrating human intuition and knowledge in Artificial Intelligence to augment organizational knowledge

Antoine Harfouche,Bernard Quinio,Mario Saba,Peter Bou Saba

DOI: https://doi.org/10.1007/s10796-022-10352-8

2022-10-27

Information Systems Frontiers

Abstract:Artificial intelligence (AI) has increased the ability of organizations to accumulate tacit and explicit knowledge to inform management decision-making. Despite the hype and popularity of AI, there is a noticeable scarcity of research focusing on AI's potential role in enriching and augmenting organizational knowledge. This paper develops a recursive theory of knowledge augmentation in organizations (the KAM model) based on a synthesis of extant literature and a four-year revised canonical action research project. The project aimed to design and implement a human-centric AI (called Project) to solve the lack of integration of tacit and explicit knowledge in a scientific research center (SRC). To explore the patterns of knowledge augmentation in organizations, this study extends Nonaka's SECI (socialization, externalization, combination, and internalization) model by incorporating the human-in-the-loop Informed Artificial Intelligence (IAI) approach. The proposed design offers the possibility to integrate experts' intuition and domain knowledge in AI in an explainable way. The findings show that organizational knowledge can be augmented through a recursive process enabled by the design and implementation of human-in-the-loop IAI. The study has important implications for research and practice.

computer science, information systems, theory & methods
Knowledge enhanced bottom-up affordance grounding for robotic interaction

Wen Qu,Xiao Li,Xiao Jin

DOI: https://doi.org/10.7717/peerj-cs.2097

2024-07-05

PeerJ Computer Science

Abstract:With the rapid advancement of robotics technology, an increasing number of researchers are exploring the use of natural language as a communication channel between humans and robots. In scenarios where language conditioned manipulation grounding, prevailing methods rely heavily on supervised multimodal deep learning. In this paradigm, robots assimilate knowledge from both language instructions and visual input. However, these approaches lack external knowledge for comprehending natural language instructions and are hindered by the substantial demand for a large amount of paired data, where vision and language are usually linked through manual annotation for the creation of realistic datasets. To address the above problems, we propose the knowledge enhanced bottom-up affordance grounding network (KBAG-Net), which enhances natural language understanding through external knowledge, improving accuracy in object grasping affordance segmentation. In addition, we introduce a semi-automatic data generation method aimed at facilitating the quick establishment of the language following manipulation grounding dataset. The experimental results on two standard dataset demonstrate that our method outperforms existing methods with the external knowledge. Specifically, our method outperforms the two-stage method by 12.98% and 1.22% of mIoU on the two dataset, respectively. For broader community engagement, we will make the semi-automatic data construction method publicly available at https://github.com/wmqu/Automated-Dataset-Construction4LGM .

computer science, information systems, artificial intelligence, theory & methods
Absorb What You Need: Accelerating Exploration Via Valuable Knowledge Extraction

You Wu,Zhe Wu,Renye Yan,Pin Tao,Junliang Xing

DOI: https://doi.org/10.1109/ijcnn60899.2024.10651098

2024-01-01

Abstract:Leveraging external knowledge and extracting valuable insights are efficient human practices when handling various tasks. In contrast, current artificial intelligence lacks this capability. Recent research aims to teach Reinforcement Learning (RL) agents to incorporate external knowledge in the form of natural language to accelerate exploration. A common assumption in many of these approaches is that all introduced external knowledge is inherently valuable. To eliminate this assumption, we introduce the Knowledge Extraction Exploration Framework (KEEF). KEEF comprises two key components: 1) a knowledge extractor, designed to filter useful external knowledge based on three dimensions, task relevance, environment relevance, and achievement difficulty, through a prediction network and a policy network; and 2) a policy executor, which is a knowledge-conditioned network facilitating joint reasoning between the useful knowledge extracted by the knowledge extractor and the current state of the environment. In eight challenging sparse reward BabyAI environments, KEEF has consistently demonstrated superior sampling efficiency compared to knowledge-based and traditional RL methods.
Expert-oriented optimization of knowledge base

Zhao-han SHENG,Wei-dong ZHAO,Guo-hua CHEN

DOI: https://doi.org/10.3321/j.issn:1007-9807.2001.03.007

2001-01-01

Abstract:The quality of knowledge base is important for knowledge intensive systems(KIS), such as expert systems and intelligent decision support systems. But over a long time, knowledge acquisition is a bottleneck in designing KIS due to the bad coordination between knowledge engineers and experts, which is limited by human epistemology level nowadays. To solve the problem, this paper utilizes some machine learning theories (mainly rough set theory) to get a rough knowledge base and then choose genetic algorithms, visualization technology, knowledge verification and validation technology to optimize it. We, in this way, build a new relation between knowledge engineers and experts in which experts play a decisive role while knowledge engineers are accessory, i.e., it is expert-oriented during the knowledge acquisition course.
Development and Automatic Construction of Context-based Knowledge Base

Li Guangjian,Li Yazi,Guo Liwen

DOI: https://doi.org/10.3969/j.issn.1000-4254.2008.02.016

2008-01-01

Library journal

Abstract:Firstly this paper briefly introduces the concept and the function of the context-based knowledge base,then by analyzing on-line publishers and electronic journals contained in the publishers' web sites,constructs context-based knowledge base which program a spider crawling data,automatically constructing the knowledge base,and updating the base instantly.Finally the principle and the workflow of the context-based knowledge base is given.
Improving the Applicability of Knowledge-Enhanced Dialogue Generation Systems by Using Heterogeneous Knowledge from Multiple Sources

Sixing Wu,Minghui Wang,Ying Li,Dawei Zhang,Zhonghai Wu

DOI: https://doi.org/10.1145/3488560.3498393

2022-01-01

Abstract:Traditional conversational systems can only access the given query during the response generation, leading to meaningless responses. To this end, researchers proposed to enhance dialogue generation by integrating external knowledge. Although such methods have achieved remarkable gains, the use of only single-source knowledge often makes existing knowledge-enhanced methods degenerate into traditional models in real scenarios because of the insufficient knowledge coverage of single-source knowledge. To improve the applicability of knowledge-enhanced methods, we propose two novel frameworks to use heterogeneous knowledge from multiple sources. We first propose an MHKD-Seq2Seq framework, which can use different heterogeneous knowledge by identifying abstractlevel knowledge behaviors; meanwhile, a Diffuse-Aggregate scheme is used to process multiple knowledge simultaneously and produce a unified result. The next framework MHKD-ARPLM can leverage the advantages of pretrained language models with Knowledge Linearization techniques. In experiments, we collected dialogues from previously open-released datasets and built a multisource knowledge-aligned dataset TriKE-Weibo, which involves three knowledge sources: commonsense, texts, and infobox tables. Extensive evaluations demonstrate the performance leadership of our approaches against competitive baseline models.
A Survey of Knowledge-Enhanced Text Generation

Wenhao Yu,Chenguang Zhu,Zaitang Li,Zhiting Hu,Qingyun Wang,Heng Ji,Meng Jiang

DOI: https://doi.org/10.1145/3512467

IF: 16.6

2022-03-25

ACM Computing Surveys

Abstract:The goal of text-to-text generation is to make machines express like a human in many applications such as conversation, summarization, and translation. It is one of the most important yet challenging tasks in natural language processing (NLP). Various neural encoder-decoder models have been proposed to achieve the goal by learning to map input text to output text. However, the input text alone often provides limited knowledge to generate the desired output, so the performance of text generation is still far from satisfaction in many real-world scenarios. To address this issue, researchers have considered incorporating (i) internal knowledge embedded in the input text and (ii) external knowledge from outside sources such as knowledge base and knowledge graph into the text generation system. This research topic is known as knowledge-enhanced text generation . In this survey, we present a comprehensive review of the research on this topic over the past five years. The main content includes two parts: (i) general methods and architectures for integrating knowledge into text generation; (ii) specific techniques and applications according to different forms of knowledge data. This survey can have broad audiences, researchers and practitioners, in academia and industry.

computer science, theory & methods
Research on the Knowledge Management in Component Retrieval by Intelligent Agent

Xue Yunjiao,Qian Leqiu,Peng Xin,Xu Ruzhi

DOI: https://doi.org/10.3321/j.issn:1002-8331.2006.08.003

2006-01-01

Abstract:The intelligent agents can perform the retrieval requests from users via collaboration in a distributed component repository system.The primary problem to solve in retrieval is the selection of data source,i.e.,to locate which repositories may possess the target components.The intelligent agents have their own knowledge base.They need the capability to learn new information and update their knowledge base to keep the retrieval results effective.This paper discusses the updatable agents that can incorporate new information into an existing knowledge base.We also propose a method for knowledge description and update based on logical programming.This method can execute the update task following a declarative updating policy.The updatable agents we proposed have clear semantics,and are able to deal with inconsistent information in a relatively intelligent way.
KnowledgeShovel: An AI-in-the-Loop Document Annotation System for Scientific Knowledge Base Construction

Shao Zhang,Yuting Jia,Hui Xu,Dakuo Wang,Toby Jia-jun Li,Ying Wen,Xinbing Wang,Chenghu Zhou

DOI: https://doi.org/10.48550/arXiv.2210.02830

2022-10-06

Abstract:Constructing a comprehensive, accurate, and useful scientific knowledge base is crucial for human researchers synthesizing scientific knowledge and for enabling Al-driven scientific discovery. However, the current process is difficult, error-prone, and laborious due to (1) the enormous amount of scientific literature available; (2) the highly-specialized scientific domains; (3) the diverse modalities of information (text, figure, table); and, (4) the silos of scientific knowledge in different publications with inconsistent formats and structures. Informed by a formative study and iterated with participatory design workshops, we designed and developed KnowledgeShovel, an Al-in-the-Loop document annotation system for researchers to construct scientific knowledge bases. The design of KnowledgeShovel introduces a multi-step multi-modal human-AI collaboration pipeline that aligns with users' existing workflows to improve data accuracy while reducing the human burden. A follow-up user evaluation with 7 geoscience researchers shows that KnowledgeShovel can enable efficient construction of scientific knowledge bases with satisfactory accuracy.

Digital Libraries,Artificial Intelligence,Human-Computer Interaction
KnowRU: Knowledge Reusing via Knowledge Distillation in Multi-agent Reinforcement Learning

Zijian Gao,Kele Xu,Bo Ding,Huaimin Wang,Yiying Li,Hongda Jia

DOI: https://doi.org/10.3390/e23081043

2021-03-27

Abstract:Recently, deep Reinforcement Learning (RL) algorithms have achieved dramatically progress in the multi-agent area. However, training the increasingly complex tasks would be time-consuming and resources-exhausting. To alleviate this problem, efficient leveraging the historical experience is essential, which is under-explored in previous studies as most of the exiting methods may fail to achieve this goal in a continuously variational system due to their complicated design and environmental dynamics. In this paper, we propose a method, named "KnowRU" for knowledge reusing which can be easily deployed in the majority of the multi-agent reinforcement learning algorithms without complicated hand-coded design. We employ the knowledge distillation paradigm to transfer the knowledge among agents with the goal to accelerate the training phase for new tasks, while improving the asymptotic performance of agents. To empirically demonstrate the robustness and effectiveness of KnowRU, we perform extensive experiments on state-of-the-art multi-agent reinforcement learning (MARL) algorithms on collaborative and competitive scenarios. The results show that KnowRU can outperform the recently reported methods, which emphasizes the importance of the proposed knowledge reusing for MARL.

Artificial Intelligence,Multiagent Systems
Knowledge Representation Learning: A Quantitative Review

Yankai Lin,Xu Han,Ruobing Xie,Zhiyuan Liu,Maosong Sun

2018-01-01

Abstract:Knowledge representation learning (KRL) aims to represent entities and relations in knowledge graph in low-dimensional semantic space, which have been widely used in massive knowledge-driven tasks. In this article, we introduce the reader to the motivations for KRL, and overview existing approaches for KRL. Afterwards, we extensively conduct and quantitative comparison and analysis of several typical KRL methods on three evaluation tasks of knowledge acquisition including knowledge graph completion, triple classification, and relation extraction. We also review the real-world applications of KRL, such as language modeling, question answering, information retrieval, and recommender systems. Finally, we discuss the remaining challenges and outlook the future directions for KRL. The codes and datasets used in the experiments can be found in https://github.com/thunlp/OpenKE.
A Unified Framework for Human-Robot Knowledge Transfer.

Nishant Shukla,Caiming Xiong,Song-Chun Zhu

2015-01-01

Abstract:Robots capable of growing knowledge and learning new tasks is of demanding interest. We formalize knowledge transfer in human-robot interactions, and establish a testing framework for it. As a proof of concept, we implement a robot system that not only learns in real-time from human demonstrations, but also transfers this knowledge.
A Comprehensive Survey on Automatic Knowledge Graph Construction

Lingfeng Zhong,Jia Wu,Qian Li,Hao Peng,Xindong Wu

DOI: https://doi.org/10.1145/3618295

IF: 16.6

2023-09-05

ACM Computing Surveys

Abstract:Automatic knowledge graph construction aims to manufacture structured human knowledge. To this end, much effort has historically been spent extracting informative fact patterns from different data sources. However, more recently, research interest has shifted to acquiring conceptualized structured knowledge beyond informative data. In addition, researchers have also been exploring new ways of handling sophisticated construction tasks in diversified scenarios. Thus, there is a demand for a systematic review of paradigms to organize knowledge structures beyond data-level mentions. To meet this demand, we comprehensively survey more than 300 methods to summarize the latest developments in knowledge graph construction. A knowledge graph is built in three steps: knowledge acquisition, knowledge refinement, and knowledge evolution. The processes of knowledge acquisition are reviewed in detail, including obtaining entities with fine-grained types and their conceptual linkages to knowledge graphs; resolving coreferences; and extracting entity relationships in complex scenarios. The survey covers models for knowledge refinement, including knowledge graph completion, and knowledge fusion. Methods to handle knowledge evolution are also systematically presented, including condition knowledge acquisition, condition knowledge graph completion, and knowledge dynamic. We present the paradigms to compare the distinction among these methods along the axis of the data environment, motivation, and architecture. Additionally, we also provide briefs on accessible resources that can help readers to develop practical knowledge graph systems. The survey concludes with discussions on the challenges and possible directions for future exploration.

computer science, theory & methods

Enhance the Automatic Acquisition of Knowledge

A Review of Knowledge Transfer Based on Foreign Studies

A Multi-Disciplinary Review of Knowledge Acquisition Methods: From Human to Autonomous Eliciting Agents

On knowledge based intelligence

KICE: A Knowledge Consolidation and Expansion Framework for Relation Extraction.

Enabling Knowledge Refinement Upon New Concepts in Abductive Learning.

Benchmarking Knowledge-driven Zero-shot Learning

Shaping in Reinforcement Learning by Knowledge Transferred from Human-Demonstrations of a Simple Similar Task.

The Recursive Theory of Knowledge Augmentation: Integrating human intuition and knowledge in Artificial Intelligence to augment organizational knowledge

Knowledge enhanced bottom-up affordance grounding for robotic interaction

Absorb What You Need: Accelerating Exploration Via Valuable Knowledge Extraction

Expert-oriented optimization of knowledge base

Development and Automatic Construction of Context-based Knowledge Base

Improving the Applicability of Knowledge-Enhanced Dialogue Generation Systems by Using Heterogeneous Knowledge from Multiple Sources

A Survey of Knowledge-Enhanced Text Generation

Research on the Knowledge Management in Component Retrieval by Intelligent Agent

KnowledgeShovel: An AI-in-the-Loop Document Annotation System for Scientific Knowledge Base Construction

KnowRU: Knowledge Reusing via Knowledge Distillation in Multi-agent Reinforcement Learning

Knowledge Representation Learning: A Quantitative Review

A Unified Framework for Human-Robot Knowledge Transfer.

A Comprehensive Survey on Automatic Knowledge Graph Construction