LLM-assisted Knowledge Graph Engineering: Experiments with ChatGPT

Lars-Peter Meyer,Claus Stadler,Johannes Frey,Norman Radtke,Kurt Junghanns,Roy Meissner,Gordian Dziwis,Kirill Bulert,Michael Martin
DOI: https://doi.org/10.1007/978-3-658-43705-3_8
2023-07-14
Abstract:Knowledge Graphs (KG) provide us with a structured, flexible, transparent, cross-system, and collaborative way of organizing our knowledge and data across various domains in society and industrial as well as scientific disciplines. KGs surpass any other form of representation in terms of effectiveness. However, Knowledge Graph Engineering (KGE) requires in-depth experiences of graph structures, web technologies, existing models and vocabularies, rule sets, logic, as well as best practices. It also demands a significant amount of work. Considering the advancements in large language models (LLMs) and their interfaces and applications in recent years, we have conducted comprehensive experiments with ChatGPT to explore its potential in supporting KGE. In this paper, we present a selection of these experiments and their results to demonstrate how ChatGPT can assist us in the development and management of KGs.
Artificial Intelligence,Computation and Language,Databases
What problem does this paper attempt to address?
The problem that this paper attempts to solve is to utilize large - language models (LLMs), especially ChatGPT, in Knowledge Graph Engineering (KGE) to assist or automate various knowledge - engineering tasks. Specifically, the paper explores the following aspects: 1. **Assistance in Knowledge Graph Usage**: - Generate SPARQL queries from natural - language questions. - Explore and summarize existing knowledge graphs. - Convert competency questions into SPARQL queries. - Generate or configure the code of data - pipeline tools (or tool chains). 2. **Assistance in Knowledge Graph Construction**: - Populate knowledge graphs. - Create or enrich knowledge - graph schemas/ontologies. - Provide hints regarding graph - design problems by analyzing issues in ChatGPT usage. - Conduct semantic searches for concepts or properties in other existing knowledge graphs. - Create and adjust knowledge graphs based on competency questions. The paper evaluates ChatGPT's performance on these tasks through a series of experiments and discusses its advantages, disadvantages, and challenges, aiming to provide directions for future research. Specific experiments include: - **SPARQL Query Generation**: Test ChatGPT's ability to generate SPARQL queries for a custom - made small knowledge graph and the larger Mondial knowledge graph. - **Knowledge Extraction**: Extract information from 3D - printer specification sheets to construct a knowledge graph. - **Knowledge - Graph Exploration**: Generate a visualization of important concepts in the DBpedia ontology and their connections. Overall, the paper aims to explore and verify the application potential of large - language models in knowledge - graph engineering and how these models can reduce the workload of knowledge engineers and improve the efficiency and accessibility of knowledge engineering.