Combining Knowledge Graphs and Large Language Models

Amanda Kau,Xuzeng He,Aishwarya Nambissan,Aland Astudillo,Hui Yin,Amir Aryani

2024-07-09

Abstract:In recent years, Natural Language Processing (NLP) has played a significant role in various Artificial Intelligence (AI) applications such as chatbots, text generation, and language translation. The emergence of large language models (LLMs) has greatly improved the performance of these applications, showing astonishing results in language understanding and generation. However, they still show some disadvantages, such as hallucinations and lack of domain-specific knowledge, that affect their performance in real-world tasks. These issues can be effectively mitigated by incorporating knowledge graphs (KGs), which organise information in structured formats that capture relationships between entities in a versatile and interpretable fashion. Likewise, the construction and validation of KGs present challenges that LLMs can help resolve. The complementary relationship between LLMs and KGs has led to a trend that combines these technologies to achieve trustworthy results. This work collected 28 papers outlining methods for KG-powered LLMs, LLM-based KGs, and LLM-KG hybrid approaches. We systematically analysed and compared these approaches to provide a comprehensive overview highlighting key trends, innovative techniques, and common challenges. This synthesis will benefit researchers new to the field and those seeking to deepen their understanding of how KGs and LLMs can be effectively combined to enhance AI applications capabilities.

Computation and Language,Artificial Intelligence

What problem does this paper attempt to address?

The paper primarily explores how to combine Knowledge Graphs (KGs) and Large Language Models (LLMs) to enhance each other's capabilities and address the issues encountered in their practical applications.

Specifically, the paper attempts to address the following core questions:

1. **How to utilize KGs to enhance the capabilities of LLMs?** This includes adding facts from KGs to the prompts of LLMs through knowledge injection to support tasks such as zero-shot question answering; and other methods by which KGs can directly contribute to LLMs, such as improving interpretability and semantic understanding.

2. **How can LLMs support and enhance KGs?** The paper discusses the applications of LLMs in temporal prediction, KG construction, etc., such as using LLMs for historical data prediction and automatically extracting entities and relationships from text to construct KGs.

3. **Is it possible to gain more advantages by more closely integrating KGs and LLMs?** This direction includes developing hybrid methods, such as merging text and knowledge embeddings, or embedding KG knowledge into LLMs to achieve better performance.

In summary, this paper aims to systematically analyze and compare current methods of combining KGs and LLMs to provide a comprehensive overview, highlighting key trends, innovative technologies, and common challenges. The purpose of this is to promote researchers' understanding of the field and drive future research development.