Abstract:Humankind's understanding of the world is fundamentally linked to our perception and cognition, with \emph{human languages} serving as one of the major carriers of \emph{world knowledge}. In this vein, \emph{Large Language Models} (LLMs) like ChatGPT epitomize the pre-training of extensive, sequence-based world knowledge into neural networks, facilitating the processing and manipulation of this knowledge in a parametric space. This article explores large models through the lens of "knowledge". We initially investigate the role of symbolic knowledge such as Knowledge Graphs (KGs) in enhancing LLMs, covering aspects like knowledge-augmented language model, structure-inducing pre-training, knowledgeable prompts, structured CoT, knowledge editing, semantic tools for LLM and knowledgeable AI agents. Subsequently, we examine how LLMs can boost traditional symbolic knowledge bases, encompassing aspects like using LLM as KG builder and controller, structured knowledge pretraining, and LLM-enhanced symbolic reasoning. Considering the intricate nature of human knowledge, we advocate for the creation of \emph{Large Knowledge Models} (LKM), specifically engineered to manage diversified spectrum of knowledge structures. This promising undertaking would entail several key challenges, such as disentangling knowledge base from language models, cognitive alignment with human knowledge, integration of perception and cognition, and building large commonsense models for interacting with physical world, among others. We finally propose a five-"A" principle to distinguish the concept of LKM.

Do large language models "understand" their knowledge?

Large Knowledge Model: Perspectives and Challenges

Large Language Models and Knowledge Graphs: Opportunities and Challenges

A Perspective on Large Language Models, Intelligent Machines, and Knowledge Acquisition

What's in an embedding? Would a rose by any embedding smell as sweet?

Can Language Models Act as Knowledge Bases at Scale?

LLMs' Understanding of Natural Language Revealed

Symbols and grounding in large language models

Can Large Language Models Create New Knowledge for Spatial Reasoning Tasks?

Large Language Models Are In-Context Semantic Reasoners Rather Than Symbolic Reasoners

Do Large Language Models Know What They Don't Know?

Can Large Language Models Understand DL-Lite Ontologies? An Empirical Study

A Principled Framework for Knowledge-enhanced Large Language Model

Do Large Language Models Understand Logic or Just Mimick Context?

Can Large Language Models Act as Symbolic Reasoners?

Can Large Language Models put 2 and 2 together? Probing for Entailed Arithmetical Relationships

Large Language Models: The Need for Nuance in Current Debates and a Pragmatic Perspective on Understanding

Do Large Language Models Truly Grasp Mathematics? An Empirical Exploration From Cognitive Psychology

Large Language Models as a Tool for Mining Object Knowledge

Towards Uncovering How Large Language Model Works: An Explainability Perspective

Stochastic LLMs do not Understand Language: Towards Symbolic, Explainable and Ontologically Based LLMs