Borges and AI

Léon Bottou,Bernhard Schölkopf

2023-10-05

Abstract:Many believe that Large Language Models (LLMs) open the era of Artificial Intelligence (AI). Some see opportunities while others see dangers. Yet both proponents and opponents grasp AI through the imagery popularised by science fiction. Will the machine become sentient and rebel against its creators? Will we experience a paperclip apocalypse? Before answering such questions, we should first ask whether this mental imagery provides a good description of the phenomenon at hand. Understanding weather patterns through the moods of the gods only goes so far. The present paper instead advocates understanding LLMs and their connection to AI through the imagery of Jorge Luis Borges, a master of 20th century literature, forerunner of magical realism, and precursor to postmodern literature. This exercise leads to a new perspective that illuminates the relation between language modelling and artificial intelligence.

Computation and Language,Artificial Intelligence,Machine Learning

What problem does this paper attempt to address?

The paper explores the relationship between Large Language Models (LLMs) and Artificial Intelligence (AI), and attempts to provide a new perspective on this relationship through the works of literary master Jorge Luis Borges. The author argues that current discussions about AI are often dominated by images from science fiction, which may not accurately describe the true nature of AI. Instead, by drawing on Borges' literary works, particularly his magical realism, one can better understand the essence of language models and their significance to AI.

The paper first introduces the basic concept of large language models and likens them to a perfect language model capable of generating all possible text sequences. Such a model can generate reasonable subsequent content based on a given text fragment, similar to randomly selecting appropriate text from an infinitely large collection to continue the story. The author further points out that this model is actually creating fictional stories rather than simply retrieving information or stating facts.

Subsequently, the paper explores how language models influence human culture and ways of thinking by analyzing two of Borges' works—"The Garden of Forking Paths" and "The Library of Babel." The concept in "The Garden of Forking Paths" is used to illustrate the multiple possibilities language models face when generating text and how these possibilities branch and converge as the story develops. "The Library of Babel" is used as a metaphor to explain that although language models possess a vast repository of knowledge, the truthfulness of the information is difficult to discern, requiring users to make their own judgments.

The paper also discusses the challenges of language models in practical applications, including how to distinguish fiction from reality, how to handle harmful information, and how to ensure that the model's output aligns with social ethical standards. The author suggests that although language models essentially generate fictional content, if users mistakenly take this content as fact, it could lead to misunderstandings or even dangerous situations. Additionally, the paper mentions efforts to control or purify the output of language models and points out the potential risks in this area.

In summary, this paper aims to re-examine the relationship between large language models and artificial intelligence from a literary perspective, emphasizing the importance of understanding the fictional nature of these models and exploring their impact on social and cultural levels.