Generative linguistics contribution to artificial intelligence: Where this contribution lies?

Mohammed Q. Shormani
2024-10-31
Abstract:This article aims to characterize Generative linguistics (GL) contribution to artificial intelligence (AI), alluding to the debate among linguists and AI scientists on whether linguistics belongs to humanities or science. In this article, I will try not to be biased as a linguist, studying the phenomenon from an independent scientific perspective. The article walks the researcher/reader through the scientific theorems and rationales involved in AI which belong from GL, specifically the Chomsky School. It, thus, provides good evidence from syntax, semantics, language faculty, Universal Grammar, computational system of human language, language acquisition, human brain, programming languages (e.g. Python), Large Language Models, and unbiased AI scientists that this contribution is huge, and that this contribution cannot be denied. It concludes that however the huge GL contribution to AI, there are still points of divergence including the nature and type of language input.
Computation and Language
What problem does this paper attempt to address?
The main problem that this paper attempts to solve is to explore the contributions of Generative Linguistics (GL) to Artificial Intelligence (AI) and discuss to what extent such contributions can be recognized. Specifically, the article aims to answer the following key questions: 1. **What is Generative Linguistics?** 2. **How has AI developed from the ideas, concepts and assumptions of Generative Linguistics?** 3. **In which aspects do Generative Linguistics and AI have intersections and differences?** ### Overview of Main Content #### 1. Research Background - The article first introduces the basic theories of Generative Linguistics, especially the "Chomsky School", and explains its research in grammar, semantics, language acquisition, Universal Grammar (UG), computational systems, brain science, etc. - It discusses the origin and development of AI, especially the current large - language models (LLMs) and the deep neural networks (DNNs) and neural - algorithmic networks (NNAs) behind them. #### 2. Theoretical Framework of Generative Linguistics - **Syntax**: Starting from Chomsky's "Syntactic Structures", it introduces the development process of generative grammar, including Standard Theory, Modified ST, Extended Standard Theory, Principles and Parameters Framework (P&P), and Minimalism. - **Universal Grammar and Language Acquisition**: It discusses the concept of UG, that is, the inborn language ability of human beings, and explains the role of UG in the L1 and L2 acquisition processes. - **Computational System of Human Languages**: It describes core operations such as Select, Merge, Agree and Spell - out, and how these operations process language structures in the brain. #### 3. Intersection Points between AI and Generative Linguistics - **Natural Language Understanding and Generation**: Generative Linguistics provides a basis for AI to develop natural language understanding and generation capabilities. - **Explanatory Modeling**: AI utilizes human - heuristic modeling techniques and judgment. - **Processing of Language Input**: AI draws on the research results of linguistics to extract and represent the meaning of language input. #### 4. Controversies and Differences - Although Generative Linguistics has made great contributions to AI, there are still differences in some aspects, such as the nature and type of language input. - The paper also mentions some scientists' criticisms of the "Chomsky School", such as the views of Geoffrey Hinton, the Nobel laureate in physics, but he believes that these criticisms are often based on misunderstandings or prejudices. ### Conclusion Through detailed theoretical analysis and empirical evidence, the article proves the great contributions of Generative Linguistics to AI, and points out that although there are some differences, these contributions cannot be ignored. At the same time, the article emphasizes the importance of interdisciplinary research, especially the bridging role between linguistics and AI. ### Examples of Formulas Involved - **Core Assumption of the Minimalist Program (Strong Minimalist Thesis, SMT)**: \[ \text{Language is the optimal solution that meets legibility conditions} \] Here, legibility conditions refer to how the Core Computational System (CCHL) optimally associates lexical items with interfaces (LF and PF). Through the above content, the article comprehensively explores the contributions of Generative Linguistics to AI and provides directions for future research.