Abstract:Purpose The rapid rise of large language models (LLMs) has propelled them to the forefront of applications in natural language processing (NLP). This paper aims to present a comprehensive examination of the research landscape in LLMs, providing an overview of the prevailing themes and topics within this dynamic domain. Design/methodology/approach Drawing from an extensive corpus of 198 records published between 1996 to 2023 from the relevant academic database encompassing journal articles, books, book chapters, conference papers and selected working papers, this study delves deep into the multifaceted world of LLM research. In this study, the authors employed the BERTopic algorithm, a recent advancement in topic modeling, to conduct a comprehensive analysis of the data after it had been meticulously cleaned and preprocessed. BERTopic leverages the power of transformer-based language models like bidirectional encoder representations from transformers (BERT) to generate more meaningful and coherent topics. This approach facilitates the identification of hidden patterns within the data, enabling authors to uncover valuable insights that might otherwise have remained obscure. The analysis revealed four distinct clusters of topics in LLM research: “language and NLP”, “education and teaching”, “clinical and medical applications” and “speech and recognition techniques”. Each cluster embodies a unique aspect of LLM application and showcases the breadth of possibilities that LLM technology has to offer. In addition to presenting the research findings, this paper identifies key challenges and opportunities in the realm of LLMs. It underscores the necessity for further investigation in specific areas, including the paramount importance of addressing potential biases, transparency and explainability, data privacy and security, and responsible deployment of LLM technology. Findings The analysis revealed four distinct clusters of topics in LLM research: “language and NLP”, “education and teaching”, “clinical and medical applications” and “speech and recognition techniques”. Each cluster embodies a unique aspect of LLM application and showcases the breadth of possibilities that LLM technology has to offer. In addition to presenting the research findings, this paper identifies key challenges and opportunities in the realm of LLMs. It underscores the necessity for further investigation in specific areas, including the paramount importance of addressing potential biases, transparency and explainability, data privacy and security, and responsible deployment of LLM technology. Practical implications This classification offers practical guidance for researchers, developers, educators, and policymakers to focus efforts and resources. The study underscores the importance of addressing challenges in LLMs, including potential biases, transparency, data privacy, and responsible deployment. Policymakers can utilize this information to shape regulations, while developers can tailor technology development based on the diverse applications identified. The findings also emphasize the need for interdisciplinary collaboration and highlight ethical considerations, providing a roadmap for navigating the complex landscape of LLM research and applications. Originality/value This study stands out as the first to examine the evolution of LLMs across such a long time frame and across such diversified disciplines. It provides a unique perspective on the key areas of LLM research, highlighting the breadth and depth of LLM’s evolution.

On the uniqueness of continuous inverse kinetic theory for incompressible fluids

Surveying the MLLM Landscape: A Meta-Review of Current Surveys

Advancements and Methodologies in Natural Language Processing and Machine Learning: A Comprehensive Review

SLANG: New Concept Comprehension of Large Language Models

An automated domain-independent text reading, interpreting and extracting approach for reviewing the scientific literature

Multilingual Large Language Model: A Survey of Resources, Taxonomy and Frontiers

A Review of Multilingualism in and for Ontologies

NLPExplorer: Exploring the Universe of NLP Papers

The early days of contemporary philosophy of science: novel insights from machine translation and topic-modeling of non-parallel multilingual corpora

Exploring the Landscape of Natural Language Processing Research

Use of Formal Ethical Reviews in NLP Literature: Historical Trends and Current Practices

Unraveling the landscape of large language models: a systematic review and future perspectives

Sharing Matters: Analysing Neurons Across Languages and Tasks in LLMs

Concept Induction: Analyzing Unstructured Text with High-Level Concepts Using LLooM

LLM-based NLG Evaluation: Current Status and Challenges

LLM With Tools: A Survey

The monolingual problem of computer-assisted language learning

LLMs Assist NLP Researchers: Critique Paper (Meta-)Reviewing

A Case Study and Qualitative Analysis of Simple Cross-Lingual Opinion Mining

Automated Source Code Generation and Auto-completion Using Deep Learning: Comparing and Discussing Current Language-Model-Related Approaches