Abstract:Purpose The rapid rise of large language models (LLMs) has propelled them to the forefront of applications in natural language processing (NLP). This paper aims to present a comprehensive examination of the research landscape in LLMs, providing an overview of the prevailing themes and topics within this dynamic domain. Design/methodology/approach Drawing from an extensive corpus of 198 records published between 1996 to 2023 from the relevant academic database encompassing journal articles, books, book chapters, conference papers and selected working papers, this study delves deep into the multifaceted world of LLM research. In this study, the authors employed the BERTopic algorithm, a recent advancement in topic modeling, to conduct a comprehensive analysis of the data after it had been meticulously cleaned and preprocessed. BERTopic leverages the power of transformer-based language models like bidirectional encoder representations from transformers (BERT) to generate more meaningful and coherent topics. This approach facilitates the identification of hidden patterns within the data, enabling authors to uncover valuable insights that might otherwise have remained obscure. The analysis revealed four distinct clusters of topics in LLM research: “language and NLP”, “education and teaching”, “clinical and medical applications” and “speech and recognition techniques”. Each cluster embodies a unique aspect of LLM application and showcases the breadth of possibilities that LLM technology has to offer. In addition to presenting the research findings, this paper identifies key challenges and opportunities in the realm of LLMs. It underscores the necessity for further investigation in specific areas, including the paramount importance of addressing potential biases, transparency and explainability, data privacy and security, and responsible deployment of LLM technology. Findings The analysis revealed four distinct clusters of topics in LLM research: “language and NLP”, “education and teaching”, “clinical and medical applications” and “speech and recognition techniques”. Each cluster embodies a unique aspect of LLM application and showcases the breadth of possibilities that LLM technology has to offer. In addition to presenting the research findings, this paper identifies key challenges and opportunities in the realm of LLMs. It underscores the necessity for further investigation in specific areas, including the paramount importance of addressing potential biases, transparency and explainability, data privacy and security, and responsible deployment of LLM technology. Practical implications This classification offers practical guidance for researchers, developers, educators, and policymakers to focus efforts and resources. The study underscores the importance of addressing challenges in LLMs, including potential biases, transparency, data privacy, and responsible deployment. Policymakers can utilize this information to shape regulations, while developers can tailor technology development based on the diverse applications identified. The findings also emphasize the need for interdisciplinary collaboration and highlight ethical considerations, providing a roadmap for navigating the complex landscape of LLM research and applications. Originality/value This study stands out as the first to examine the evolution of LLMs across such a long time frame and across such diversified disciplines. It provides a unique perspective on the key areas of LLM research, highlighting the breadth and depth of LLM’s evolution.

Defining a New NLP Playground

Has It All Been Solved? Open NLP Research Questions Not Solved by Large Language Models

Exploring the frontiers of deep learning and natural language processing: A comprehensive overview of key challenges and emerging trends

Large Language Models Meet NLP: A Survey

Deep Learning and Machine Learning -- Natural Language Processing: From Theory to Application

The Shifted and The Overlooked: A Task-oriented Investigation of User-GPT Interactions

Exploring the Landscape of Natural Language Processing Research

Challenges and Applications of Large Language Models

Domain Specialization as the Key to Make Large Language Models Disruptive: A Comprehensive Survey

NLPBench: Evaluating Large Language Models on Solving NLP Problems

Unraveling the landscape of large language models: a systematic review and future perspectives

Leveraging the Potential of Large Language Models in Education Through Playful and Game-Based Learning

Exploring the landscape of large language models: Foundations, techniques, and challenges

Perils and opportunities in using large language models in psychological research

LLM-Generated Natural Language Meets Scaling Laws: New Explorations and Data Augmentation Methods

Using large language models in psychology

Transforming Scholarly Landscapes: Influence of Large Language Models on Academic Fields beyond Computer Science

Challenges and Contributing Factors in the Utilization of Large Language Models (LLMs)

Leveraging Large Language Models for NLG Evaluation: Advances and Challenges

Natural Language Processing RELIES on Linguistics

Surveying (Dis)Parities and Concerns of Compute Hungry NLP Research