Abstract:Purpose The rapid rise of large language models (LLMs) has propelled them to the forefront of applications in natural language processing (NLP). This paper aims to present a comprehensive examination of the research landscape in LLMs, providing an overview of the prevailing themes and topics within this dynamic domain. Design/methodology/approach Drawing from an extensive corpus of 198 records published between 1996 to 2023 from the relevant academic database encompassing journal articles, books, book chapters, conference papers and selected working papers, this study delves deep into the multifaceted world of LLM research. In this study, the authors employed the BERTopic algorithm, a recent advancement in topic modeling, to conduct a comprehensive analysis of the data after it had been meticulously cleaned and preprocessed. BERTopic leverages the power of transformer-based language models like bidirectional encoder representations from transformers (BERT) to generate more meaningful and coherent topics. This approach facilitates the identification of hidden patterns within the data, enabling authors to uncover valuable insights that might otherwise have remained obscure. The analysis revealed four distinct clusters of topics in LLM research: “language and NLP”, “education and teaching”, “clinical and medical applications” and “speech and recognition techniques”. Each cluster embodies a unique aspect of LLM application and showcases the breadth of possibilities that LLM technology has to offer. In addition to presenting the research findings, this paper identifies key challenges and opportunities in the realm of LLMs. It underscores the necessity for further investigation in specific areas, including the paramount importance of addressing potential biases, transparency and explainability, data privacy and security, and responsible deployment of LLM technology. Findings The analysis revealed four distinct clusters of topics in LLM research: “language and NLP”, “education and teaching”, “clinical and medical applications” and “speech and recognition techniques”. Each cluster embodies a unique aspect of LLM application and showcases the breadth of possibilities that LLM technology has to offer. In addition to presenting the research findings, this paper identifies key challenges and opportunities in the realm of LLMs. It underscores the necessity for further investigation in specific areas, including the paramount importance of addressing potential biases, transparency and explainability, data privacy and security, and responsible deployment of LLM technology. Practical implications This classification offers practical guidance for researchers, developers, educators, and policymakers to focus efforts and resources. The study underscores the importance of addressing challenges in LLMs, including potential biases, transparency, data privacy, and responsible deployment. Policymakers can utilize this information to shape regulations, while developers can tailor technology development based on the diverse applications identified. The findings also emphasize the need for interdisciplinary collaboration and highlight ethical considerations, providing a roadmap for navigating the complex landscape of LLM research and applications. Originality/value This study stands out as the first to examine the evolution of LLMs across such a long time frame and across such diversified disciplines. It provides a unique perspective on the key areas of LLM research, highlighting the breadth and depth of LLM’s evolution.

Practitioners' Discussions on Building LLM-based Applications for Production

Unraveling the landscape of large language models: a systematic review and future perspectives

An Empirical Study on Challenges for LLM Application Developers

Developer Challenges on Large Language Models: A Study of Stack Overflow and OpenAI Developer Forum Posts

Expansive data, extensive model: Investigating discussion topics around LLM through unsupervised machine learning in academic papers and news

LLMs for science: Usage for code generation and data analysis

Practical Considerations for Agentic LLM Systems

State of Practice: LLMs in Software Engineering and Software Architecture

Harnessing the Power of LLMs in Practice: A Survey on ChatGPT and Beyond

Assessing Hidden Risks of LLMs: An Empirical Study on Robustness, Consistency, and Credibility

Exploring the Frontiers of LLMs in Psychological Applications: A Comprehensive Review

A Survey of Useful LLM Evaluation

"I'm categorizing LLM as a productivity tool": Examining ethics of LLM use in HCI research practices

LLMs as Research Tools: A Large Scale Survey of Researchers' Usage and Perceptions

An Empirical Study on Usage and Perceptions of LLMs in a Software Engineering Project

Domain Specific Adaptation of an Open-Source LLM (Large Language Model)

"Which LLM should I use?": Evaluating LLMs for tasks performed by Undergraduate Computer Science Students

Apprentices to Research Assistants: Advancing Research with Large Language Models

Student Perspectives on Using a Large Language Model (LLM) for an Assignment on Professional Ethics

Understanding LLMs: A Comprehensive Overview from Training to Inference