Abstract:Purpose The rapid rise of large language models (LLMs) has propelled them to the forefront of applications in natural language processing (NLP). This paper aims to present a comprehensive examination of the research landscape in LLMs, providing an overview of the prevailing themes and topics within this dynamic domain. Design/methodology/approach Drawing from an extensive corpus of 198 records published between 1996 to 2023 from the relevant academic database encompassing journal articles, books, book chapters, conference papers and selected working papers, this study delves deep into the multifaceted world of LLM research. In this study, the authors employed the BERTopic algorithm, a recent advancement in topic modeling, to conduct a comprehensive analysis of the data after it had been meticulously cleaned and preprocessed. BERTopic leverages the power of transformer-based language models like bidirectional encoder representations from transformers (BERT) to generate more meaningful and coherent topics. This approach facilitates the identification of hidden patterns within the data, enabling authors to uncover valuable insights that might otherwise have remained obscure. The analysis revealed four distinct clusters of topics in LLM research: “language and NLP”, “education and teaching”, “clinical and medical applications” and “speech and recognition techniques”. Each cluster embodies a unique aspect of LLM application and showcases the breadth of possibilities that LLM technology has to offer. In addition to presenting the research findings, this paper identifies key challenges and opportunities in the realm of LLMs. It underscores the necessity for further investigation in specific areas, including the paramount importance of addressing potential biases, transparency and explainability, data privacy and security, and responsible deployment of LLM technology. Findings The analysis revealed four distinct clusters of topics in LLM research: “language and NLP”, “education and teaching”, “clinical and medical applications” and “speech and recognition techniques”. Each cluster embodies a unique aspect of LLM application and showcases the breadth of possibilities that LLM technology has to offer. In addition to presenting the research findings, this paper identifies key challenges and opportunities in the realm of LLMs. It underscores the necessity for further investigation in specific areas, including the paramount importance of addressing potential biases, transparency and explainability, data privacy and security, and responsible deployment of LLM technology. Practical implications This classification offers practical guidance for researchers, developers, educators, and policymakers to focus efforts and resources. The study underscores the importance of addressing challenges in LLMs, including potential biases, transparency, data privacy, and responsible deployment. Policymakers can utilize this information to shape regulations, while developers can tailor technology development based on the diverse applications identified. The findings also emphasize the need for interdisciplinary collaboration and highlight ethical considerations, providing a roadmap for navigating the complex landscape of LLM research and applications. Originality/value This study stands out as the first to examine the evolution of LLMs across such a long time frame and across such diversified disciplines. It provides a unique perspective on the key areas of LLM research, highlighting the breadth and depth of LLM’s evolution.

A Large Language Model Supported Synthesis of Contemporary Academic Integrity Research Trends

Survey on Plagiarism Detection in Large Language Models: The Impact of ChatGPT and Gemini on Academic Integrity

Academic Dishonesty or Academic Integrity? Using Natural Language Processing (NLP) Techniques to Investigate Positive Integrity in Academic Integrity Research

Academic integrity considerations of AI Large Language Models in the post-pandemic era: ChatGPT and beyond

Creating Large Language Model Resistant Exams: Guidelines and Strategies

Topics, Authors, and Institutions in Large Language Model Research: Trends from 17K arXiv Papers

Awes, Laws, and Flaws From Today's LLM Research

The rise of large language models: challenges for Critical Discourse Studies

Academic collaboration on large language model studies increases overall but varies across disciplines

Large language models (LLMs): Risks and policy implications

Deconstructing The Ethics of Large Language Models from Long-standing Issues to New-emerging Dilemmas: A Survey

An Interdisciplinary Outlook on Large Language Models for Scientific Research

"The teachers are confused as well": A Multiple-Stakeholder Ethics Discussion on Large Language Models in Computing Education

The Only Way is Ethics: A Guide to Ethical Research with Large Language Models

A Wolf in Sheep’s Clothing? Critical Discourse Analysis of Five Online Automated Paraphrasing Sites

Unraveling the landscape of large language models: a systematic review and future perspectives

LLMs as Research Tools: A Large Scale Survey of Researchers' Usage and Perceptions

Student Perspectives on Using a Large Language Model (LLM) for an Assignment on Professional Ethics

"I'm categorizing LLM as a productivity tool": Examining ethics of LLM use in HCI research practices

ChatGPT and large language models in academia: opportunities and challenges

Practical and Ethical Challenges of Large Language Models in Education: A Systematic Scoping Review