Abstract:Purpose The rapid rise of large language models (LLMs) has propelled them to the forefront of applications in natural language processing (NLP). This paper aims to present a comprehensive examination of the research landscape in LLMs, providing an overview of the prevailing themes and topics within this dynamic domain. Design/methodology/approach Drawing from an extensive corpus of 198 records published between 1996 to 2023 from the relevant academic database encompassing journal articles, books, book chapters, conference papers and selected working papers, this study delves deep into the multifaceted world of LLM research. In this study, the authors employed the BERTopic algorithm, a recent advancement in topic modeling, to conduct a comprehensive analysis of the data after it had been meticulously cleaned and preprocessed. BERTopic leverages the power of transformer-based language models like bidirectional encoder representations from transformers (BERT) to generate more meaningful and coherent topics. This approach facilitates the identification of hidden patterns within the data, enabling authors to uncover valuable insights that might otherwise have remained obscure. The analysis revealed four distinct clusters of topics in LLM research: “language and NLP”, “education and teaching”, “clinical and medical applications” and “speech and recognition techniques”. Each cluster embodies a unique aspect of LLM application and showcases the breadth of possibilities that LLM technology has to offer. In addition to presenting the research findings, this paper identifies key challenges and opportunities in the realm of LLMs. It underscores the necessity for further investigation in specific areas, including the paramount importance of addressing potential biases, transparency and explainability, data privacy and security, and responsible deployment of LLM technology. Findings The analysis revealed four distinct clusters of topics in LLM research: “language and NLP”, “education and teaching”, “clinical and medical applications” and “speech and recognition techniques”. Each cluster embodies a unique aspect of LLM application and showcases the breadth of possibilities that LLM technology has to offer. In addition to presenting the research findings, this paper identifies key challenges and opportunities in the realm of LLMs. It underscores the necessity for further investigation in specific areas, including the paramount importance of addressing potential biases, transparency and explainability, data privacy and security, and responsible deployment of LLM technology. Practical implications This classification offers practical guidance for researchers, developers, educators, and policymakers to focus efforts and resources. The study underscores the importance of addressing challenges in LLMs, including potential biases, transparency, data privacy, and responsible deployment. Policymakers can utilize this information to shape regulations, while developers can tailor technology development based on the diverse applications identified. The findings also emphasize the need for interdisciplinary collaboration and highlight ethical considerations, providing a roadmap for navigating the complex landscape of LLM research and applications. Originality/value This study stands out as the first to examine the evolution of LLMs across such a long time frame and across such diversified disciplines. It provides a unique perspective on the key areas of LLM research, highlighting the breadth and depth of LLM’s evolution.

Opportunities and Challenges of Applying Large Language Models in Building Energy Efficiency and Decarbonization Studies: An Exploratory Overview

Exploring the capabilities and limitations of large language models in the electric energy sector

Advancing Building Energy Modeling with Large Language Models: Exploration and Case Studies

Applications and Challenges for Large Language Models: from Data Management Perspective

Decoding Large-Language Models: A Systematic Overview of Socio-Technical Impacts, Constraints, and Emerging Questions

Scaling Data-Driven Building Energy Modelling using Large Language Models

A Survey of Sustainability in Large Language Models: Applications, Economics, and Challenges

Integration of LLMs and the Physical World: Research and Application

The Role of Large Language Models in Interdisciplinary Research: Opportunities, Challenges, and Ways Forward

Opportunities and Challenges of Large Language Models for Low-Resource Languages in Humanities Research

Evaluating Large Language Models: A Comprehensive Survey

Challenges and Contributing Factors in the Utilization of Large Language Models (LLMs)

Large Language Models (LLMs): Deployment, Tokenomics and Sustainability

Unlocking the potential: A comprehensive exploration of large language models in natural language processing

LLM-based Frameworks for Power Engineering from Routine to Novel Tasks

Unraveling the landscape of large language models: a systematic review and future perspectives

LLeMpower: Understanding Disparities in the Control and Access of Large Language Models

Challenges and Applications of Large Language Models

Large Language Models for Education: A Survey and Outlook

An Interdisciplinary Outlook on Large Language Models for Scientific Research