GPT-Based Models Meet Simulation: How to Efficiently Use Large-Scale Pre-Trained Language Models Across Simulation Tasks

Philippe J. Giabbanelli

2023-06-21

Abstract:The disruptive technology provided by large-scale pre-trained language models (LLMs) such as ChatGPT or GPT-4 has received significant attention in several application domains, often with an emphasis on high-level opportunities and concerns. This paper is the first examination regarding the use of LLMs for scientific simulations. We focus on four modeling and simulation tasks, each time assessing the expected benefits and limitations of LLMs while providing practical guidance for modelers regarding the steps involved. The first task is devoted to explaining the structure of a conceptual model to promote the engagement of participants in the modeling process. The second task focuses on summarizing simulation outputs, so that model users can identify a preferred scenario. The third task seeks to broaden accessibility to simulation platforms by conveying the insights of simulation visualizations via text. Finally, the last task evokes the possibility of explaining simulation errors and providing guidance to resolve them.

Human-Computer Interaction,Artificial Intelligence,Machine Learning

What problem does this paper attempt to address?

This paper attempts to explore the application potential of large - scale pre - trained language models (LLMs) in scientific simulation, especially how to efficiently use these models to complete specific modeling and simulation tasks. The paper analyzes four main tasks in detail:

1. **Explain the structure of the conceptual model**: Through natural language generation technology (NLG), complex conceptual models are explained in text form to participants to promote their understanding and participation in the models.

2. **Summarize simulation output**: Use NLG technology to summarize the results of the simulation to help model users quickly identify the optimal scenario plan.

3. **Convert simulation visualization to text**: In order to improve the accessibility of the simulation platform, especially for the visually impaired, convey the key information of simulation visualization by means of text description.

4. **Explain and solve simulation errors**: Use the capabilities of LLMs to explain the errors that occur during the simulation process and provide guidance and suggestions for solving these errors.

The main goal of the paper is to evaluate the potential advantages and limitations of LLMs in the above - mentioned tasks, and at the same time provide practical guidance for model developers, including how to prepare input data, select appropriate LLMs, and how to process the generated text, etc. In this way, the paper hopes to promote the wider application of LLMs in the field of modeling and simulation, especially in improving the transparency, participation and accessibility of the models.