Abstract:The rapid development of Large Language Models (LLMs) and Generative Pre-Trained Transformers(GPTs) in the field of Generative Artificial Intelligence (AI) can significantly impact task automation in themodern economy. We anticipate that the PRA field will inevitably be affected by this technology. Thus, themain goal of this paper is to engage the risk assessment community into a discussion of benefits anddrawbacks of this technology for PRA. We make a preliminary analysis of possible application of LLM inProbabilistic Risk Assessment (PRA) modeling context referring to the ongoing experience in softwareengineering field. We explore potential application scenarios and the necessary conditions for controlledLLM usage in PRA modeling (whether static or dynamic). Additionally, we consider the potential impact ofthis technology on PRA modeling tools.

What problem does this paper attempt to address?

The problem that this paper attempts to solve is to explore the impact of generative artificial intelligence (especially large language models, LLM, and Generative Pretrained Transformer, GPT) on probabilistic risk assessment (PRA) modeling and maintenance. Specifically, the paper focuses on the following points: 1. **Technical Impact and Application**: Analyze the potential application scenarios of generative AI in PRA modeling, including static (Boolean - logic - based event trees and fault trees) and dynamic reliability modeling. For example, generative AI can be used to automatically generate fault trees, interpret existing models, and review model consistency, etc. 2. **Verification and Quality Control**: Emphasize that when using generative AI in PRA modeling, automatic verification methods and tools must be developed to ensure the correctness and reliability of the generated content. This includes grammar and semantic verification, and these verification methods are more important especially in dynamic models. 3. **Tools and Formats**: Discuss two options that PRA software developers may face: adopting an open exchange format to share the cost of generative AI solutions, or retaining a proprietary format and customizing existing AI solutions. 4. **Challenges and Future Directions**: Identify and discuss the challenges faced in introducing generative AI in the PRA field, such as issues in data security, economic benefits, organizational adjustment, regulatory policies, and knowledge management. Through these discussions, the paper aims to prompt the risk assessment community to think about how to utilize the advantages of generative AI while dealing with possible technological and social challenges. The following is a summary of the core questions in the paper: - **How can generative AI be applied to different stages of PRA modeling?** - **When using generative AI in PRA modeling, how can the correctness and reliability of the generated content be ensured?** - **How should PRA software developers respond to the tool and format changes brought about by generative AI?** - **What are the main challenges faced by the PRA field when introducing generative AI?** The answers to these questions are of great significance for promoting technological innovation and practical improvement in the PRA field.

Impact of Generative AI (Large Language Models) on the PRA model construction and maintenance, observations

Transforming Assessment: The Impacts and Implications of Large Language Models and Generative AI

On the application of Large Language Models for language teaching and assessment technology

Beyond Words: On Large Language Models Actionability in Mission-Critical Risk Analysis

Risk Assessment of Large Language Models Beyond Apocalyptic Visions

What executives need to know about knowledge management, large language models and generative AI

On the assessment of generative AI in modeling tasks: an experience report with ChatGPT and UML

GPTs are GPTs: An Early Look at the Labor Market Impact Potential of Large Language Models

ExploreGen: Large Language Models for Envisioning the Uses and Risks of AI Technologies

How good are large language models at product risk assessment?

Perils and opportunities in using large language models in psychological research

AI Safety in Generative AI Large Language Models: A Survey

Generative artificial intelligence and large language models for digital banking: First outlook and perspectives

Cutting Through the Confusion and Hype: Understanding the True Potential of Generative AI

Generative AI in the Era of Transformers: Revolutionizing Natural Language Processing with LLMs

Large Language Models as Subpopulation Representative Models: A Review

Large Language Models and Generative AI in Finance: An Analysis of ChatGPT, Bard, and Bing AI

Generative AI: Overview, Economic Impact, and Applications in Asset Management

Large language models (LLMs): survey, technical frameworks, and future challenges

Ethical Considerations and Policy Implications for Large Language Models: Guiding Responsible Development and Deployment