Abstract:Cyber-physical systems (CPSs) integrate cyber and physical components and enable them to interact with each other to meet user needs. The needs for CPSs span rich application domains such as healthcare and medicine, smart home, smart building, etc. This indicates that CPSs are all about solving real-world problems. With the increasing abundance of sensing devices and effectors, the problems wanted to solve with CPSs are becoming more and more complex. It is also becoming increasingly difficult to extract and express CPS requirements accurately. Problem frame approach aims to shape real-world problems by capturing the characteristics and interconnections of components, where the problem diagram is central to expressing the requirements. CPSs requirements are generally presented in domain-specific documents that are normally expressed in natural language. There is currently no effective way to extract problem diagrams from natural language documents. CPSs requirements extraction and modeling are generally done manually, which is time-consuming, labor-intensive, and error-prone. Large language models (LLMs) have shown excellent performance in natural language understanding. It can be interesting to explore the abilities of LLMs to understand domain-specific documents and identify modeling elements, which this paper is working on. To achieve this goal, we first formulate two tasks (i.e., entity recognition and interaction extraction) and propose a benchmark called CPSBench. Based on this benchmark, extensive experiments are conducted to evaluate the abilities and limitations of seven advanced LLMs. We find some interesting insights. Finally, we establish a taxonomy of LLMs hallucinations in CPSs requirements modeling using problem diagrams. These results will inspire research on the use of LLMs for automated CPSs requirements modeling.

The Ten Lockheed Martin Cyber-Physical Challenges: Formalized, Analyzed, and Explained

An Evaluation of Requirements Modeling for Cyber-Physical Systems via LLMs

Deriving Cyber-security Requirements for Cyber Physical Systems

Analyzing Early Requirements of Cyber-physical Systems Through Structure and Goal Modeling

Testing learning-enabled cyber-physical systems with Large-Language Models: A Formal Approach

Modelling and Analysing Resilient Cyber-Physical Systems

Constructing Cyber-Physical System Testing Suites Using Active Sensor Fuzzing

Stress Testing Control Loops in Cyber-Physical Systems

CPS Engineering: Gap Analysis and Perspectives

CPSim: Simulation Toolbox for Security Problems in Cyber-Physical Systems

Simulation Based Formal Verification of Cyber-Physical Systems

Towards formally analyzed Cyber-Physical Systems

Transforming Timing Requirements into CCSL Constraints to Verify Cyber-Physical Systems.

Coupled Requirements-driven Testing of CPS: From Simulation To Reality

Model-based Construction and Verification of Cyber-Physical Systems.

Resilient Cyberphysical Systems and their Application Drivers: A Technology Roadmap

Automatic Failure Explanation in CPS Models

Composition Challenges and Approaches for Cyber Physical Systems.

Analyzing Software Requirements for Cyber Physical Systems

Threat Modeling of Cyber-Physical Systems in Practice

Cyber-Physical Energy Systems Security: Threat Modeling, Risk Assessment, Resources, Metrics, and Case Studies