Representative Real-Time Dataset Generation Based on Automated Fault Injection and HIL Simulation for ML-Assisted Validation of Automotive Software Systems

Mohammad Abboush,Christoph Knieke,Andreas Rausch
DOI: https://doi.org/10.3390/electronics13020437
IF: 2.9
2024-01-21
Electronics
Abstract:Recently, a data-driven approach has been widely used at various stages of the system development lifecycle thanks to its ability to extract knowledge from historical data. However, despite its superiority over other conventional approaches, e.g., approaches that are model-based and signal-based, the availability of representative datasets poses a major challenge. Therefore, for various engineering applications, new solutions to generate representative faulty data that reflect the real world operating conditions should be explored. In this study, a novel approach based on a hardware-in-the-loop (HIL) simulation and automated real-time fault injection (FI) method is proposed to generate, analyse and collect data samples in the presence of single and concurrent faults. The generated dataset is employed for the development of machine learning (ML)-assisted test strategies during the system verification and validation phases of the V-cycle development model. The developed framework can generate not only time series data but also a textual data including fault logs in an automated manner. As a case study, a high-fidelity simulation model of a gasoline engine system with a dynamic entire vehicle model is utilised to demonstrate the capabilities and benefits of the proposed framework. The results reveal the applicability of the proposed framework in simulating and capturing the system behaviour in the presence of faults occurring within the system's components. Furthermore, the effectiveness of the proposed framework in analysing system behaviour and acquiring data during the validation phase of real-time systems under realistic operating conditions has been demonstrated.
engineering, electrical & electronic,computer science, information systems,physics, applied
What problem does this paper attempt to address?
The problem that this paper attempts to solve is the lack of representative fault data sets that can reflect real - working conditions in the development process of automotive software systems. Specifically, as the functions of modern automotive software systems become increasingly complex, testing and validating these systems face significant challenges. Due to the expansion of the system architecture, which includes hundreds of electronic control units (ECUs) and is connected through multiple system buses, the probability of faults occurring is very high. To ensure the safety and reliability of these systems, it is necessary to meet the requirements of the functional safety standard ISO 26262. However, obtaining high - quality data sets that can cover single and concurrent faults is a major problem. In addition, dynamic changes in the real - time environment and meeting real - time requirements are also complex factors in applying data - driven methods for real - time system validation. To solve these problems, the author proposes a method based on hardware - in - the - loop (HIL) simulation and automatic real - time fault injection (FI) for generating, analyzing, and collecting data samples in the presence of single and concurrent faults. The generated data sets are used to develop machine - learning (ML) - assisted test strategies in the system verification and validation stages of the V - model development process. This framework can not only generate time - series data but also automatically generate text data including fault logs. Through a high - fidelity simulation model of a gasoline engine system as a case study, the capabilities and advantages of this framework are demonstrated. The research shows that the proposed framework is applicable in simulating and capturing the behavior when faults occur in system components, and is also effective in analyzing system behavior and obtaining data of real - time systems under real - world operating conditions.