Abstract:An overview of the AI‐enabled software development process has been presented, represented as a concrete output of this systematic literature review (SLR) study. It offers a holistic view of development activities for software systems that include AI components. This process model is derived from 14 related validation studies that reported experiences in AI software development, particularly for ML components. It should be considered a first attempt to integrate a comprehensive overview process model. Context With the fast advancement of techniques in artificial intelligence (AI) and of the target infrastructures in the last decades, AI software is becoming an undeniable part of software system projects. As in most cases in history, however, development methods and guides follow the advancements in technology with phase differences. Purpose With an aim to elicit and integrate available evidence from AI software development practices into a process model, this study synthesizes the contributions of the validation studies reported in scientific literature. Method We applied a systematic literature review to retrieve, select, and analyze the primary studies. After a comprehensive and rigorous search and scoping review, we identified 82 studies that make various contributions in relation to AI software development practices. To increase the effectiveness of the synthesis and the usefulness of the outcome, for detailed analysis, we selected 14 primary studies (out of 82) that empirically validated their contributions. Results We carefully reviewed the selected studies that validate proposals on approaches/models, methods/techniques, tasks/phases, lessons learned/best practices, or workflows. We mapped the steps/activities in these proposals with the knowledge areas in SWEBOK, and using the evidence in this mapping and the primary studies, we synthesized a process model that integrates activities, artifacts, and roles for AI‐enabled software system development. Conclusion To the best of our knowledge, this is the first study that proposes such a process model by eliciting and gathering the contributions of the validation studies in a bottom‐up manner. We expect that the output of this synthesis will be input for further research to validate or improve the process model.

A validation methodology forai simulation models

Model Validation Via Uncertainty Propagation and Data Transformations

An Engineering-Effective Adaptive Model Algorithm Control (AMAC) and Simulation

A New Validation Metric for Models with Correlated Responses Using Limited Experimental and Simulation Data

A Contribution to Validating of Simulation Models in Production and Logistics

Systematic literature review of validation methods for AI systems

An empirical learning-based validation procedure for simulation workflow

The Validation of A Microscopic Simulation Model: A Methodological Case Study

A New Methodology For Simulation Validation And Model Modification

Quantitative model validation techniques: New insights

Structured validation of AI-based systems by virtual testing in simulated test scenarios

Method of calibrating and validating car-following model

A Survey on Failure Analysis and Fault Injection in AI Systems

Simulation Driven AI: From Artificial to Actual and Vice Versa

Validation of the development methodologies

A Process Model for AI‐Enabled Software Development: A Synthesis From Validation Studies in White Literature

A Systematic Map on Verifying and Validating Software Process Simulation Models.

A Nested Model for AI Design and Validation

A Family of Simulation Criteria to Guide DEVS Models Validation Rigorously, Systematically and Semi-Automatically

Simulation Validation Technology of the C 4 ISR System Based on Component-Oriented Development Platform