Abstract:Context: Machine Learning (ML) has become widely adopted as a component in many modern software applications. Due to the large volumes of data available, organizations want to increasingly leverage their data to extract meaningful insights and enhance business profitability. ML components enable predictive capabilities, anomaly detection, recommendation, accurate image and text processing, and informed decision-making. However, developing systems with ML components is not trivial; it requires time, effort, knowledge, and expertise in ML, data processing, and software engineering. There have been several studies on the use of model-driven engineering (MDE) techniques to address these challenges when developing traditional software and cyber–physical systems. Recently, there has been a growing interest in applying MDE for systems with ML components. Objective: The goal of this study is to further explore the promising intersection of MDE with ML (MDE4ML) through a systematic literature review (SLR). Through this SLR, we wanted to analyze existing studies, including their motivations, MDE solutions, evaluation techniques, key benefits and limitations. Method: Our SLR is conducted following the well-established guidelines by Kitchenham. We started by devising a protocol and systematically searching seven databases, which resulted in 3934 papers. After iterative filtering, we selected 46 highly relevant primary studies for data extraction, synthesis, and reporting. Results: We analyzed selected studies with respect to several areas of interest and identified the following: (1) the key motivations behind using MDE4ML; (2) a variety of MDE solutions applied, such as modeling languages, model transformations, tool support, targeted ML aspects, contributions and more; (3) the evaluation techniques and metrics used; and (4) the limitations and directions for future work. We also discuss the gaps in existing literature and provide recommendations for future research. Conclusion: This SLR highlights current trends, gaps and future research directions in the field of MDE4ML, benefiting both researchers and practitioners.

RM4ML: requirements model for machine learning-enabled software systems

Model-driven Engineering for Machine Learning Components: A Systematic Literature Review

Machine Learning with Requirements: a Manifesto

Model driven engineering for machine learning components: A systematic literature review

Requirements-driven Test Generation for Autonomous Vehicles with Machine Learning Components

Understanding the Complexity and Its Impact on Testing in ML-Enabled Systems

Requirements Engineering for Machine Learning: A Review and Reflection

Classification, Challenges, and Automated Approaches to Handle Non-Functional Requirements in ML-Enabled Systems: A Systematic Literature Review

Model-Driven Engineering Method to Support the Formalization of Machine Learning using SysML

MLTEing Models: Negotiating, Evaluating, and Documenting Model and System Qualities

Reliability Assessment and Safety Arguments for Machine Learning Components in System Assurance

Non-functional Requirements for Machine Learning: Understanding Current Use and Challenges in Industry

Towards a safe MLOps Process for the Continuous Development and Safety Assurance of ML-based Systems in the Railway Domain

An Exploratory Study of V-Model in Building ML-Enabled Software: A Systems Engineering Perspective

RMF: A Risk Measurement Framework for Machine Learning Models

Requirements and software engineering for automotive perception systems: an interview study

A Framework to Model ML Engineering Processes

Characterizing machine learning process: A maturity framework

A Catalogue of Concerns for Specifying Machine Learning-Enabled Systems

ML-On-Rails: Safeguarding Machine Learning Models in Software Systems A Case Study

Technology Readiness Levels for Machine Learning Systems