Abstract:Context: Machine Learning (ML) has become widely adopted as a component in many modern software applications. Due to the large volumes of data available, organizations want to increasingly leverage their data to extract meaningful insights and enhance business profitability. ML components enable predictive capabilities, anomaly detection, recommendation, accurate image and text processing, and informed decision-making. However, developing systems with ML components is not trivial; it requires time, effort, knowledge, and expertise in ML, data processing, and software engineering. There have been several studies on the use of model-driven engineering (MDE) techniques to address these challenges when developing traditional software and cyber–physical systems. Recently, there has been a growing interest in applying MDE for systems with ML components. Objective: The goal of this study is to further explore the promising intersection of MDE with ML (MDE4ML) through a systematic literature review (SLR). Through this SLR, we wanted to analyze existing studies, including their motivations, MDE solutions, evaluation techniques, key benefits and limitations. Method: Our SLR is conducted following the well-established guidelines by Kitchenham. We started by devising a protocol and systematically searching seven databases, which resulted in 3934 papers. After iterative filtering, we selected 46 highly relevant primary studies for data extraction, synthesis, and reporting. Results: We analyzed selected studies with respect to several areas of interest and identified the following: (1) the key motivations behind using MDE4ML; (2) a variety of MDE solutions applied, such as modeling languages, model transformations, tool support, targeted ML aspects, contributions and more; (3) the evaluation techniques and metrics used; and (4) the limitations and directions for future work. We also discuss the gaps in existing literature and provide recommendations for future research. Conclusion: This SLR highlights current trends, gaps and future research directions in the field of MDE4ML, benefiting both researchers and practitioners.

Classification, Challenges, and Automated Approaches to Handle Non-Functional Requirements in ML-Enabled Systems: A Systematic Literature Review

Non-functional requirements for machine learning: understanding current use and challenges among practitioners

Maintainability Challenges in ML: A Systematic Literature Review

Requirement Formalisation using Natural Language Processing and Machine Learning: A Systematic Review

Non-functional Requirements for Machine Learning: Understanding Current Use and Challenges in Industry

Status Quo and Problems of Requirements Engineering for Machine Learning: Results from an International Survey

A Catalogue of Concerns for Specifying Machine Learning-Enabled Systems

How to certify machine learning based safety-critical systems? A systematic literature review

A software engineering perspective on engineering machine learning systems: State of the art and challenges

A Systematic Literature Review on the Use of Machine Learning in Software Engineering

Model driven engineering for machine learning components: A systematic literature review

Machine Learning with Requirements: a Manifesto

The application of AI techniques in requirements classification: a systematic mapping

Model-driven Engineering for Machine Learning Components: A Systematic Literature Review

Systematic Literature Review on Application of Learning-based Approaches in Continuous Integration

RM4ML: requirements model for machine learning-enabled software systems

A Systematic Literature Review of Empirical Research on Quality Requirements

A Multivocal Literature Review on the Benefits and Limitations of Automated Machine Learning Tools

Machine/Deep Learning for Software Engineering: A Systematic Literature Review

Software engineering for artificial intelligence and machine learning software: A systematic literature review

Preliminary Systematic Literature Review of Machine Learning System Development Process