Abstract:Context: Machine Learning (ML) has become widely adopted as a component in many modern software applications. Due to the large volumes of data available, organizations want to increasingly leverage their data to extract meaningful insights and enhance business profitability. ML components enable predictive capabilities, anomaly detection, recommendation, accurate image and text processing, and informed decision-making. However, developing systems with ML components is not trivial; it requires time, effort, knowledge, and expertise in ML, data processing, and software engineering. There have been several studies on the use of model-driven engineering (MDE) techniques to address these challenges when developing traditional software and cyber–physical systems. Recently, there has been a growing interest in applying MDE for systems with ML components. Objective: The goal of this study is to further explore the promising intersection of MDE with ML (MDE4ML) through a systematic literature review (SLR). Through this SLR, we wanted to analyze existing studies, including their motivations, MDE solutions, evaluation techniques, key benefits and limitations. Method: Our SLR is conducted following the well-established guidelines by Kitchenham. We started by devising a protocol and systematically searching seven databases, which resulted in 3934 papers. After iterative filtering, we selected 46 highly relevant primary studies for data extraction, synthesis, and reporting. Results: We analyzed selected studies with respect to several areas of interest and identified the following: (1) the key motivations behind using MDE4ML; (2) a variety of MDE solutions applied, such as modeling languages, model transformations, tool support, targeted ML aspects, contributions and more; (3) the evaluation techniques and metrics used; and (4) the limitations and directions for future work. We also discuss the gaps in existing literature and provide recommendations for future research. Conclusion: This SLR highlights current trends, gaps and future research directions in the field of MDE4ML, benefiting both researchers and practitioners.

An assisted literature review using machine learning models to identify and build a literature corpus

LLAssist: Simple Tools for Automating Literature Review Using Large Language Models

An automated domain-independent text reading, interpreting and extracting approach for reviewing the scientific literature

Cutting Through the Clutter: The Potential of LLMs for Efficient Filtration in Systematic Literature Reviews

Evaluation of a prototype machine learning tool to semi-automate data extraction for systematic literature reviews

A Machine Learning Approach for Semi-Automated Search and Selection in Literature Studies

A Literature Review of Literature Reviews in Pattern Analysis and Machine Intelligence

LitLLM: A Toolkit for Scientific Literature Review

Artificial intelligence for literature reviews: opportunities and challenges

Automated Literature Review Using NLP Techniques and LLM-Based Retrieval-Augmented Generation

A Hybrid Semi-Automated Workflow for Systematic and Literature Review Processes with Large Language Model Analysis

Title and abstract screening for literature reviews using large language models: an exploratory study in the biomedical domain

Automating Systematic Literature Reviews with Natural Language Processing and Text Mining: a Systematic Literature Review

A systematic literature review on Machine Learning Model evaluation on healthcare applications

The emergence of Large Language Models (LLM) as a tool in literature reviews: an LLM automated systematic review

Model-driven Engineering for Machine Learning Components: A Systematic Literature Review

A Systematic Literature Review on the Use of Machine Learning in Software Engineering

vitaLITy 2: Reviewing Academic Literature Using Large Language Models

Literature review: Machine learning techniques applied to financial market prediction

Model driven engineering for machine learning components: A systematic literature review