Abstract:Objective: To identify processes to engage stakeholders in healthcare Simulation Modeling (SM), and the impacts of this engagement on model design, model implementation, and stakeholder participants. To investigate how engagement process may lead to specific impacts. Data Sources: English-language articles on health SM engaging stakeholders in the MEDLINE, EMBASE, Scopus, Web of Science and Business Source Complete databases published from inception to February 2020. Study Design: A systematic review of the literature based on a priori protocol and reported according to PRISMA guidelines. Extraction Methods: Eligible articles were SM studies with a health outcome which engaged stakeholders in model design. Data were extracted using a data extraction form adapted to be specific for stakeholder engagement in SM studies. Data were analyzed using summary statistics, deductive and inductive content analysis, and narrative synthesis. Principal Findings: Thirty-two articles met inclusion criteria. Processes used to engage stakeholders in healthcare SM are heterogenous and often based on intuition rather than clear methodological frameworks. These processes most commonly involve stakeholders across multiple SM stages via discussion/dialogue, interviews, workshops and meetings. Key reported impacts of stakeholder engagement included improved model quality/accuracy, implementation, and stakeholder decision-making. However, for all but four studies, these reports represented author perceptions rather than formal evaluations incorporating stakeholder perspectives. Possible process enablers of impact included the use of models as "boundary objects" and structured facilitation via storytelling to promote effective communication and mutual understanding between stakeholders and modelers. Conclusions: There is a large gap in the current literature of formal evaluation of SM stakeholder engagement, and a lack of consensus about the processes required for effective SM stakeholder engagement. The adoption and clear reporting of structured engagement and process evaluation methodologies/frameworks are required to advance the field and produce evidence of impact.

A systematic literature review into simulation for building operations management theory: reaching beyond positivism?

Software Process Simulation Modeling: An Extended Systematic Review

Discrete simulation-based optimization methods for industrial engineering problems: A systematic literature review

Metamodel-based simulation optimization: A systematic literature review

Simulation modelling is 50! Do we need a reality check?

Simulation for manufacturing system design and operation: Literature review and analysis

Simulation optimization: A comprehensive review on theory and applications

Simulation modelling of hospital outpatient Department: a review of the literature and bibliometric analysis

Online Simulation at Machine Level: A Systematic Review

Reflections On 10 Years Of Software Process Simulation Modeling: A Systematic Review

Constructing International Relations Simulations: Examining the Pedagogy of IR Simulations Through a Constructivist Learning Theory Lens

Software Process Simulation Modeling: Facts, Trends and Directions

A review of the design and development processes of simulation for training in healthcare - A technology-centered versus a human-centered perspective

Conducting systematic literature review in operations management

Harnessing the power of simulation in the project management / decision support aspects of the construction industry

Engaging Healthcare Staff and Stakeholders in Healthcare Simulation Modeling to Better Translate Research Into Health Impact: A Systematic Review

Decision support in productive processes through DES and ABS in the Digital Twin era: a systematic literature review

Software Process Simulation Modeling: Preliminary Results from an Updated Systematic Review.

Simulation Methods and Digital Strategies for Supply Chains Facing Disruptions: Insights from a Systematic Literature Review