Abstract:IntroductionIn an effort to increase the rigor of evaluation in health professions education (HPE), a range of evaluation approaches are used. These largely focus on outcome evaluation as opposed to program evaluation. We aim to review and critique the use of outcome evaluation models, using the Kirkpatrick Model as an example given its wide acceptance and use, and advocate for the use of program evaluation models that help us understand how, and why outcomes are occurring. MethodsWe systematically searched OVID medline, Scopus, CINAHL and Pubmed, and hand searched six leading HPE journals to provide an overview of the use of the Kirkpatrick Model as well as a range of program evaluation models in HPE. In addition to this we synthesised the existing critiques of the Kirkpatrick Model as an example of outcome evaluation, to highlight the limitations of such models. ResultsThe use of the Kirkpatrick Model in HPE is widespread and increasing, however studies focus on categorising outcomes, rather than explaining how and why they occur. The main criticisms of the model are: it is outcomes focused and fails to consider factors that can impact training outcomes; it assumes positive casual linkages between the levels; there is an assumption that the higher-level outcomes are more important; and unintended impacts are not considered. The use of the Kirkpatrick Model by the MERSQI, BEME and WHO contribute to the myth that the Kirkpatrick Model is the gold standard for program evaluation. DiscussionMoving forward evaluations of HPE interventions must shift from focusing largely on measuring outcomes of interventions with little consideration for how and why these outcomes are occurring, to program evaluation that investigates what contributes to these outcomes. Other models that facilitate the evaluation of the complex processes that occur in HPE should be used instead of Kirkpatrick's.

Holton's Evaluation Model: New Evidence and Construct Elaborations

HR Model Construction and Performance Validations for the Private Company

Towards a comprehensive model of human resource development research and practice: A systematic literature review

Evaluation's role in enhancing organizational learning: A model for practice

A Meta-Analysis of the Effectiveness of Health Belief Model Variables in Predicting Behavior

Human resource management and organizational effectiveness: yesterday and today

Putting the Pieces Together: A Review of HR Differentiation Literature and a Multilevel Model

Evaluation in health professions education—Is measuring outcomes enough?

Do human resource systems indeed have "system" effects? The dual internal fit model of a high-performance work system

Impact of High-Performance Human Resource Practices, Self-Efficacy and Proactive Personality on Employee’s Job Performance: A Conceptual Model

A Critique of Kirkpatrick's Evaluation Model

A Performance Analysis Model for Corporate Human Resource Management Based on Extenics Theory

Performance Appraisal, Performance Management, and Firm-Level Performance: A Review, a Proposed Model, and New Directions for Future Research

The Building-Up and Improvement of Human Resource Mixed Employment Model

Deriving Challenges through Clarification of Areas to Strengthen the HR System

The job demands-resources model : state of the art

On the validity of the Vroom-Yetton model.

Human resource management: when research confronts theory

Using the Harvard HRM model to conceptualise the impact of changes to supervision upon HRM outcomes for different types of Australian public sector employees

Performance Management: A Model and Research Agenda

The human resource architecture model: A twenty-year review and future research directions