Abstract:IntroductionIn an effort to increase the rigor of evaluation in health professions education (HPE), a range of evaluation approaches are used. These largely focus on outcome evaluation as opposed to program evaluation. We aim to review and critique the use of outcome evaluation models, using the Kirkpatrick Model as an example given its wide acceptance and use, and advocate for the use of program evaluation models that help us understand how, and why outcomes are occurring. MethodsWe systematically searched OVID medline, Scopus, CINAHL and Pubmed, and hand searched six leading HPE journals to provide an overview of the use of the Kirkpatrick Model as well as a range of program evaluation models in HPE. In addition to this we synthesised the existing critiques of the Kirkpatrick Model as an example of outcome evaluation, to highlight the limitations of such models. ResultsThe use of the Kirkpatrick Model in HPE is widespread and increasing, however studies focus on categorising outcomes, rather than explaining how and why they occur. The main criticisms of the model are: it is outcomes focused and fails to consider factors that can impact training outcomes; it assumes positive casual linkages between the levels; there is an assumption that the higher-level outcomes are more important; and unintended impacts are not considered. The use of the Kirkpatrick Model by the MERSQI, BEME and WHO contribute to the myth that the Kirkpatrick Model is the gold standard for program evaluation. DiscussionMoving forward evaluations of HPE interventions must shift from focusing largely on measuring outcomes of interventions with little consideration for how and why these outcomes are occurring, to program evaluation that investigates what contributes to these outcomes. Other models that facilitate the evaluation of the complex processes that occur in HPE should be used instead of Kirkpatrick's.

Duck Soup and Library Outcome Evaluation

Evaluating a Public Library Makerspace

Review on the Concept,Model,Development History and Methods of Library Evaluation

Assessing an Academic Library Liaison Programme

Program evaluation in rehabilitation

Why Equal Opportunity/Affirmative Action in Libraries63;

Evaluation in health professions education—Is measuring outcomes enough?

The Connections Matter: Bi-Directional Learning in Program Evaluation and Practice-Oriented Research

160: BEING EVIDENCE BASED: A HEALTH LIBRARY PERSPECTIVE

Are Library Science Programs Preparing New Librarians? Creating a Sustainable and Vibrant Librarian Community

Policy implementation and outcome evaluation: establishing a framework and expanding capacity for advocacy organizations to assess the impact of their work in public policy

Review of Foreign Researches on the Value of Library Based on Return on Investment

Research and Practice of the Evaluation of Mutual Teaching Resource Library Based on Using Effects

Looking for impact in all the wrong places: Setting realistic expectations and measurable outcomes for small-scale community building initiatives

Teaching program evaluation: How blending theory and practice enhance student-evaluator competencies in an education policy graduate program

Putting Program Theory into Operation

The Role of Evaluation in Research—Practice Integration Working Toward the ‘‘Golden Spike’’

Examining the "Culture of Assessment" in Public Libraries

Achieving Better Educational Practices Through Research Evidence: A Critical Analysis and Case Illustration of Benefits and Challenges

Apuntes relevantes sobre la evaluación en la alfabetización informacional

The Impact of Classroom Evaluation Practices on Students