Innovative Method to Digitize a Web-Based OSCE Evaluation System for Medical Students: A Cross-Sectional Study in University Hospital in Saudi Arabia
DOI: https://doi.org/10.2147/IJGM.S351052
IF: 2.145
2022-02-03
International Journal of General Medicine
Abstract:Abdullah A Yousef, 1, 2 Bassam H Awary, 1 Faisal O AlQurashi, 1 Waleed H Albuali, 1 Mohammad H Al-Qahtani, 1 Syed I Husain, 2 Omair Sharif 2 1 Department of Pediatrics, College of Medicine, Imam Abdulrahman Bin Faisal University, Dammam, Saudi Arabia; 2 Vice Deanship for e-learning, College of Medicine, Imam Abdulrahman Bin Faisal University, Dammam, Saudi Arabia Correspondence: Faisal O AlQurashi Department of Pediatrics, College of Medicine, Imam Abdulrahman Bin Faisal University, P.O Box: 11286, Dammam, 31453, Saudi Arabia , Tel +966555078804 , Fax +966138955088 , Email Purpose: The Objective Structured Clinical Examination (OSCE) is a standard academic assessment tool in the field of medical education. This study presents an innovative method for digitizing OSCE evaluation system for medical students and explores its efficacy compared to the traditional paper-based system, through the analysis of a User Satisfaction Survey. Methods: A cross-sectional, questionnaire-based study involving a User Satisfaction Survey to evaluate assessors' attitudes toward and acceptance of the Computerized Web-based OSCE Evaluation System (COES) was used. Fifth-year medical students at a College of Medicine were assessed clinically through their 2019 end-of-year OSCE examination by 30 examiners in five different OSCE stations. The traditional paper-based stations were converted into an online electronic version using QuestionPro software. Answers were filled in using smart tablets (iPads). QR codes were used for students' identification at each station to fully digitize the process and save time. After the completion of the exam, a User Satisfaction Survey was sent electronically to all examiners to evaluate their experiences with the new system. Results: The response rate for the survey was 100% with an internal consistency of 0.83. Almost all the examiners (29, 97%) were satisfied with the application of the COES. Further, 72% of the examiners indicated that the electronic system facilitated the evaluation of the students' skills, and 84% found using a smart device (iPad) was easier than using a paper form. All examiners expressed their preference for using the electronic system in the future. Conclusion: Users were satisfied with the utilization of the customized COES. This concept of fully digitizing the OSCE assessment process shortened the time needed for both the analysis of results and providing students with feedback. Further observational studies are needed to assess examiners' behaviors when using this methodology. Keywords: academic performance, clinical competency, clinical skills, medical education, undergraduate, Saudi Arabia The Objective Structured Clinical Examination (OSCE) is a standard academic assessment tool in the field of medical education. It is designed to evaluate practical and communicative skills among medical students. 1 Some of its advantages include building examinee confidence and evaluating their clinical sense in different settings. Among its disadvantages are the significant time expenditure incurred and possible individual documentation errors. In 1975, Haden et al introduced OSCE as a method to evaluate medical students' skills. 2 Since then, it has been used as a mode for assessing the skills and clinical competence of almost all healthcare practitioners. 3 It is a timed examination in which students move systematically through a set of stations that are pre-determined and evaluated by a qualified examiner, using well-structured marking criteria. 4 Historically, the concept of the OSCE examination has been subjected to numerous modifications throughout the years to better suit specific academic purposes. 5,6 In most well-known colleges of medicine worldwide, OSCE is the standard tool for the evaluation of competency, clinical skills, communication skills, psychomotor skills, cognitive knowledge, and attitude through oral examination, counseling, data interpretation, and history and physical examination stations. 7–10 The extent of the traditional clinical exam focused on the patient's history and a demonstration of physical examination skills, with a minimal assessment of technical skills. The traditional clinical exam is broadly unreliable and unjust in evaluating students' performance because of the wide range of variability concerning both the examiners and the selected patients. 11 "The luck of the draw" in the selection of examiner and patient plays a significant negative role in the outcome when using the traditional method. 12 Since the introduction of the concept of OSCE in 1975, researchers' find -Abstract Truncated-
medicine, general & internal