Abstract:Abdullah A Yousef, 1, 2 Bassam H Awary, 1 Faisal O AlQurashi, 1 Waleed H Albuali, 1 Mohammad H Al-Qahtani, 1 Syed I Husain, 2 Omair Sharif 2 1 Department of Pediatrics, College of Medicine, Imam Abdulrahman Bin Faisal University, Dammam, Saudi Arabia; 2 Vice Deanship for e-learning, College of Medicine, Imam Abdulrahman Bin Faisal University, Dammam, Saudi Arabia Correspondence: Faisal O AlQurashi Department of Pediatrics, College of Medicine, Imam Abdulrahman Bin Faisal University, P.O Box: 11286, Dammam, 31453, Saudi Arabia , Tel +966555078804 , Fax +966138955088 , Email Purpose: The Objective Structured Clinical Examination (OSCE) is a standard academic assessment tool in the field of medical education. This study presents an innovative method for digitizing OSCE evaluation system for medical students and explores its efficacy compared to the traditional paper-based system, through the analysis of a User Satisfaction Survey. Methods: A cross-sectional, questionnaire-based study involving a User Satisfaction Survey to evaluate assessors' attitudes toward and acceptance of the Computerized Web-based OSCE Evaluation System (COES) was used. Fifth-year medical students at a College of Medicine were assessed clinically through their 2019 end-of-year OSCE examination by 30 examiners in five different OSCE stations. The traditional paper-based stations were converted into an online electronic version using QuestionPro software. Answers were filled in using smart tablets (iPads). QR codes were used for students' identification at each station to fully digitize the process and save time. After the completion of the exam, a User Satisfaction Survey was sent electronically to all examiners to evaluate their experiences with the new system. Results: The response rate for the survey was 100% with an internal consistency of 0.83. Almost all the examiners (29, 97%) were satisfied with the application of the COES. Further, 72% of the examiners indicated that the electronic system facilitated the evaluation of the students' skills, and 84% found using a smart device (iPad) was easier than using a paper form. All examiners expressed their preference for using the electronic system in the future. Conclusion: Users were satisfied with the utilization of the customized COES. This concept of fully digitizing the OSCE assessment process shortened the time needed for both the analysis of results and providing students with feedback. Further observational studies are needed to assess examiners' behaviors when using this methodology. Keywords: academic performance, clinical competency, clinical skills, medical education, undergraduate, Saudi Arabia The Objective Structured Clinical Examination (OSCE) is a standard academic assessment tool in the field of medical education. It is designed to evaluate practical and communicative skills among medical students. 1 Some of its advantages include building examinee confidence and evaluating their clinical sense in different settings. Among its disadvantages are the significant time expenditure incurred and possible individual documentation errors. In 1975, Haden et al introduced OSCE as a method to evaluate medical students' skills. 2 Since then, it has been used as a mode for assessing the skills and clinical competence of almost all healthcare practitioners. 3 It is a timed examination in which students move systematically through a set of stations that are pre-determined and evaluated by a qualified examiner, using well-structured marking criteria. 4 Historically, the concept of the OSCE examination has been subjected to numerous modifications throughout the years to better suit specific academic purposes. 5,6 In most well-known colleges of medicine worldwide, OSCE is the standard tool for the evaluation of competency, clinical skills, communication skills, psychomotor skills, cognitive knowledge, and attitude through oral examination, counseling, data interpretation, and history and physical examination stations. 7–10 The extent of the traditional clinical exam focused on the patient's history and a demonstration of physical examination skills, with a minimal assessment of technical skills. The traditional clinical exam is broadly unreliable and unjust in evaluating students' performance because of the wide range of variability concerning both the examiners and the selected patients. 11 "The luck of the draw" in the selection of examiner and patient plays a significant negative role in the outcome when using the traditional method. 12 Since the introduction of the concept of OSCE in 1975, researchers' find -Abstract Truncated-

Assessment of medical communication skills by computer: assessment method and student experiences

Assessing Communication Skills of Medical Students in Objective Structured Clinical Examinations (OSCE) - A Systematic Review of Rating Scales

Assessment of medical students’ integrated clinical communication skills: development of a tailor-made assessment tool

Developing an Institution-Based Assessment of Resident Communication and Interpersonal Skills

Assessment of Clinical Communication Skills of Medical Students Through the Simulated Patient Approach

Summative assessment of undergraduates' communication competence in challenging doctor-patient encounters. Evaluation of the Düsseldorf CoMeD-OSCE

Testing a Communication Assessment Tool for Ethically Sensitive Scenarios: Protocol of a Validation Study

Investigating a self-scoring interview simulation for learning and assessment in the medical consultation

Testing the validity of three acute care assessment tools for assessing residents’ performance during in situ simulation: the ACAT-SimSit study

Performance-based assessment of students’ communication skills

Cross-Cultural Adaptation of the Communication Assessment Tool for Use in a Simulated Clinical Setting

Assessment of Attitude of First Year Medical Undergraduate Students Towards Communication Skills Training: A Cross-sectional Study

A report on the piloting of a novel computer-based medical case simulation for teaching and formative assessment of diagnostic laboratory testing

Digitizing Scoring Systems With Extended Online Feedback: A Novel Approach to Interactive Teaching and Learning in Formative OSCE

Assessing how students value learning communication skills in an undergraduate anatomy and physiology course

Development of an assessment tool to measure communication skills among family medicine residents in the context of electronic medical record use

Communication training for pharmacy students with standard patients using artificial intelligence

Validated checklist for assessing communication skills in undergraduate medical students: bridging the gap for effective doctor-patient interactions

Development of an instrument to measure medical students' perceptions of the assessment environment: initial validation

Comparison between MCQ, Extended matching questions (EMQ) and Script concordance test (SCT) for assessment among first-year medical students - A pilot study

Innovative Method to Digitize a Web-Based OSCE Evaluation System for Medical Students: A Cross-Sectional Study in University Hospital in Saudi Arabia