Abstract:Background: The integration of artificial intelligence (AI) into clinical practice is transforming both clinical practice and medical education. AI-based systems aim to improve the efficacy of clinical tasks, enhancing diagnostic accuracy and tailoring treatment delivery. As it becomes increasingly prevalent in health care for high-quality patient care, it is critical for health care providers to use the systems responsibly to mitigate bias, ensure effective outcomes, and provide safe clinical practices. In this study, the clinical task is the identification of heart failure (HF) prior to surgery with the intention of enhancing clinical decision-making skills. HF is a common and severe disease, but detection remains challenging due to its subtle manifestation, often concurrent with other medical conditions, and the absence of a simple and effective diagnostic test. While advanced HF algorithms have been developed, the use of these AI-based systems to enhance clinical decision-making in medical education remains understudied. Objective: This research protocol is to demonstrate our study design, systematic procedures for selecting surgical cases from electronic health records, and interventions. The primary objective of this study is to measure the effectiveness of interventions aimed at improving HF recognition before surgery, the second objective is to evaluate the impact of inaccurate AI recommendations, and the third objective is to explore the relationship between the inclination to accept AI recommendations and their accuracy. Methods: Our study used a 3 × 2 factorial design (intervention type × order of prepost sets) for this randomized trial with medical students. The student participants are asked to complete a 30-minute e-learning module that includes key information about the intervention and a 5-question quiz, and a 60-minute review of 20 surgical cases to determine the presence of HF. To mitigate selection bias in the pre- and posttests, we adopted a feature-based systematic sampling procedure. From a pool of 703 expert-reviewed surgical cases, 20 were selected based on features such as case complexity, model performance, and positive and negative labels. This study comprises three interventions: (1) a direct AI-based recommendation with a predicted HF score, (2) an indirect AI-based recommendation gauged through the area under the curve metric, and (3) an HF guideline-based intervention. Results: As of July 2023, 62 of the enrolled medical students have fulfilled this study's participation, including the completion of a short quiz and the review of 20 surgical cases. The subject enrollment commenced in August 2022 and will end in December 2023, with the goal of recruiting 75 medical students in years 3 and 4 with clinical experience. Conclusions: We demonstrated a study protocol for the randomized trial, measuring the effectiveness of interventions using AI and HF guidelines among medical students to enhance HF recognition in preoperative care with electronic health record data. International registered report identifier (irrid): DERR1-10.2196/49842.

Natural frequency tree- versus conditional probability formula-based training for medical students' estimation of screening test predictive values: a randomized controlled trial

Natural Frequencies Improve Public Understanding of Medical Test Results: An Experimental Study on Various Bayesian Inference Tasks with Multiple Scoring Methods and Non-Bayesian Reasoning Strategies

Study on the Application of Classification Tree Model in Screening the Risk Factors of Malignant Tumor

Bayesian Updating and Sequential Testing: Overcoming Inferential Limitations of Screening Tests

Using random forest for reliable classification and cost-sensitive learning for medical diagnosis

Comparative value of a simulation by gaming and a traditional teaching method to improve clinical reasoning skills necessary to detect patient deterioration: a randomized study in nursing students

Using Markov chain model to evaluate medical students' trajectory on progress tests and predict USMLE step 1 scores---a retrospective cohort study in one medical school

Early prediction of medical students' performance in high-stakes examinations using machine learning approaches

Training Needs Analysis for Medical Students in Assessing Cognitive Functioning: An Observational Study

Medical diagnostic accuracy measures: an innovative approach based on the area under predictive values curves

Game-based learning to improve diagnostic accuracy: a pilot randomized-controlled trial

Selection tests and their predictive value in university nursing students' success in the first year of study

Predicting speech discrimination scores from pure-tone thresholds—A machine learning-based approach using data from 12,697 subjects

Simulation-based training following a theoretical lecture enhances the performance of medical students in the interpretation and short-term retention of 20 cross-sectional transesophageal echocardiographic views: a prospective, randomized, controlled trial

Optimal timing of faculty teaching when combined with near-peer teaching: A mixed methods analysis

Applying AI and Guidelines to Assist Medical Students in Recognizing Patients With Heart Failure: Protocol for a Randomized Trial

Machine learning of treadmill exercise test to improve selection for testing for coronary artery disease

Test-enhanced learning in Neuroanesthesia for the First Year anesthetic residents: a randomized controlled trial

Latent tree models and diagnosis in traditional Chinese medicine

Semi-Parametric Sensitivity Analysis for Trials with Irregular and Informative Assessment Times

Team-based learning (TBL) curriculum combined with video vignettes improves performance of undergraduate medical students on OSCE compared with TBL alone