Abstract:PROBLEM: Multiple-choice questions (MCQs) are the main method of assessing medical student knowledge. As a result there is a high demand from medical students for formative MCQs. However, teaching staff rarely have the time or incentive to develop high-quality formative questions, focusing instead on material for high-stakes assessments.INTERVENTION: We have developed a novel student-led approach involving an interactive online question database, created by medical students for medical students. We adopted a staged approach to create an online bank of formative MCQ questions. First, students write MCQs following a standardized format. Questions are then peer-reviewed by other students, discussing relevant clinical topics, guidelines, and journals to improve question quality. The questions are then scrutinized by specialist doctors and academics. Next, questions are piloted online. Finally, question performance is evaluated statistically. This 5-stage student-led process produced a bank of more than 200 MCQs in three months.CONTEXT: This intervention was carried out by two final-year medical student leads at Cardiff University School of Medicine, UK. Final-year students were recruited to write and peer-review questions, and senior content specialists were recruited from the department. After piloting and evaluation of the questions, the question bank was made available as a learning resource to all medical students at Cardiff University.OUTCOME: Objective analysis of the created MCQs (discrimination indices and distractor analysis) indicated that the random sample of questions piloted were of high quality. When the questions were made available as online tests to approximately 600 students, usage data revealed that 2,800 tests were taken over a 3-month period, indicating that the resource was popular. In addition, subjective feedback from students question writers/reviewers was gathered via free text feedback forms and was invariably positive. We plan to continue the question generation process in Cardiff and would encourage other medical schools to adopt this approach.LESSONS LEARNED: Our 5-stage approach can generate a large volume of high-quality MCQs, addressing the demand from students for formative MCQ questions, with minimal teaching staff input. The project's benefits go beyond the creation of the resource, as involving students in the writing, review, and presentation of questions itself is useful pedagogically.

Student-generated reading questions: diagnosing student thinking with diverse formative assessments

Connecting Activity Implementation Characteristics to Student Buy-In Toward and Utilization of Formative Assessments Within Undergraduate Biology Courses

Getting at Student Understanding - the Key to Teachers’ Use of Test Data

Student Use and Perceptions of Embedded Formative Assessments in a Basic Science Veterinary Program

Imagining, designing, and interpreting experiments: Using quantitative assessment to improve instruction in scientific reasoning

On the Development of a Computer-Based Tool for Formative Student Assessment: Epistemological, Methodological, and Practical Issues

Improving large class performance and engagement through student-generated question banks

Lessons from a Large-Scale Assessment: Results from Free Response Pre- and Post-testing in Electricity and Magnetism

Engaging the control-value theory: a new era of student response systems and formative assessment to improve student achievement

Development of embedded assessments for learning in biotechnology: Results and design process for dissemination

A Novel Student-Led Approach to Multiple-Choice Question Generation and Online Database Creation, With Targeted Clinician Input

Low-Stakes, Growth-Oriented Testing in Large-Enrollment General Chemistry 1: Formulation, Implementation, and Statistical Analysis

ASK-IT/A2L: Assessing student knowlede with instructional technology

Use of a competency framework to explore the benefits of student-generated multiple-choice questions (MCQs) on student engagement

Using graph-based assessments within socratic tutorials to reveal and refine students' analytical thinking about molecular networks

Assessing student reasoning in upper-division electricity and magnetism at Oregon State University

Active Learning in Flipped Life Science Courses Promotes Development of Critical Thinking Skills

Fostering Critical Thinking Skills in a Master's‐Level Course via in‐Depth Analysis of Primary Literature

Let's Ask Students About Their Programs, Automatically

Adapting Undergraduate Biology to Include Science Practices by Teaching Students to Generate Scientific Explanations