Abstract:A rising need for workers in science, technology, engineering and mathematics (STEM) fields has fueled interest in improving teaching within STEM disciplines. Numerous studies have demonstrated the benefits of active learning approaches on student learning outcomes. However, many of these studies have been conducted in experimental, rather than real-life class, settings. In addition, most of these studies have focused on in-class active learning exercises. This study tested the effects of answering questions outside of class on exam performance for General Biology students at the University of Minnesota. An online database of 1,020 multiple-choice questions covering material from the first half of the course was generated. Students in seven course sections (with an average of ∼265 students per section) were given unlimited access to the online study questions. These students made extensive use of the online questions, with students answering an average of 1,323 questions covering material from the half of the semester for which the questions were available. After students answered a set of questions, they were shown the correct answers for those questions. More specific feedback describing how to arrive at the correct answer was provided for the 73% of the questions for which the correct answers were not deemed to be self-explanatory. The extent to which access to the online study questions improved student learning outcomes was assessed by comparing the performance on exam questions of students in the seven course sections with access to the online study questions with the performance of students in course sections without access to the online study questions. Student performance was analyzed for a total of 89 different exams questions that were not included in the study questions, but that covered the same material covered by the study questions. Each of these 89 questions was used on one to five exams given to students in course sections that had access to the online study questions and on three to 77 exams given to students in sections that lacked such access. Data from over 1,800 students in sections with access to the online study questions show that those students scored a statistically significant average of 6.6% points higher on the exam questions analyzed than students in sections without access to the study questions. This difference was greater than the average amount necessary to raise students’ exam grades by one grade (e.g., from a “B-” to a “B”). In addition, there was a higher correlation between number of questions answered and success on exam questions on material related to the study questions than between number of questions answered and success on exam questions on material unrelated to the study questions. The online study question system required substantial effort to set up, but required minimal effort to maintain and was effective in significantly raising average exam scores for even very large course sections.

Revisiting Clickers: In-Class Questions Followed by At-Home Reflections Are Associated with Higher Student Performance on Related Exam Questions

Higher-Order Clicker Questions Engage Students and Prepare Them for Higher-Order Thinking Activities

Clickers in the Biology Classroom: Strategies for Writing and Effectively Implementing Clicker Questions That Maximize Student Learning

The Effects of Clickers With Different Teaching Strategies

A Campus-Wide Investigation of Clicker Implementation: The Status of Peer Discussion in STEM Classes

Evidence for teaching practice: The impact of clickers in a large classroom environment

Effectiveness of the use of clickers versus group discussion in learning by undergraduate medical students

Using Clickers to Address Common Errors and Misconceptions in Statistics

Peer Instruction: Comparing Clickers to Flashcards

Socratic Dialogs and Clicker use in an Upper-Division Mechanics Course

Using clickers to facilitate interactive engagement activities in a lecture room for improved performance by students

A comparative study: do “clickers” increase student engagement in multidisciplinary clinical microbiology teaching?

THE IMPACT OF THE USE OF CLICKER TOOLS IN ACADEMIC CLASSROOM ENVIRONMENTS

The impact of clickers instruction on cognitive loads and listening and speaking skills in college English class

Is Class Appreciation Just a Click Away?: Using Student Response System Technology to Enhance Shy Students' Introductory American Government Experience

Promoting an active form of learning out-of-class via answering online “study questions” leads to higher than expected exam scores in General Biology

An open-access clicker question bank for numerical analysis

Beyond Clickers, Next Generation Classroom Response Systems for Organic Chemistry

Using Prompts to Encourage Quiz Engagement: The Relationship Between Engagement Profiles and Course Success

Challenges in addressing student difficulties with time-development of two-state quantum systems using a multiple-choice question sequence in virtual and in-person classes

Click-level Learning Analytics in an Online Medical Education Learning Platform