Abstract:Scientific education provides a set of tools to make sense of a complex world by teasing out complicated cause-and-effect relationships, such as the elimination of effects of confounding factors in controlled experiments. There is evidence that depth of understanding of controlled experiments is lacking among undergraduate science students despite exposure to controlled experiments in courses. To examine the understanding of controlled experiments, we developed a two-tiered assessment that includes closed-ended and open-ended questions, with three types of questions, i.e., (i) a scientific scenario about a flawed drug study, (ii) an everyday-life scenario about flawed thinking regarding product effectiveness, and (iii) a direct question about explaining controlled experiments. Consistent with previous findings, we demonstrated that large percentages of students in introductory biology courses at both a research-intensive institution and a primarily undergraduate, minority-serving institution failed to recognize the need to account for confounds. Based on these findings, we tested the hypothesis that scientific literacy could be improved through a course-based intervention using an active learning framework focused on science as a process of evaluating alternative hypotheses. We found start-to-end-of-semester improvement in students' identification of unaccounted confounds with a scientific scenario in an intervention course but not in the control course. Interestingly, students in both the control and intervention courses showed improvement when tested with a scenario based on everyday life. The study findings suggest that a concerning number of college students may not account sufficiently for uncontrolled variables in real-life situations, and we present a widely applicable instructional strategy that improves on this broadly relevant scientific reasoning skill.

Scaffolded Instruction Improves Student Understanding of the Scientific Method & Experimental Design

Imagining, designing, and interpreting experiments: Using quantitative assessment to improve instruction in scientific reasoning

An Active Learning Intervention Based on Evaluating Alternative Hypotheses Increases Scientific Literacy of Controlled Experiments in Introductory Biology

Iteration in an Inquiry-Based Undergraduate Laboratory Strengthens Student Engagement and Incorporation of Scientific Skills

Teaching science writing in an introductory lab course

A scaffolded curriculum to foster experimental skills acquisition in an introductory physics lab course

Introductory Biology in Social Context: The Effects of an Issues-Based Laboratory Course on Biology Student Motivation

Motivating and Shaping Scientific Argumentation in Lab Reports

An Inorganic Chemistry Laboratory Technique Course using Scaffolded, Inquiry-Based Laboratories and Project-Based Learning

Adapting Undergraduate Biology to Include Science Practices by Teaching Students to Generate Scientific Explanations

Science Classroom Inquiry (SCI) Simulations: A Novel Method to Scaffold Science Learning

Effects of Learner-Centered Laboratory Activities on Achievement and Students' Preferences in Two High School Biology Courses

Effects of Reducing Scaffolding in an Undergraduate Electronics Lab

Improving Science Achievement—Is It Possible? Evaluating the Efficacy of a High School Chemistry and Physics Project-Based Learning Intervention

Data-driven activity reform: employing design research to improve scaffolding and concept development

Design Thinking in Science Education: Enhancing Undergraduate Students' Motivation and Achievement in Learning Biology

Design of inquiry-oriented science labs: impacts on students’ attitudes

Intervention initiatives to raise young people's interest and participation in STEM

Testing the Robustness of Inquiry Practices Once Scaffolding Is Removed

The efficacy of student-centered instruction in supporting science learning

Using a module-based laboratory to incorporate inquiry into a large cell biology course