Comparing introductory and beyond-introductory students' reasoning about uncertainty

Emily M. Stump,Mark Hughes,Gina Passante,N. G. Holmes
DOI: https://doi.org/10.1103/PhysRevPhysEducRes.19.020147
2023-10-25
Abstract:Uncertainty is an important concept in physics laboratory instruction. However, little work has examined how students reason about uncertainty beyond the introductory (intro) level. In this work we aimed to compare intro and beyond-intro students' ideas about uncertainty. We administered a survey to students at 10 different universities with questions probing procedural reasoning about measurement, student-identified sources of uncertainty, and predictive reasoning about data distributions. We found that intro and beyond-intro students answered similarly on questions where intro students already exhibited expert-level reasoning, such as in comparing two data sets with the same mean but different spreads, identifying limitations in an experimental setup, and predicting how a data distribution would change if more data were collected. For other questions, beyond-intro students generally exhibited more expert-like reasoning than intro students, such as when determining whether two sets of data agree, identifying principles of measurement that contribute to spread, and predicting how a data distribution would change if better data were collected. Neither differences in student populations, lab courses taken, nor research experience were able to fully explain the variability between intro and beyond-intro student responses. These results call for further research to better understand how students' ideas about uncertainty develop beyond the intro level.
Physics Education
What problem does this paper attempt to address?
The problem that this paper attempts to solve is the difference in the understanding of uncertainty among students at different levels (beginners and advanced students) in physics experimental teaching. Specifically, the researchers hope to compare the reasoning abilities of beginners and advanced students in the following aspects: 1. **Procedural reasoning**: that is, after being given data, how students decide what additional data should be collected and how to analyze the existing data. 2. **Sources of uncertainty**: whether students can identify various sources of uncertainty in the experiment and can appropriately quantify these uncertainties. 3. **Predictive reasoning**: how students predict how the data distribution will change if more data or higher - quality data are collected. Through these comparisons, the researchers hope to better understand how students' understanding of uncertainty develops as the course level increases, especially whether there is a significant improvement in students' understanding and reasoning abilities in higher - level courses after the beginner courses. In addition, the study also explores whether different background factors (such as major selection, laboratory course experience, research experience, etc.) will affect students' understanding of uncertainty. The research objective of the paper is to fill the current research gap regarding students' understanding of uncertainty, especially for advanced students, so as to provide a basis for future teaching improvement.