Survey of physics reasoning on uncertainty concepts in experiments: an assessment of measurement uncertainty for introductory physics labs

Michael Vignal,Gayle Geschwind,Benjamin Pollard,Rachel Henderson,Marcos D. Caballero,H. J. Lewandowski

2023-08-10

Abstract:Measurement uncertainty is a critical feature of experimental research in the physical sciences, and the concepts and practices surrounding measurement uncertainty are important components of physics lab courses. However, there has not been a broadly applicable, research-based assessment tool that allows physics instructors to easily measure students' knowledge of measurement uncertainty concepts and practices. To address this need, we employed Evidence-Centered Design to create the Survey of Physics Reasoning on Uncertainty Concepts in Experiments (SPRUCE). SPRUCE is a pre-post assessment instrument intended for use in introductory (first- and second-year) physics lab courses to help instructors and researchers identify student strengths and challenges with measurement uncertainty. In this paper, we discuss the development of SPRUCE's assessment items guided by Evidence-Centered Design, focusing on how instructors' and researchers' assessment priorities were incorporated into the assessment items and how students' reasoning from pilot testing informed decisions around item answer options. We also present an example of some of the feedback an instructor would receive after implementing SPRUCE in a pre-post fashion, along with a brief discussion of how that feedback could be interpreted and acted upon.

Physics Education

What problem does this paper attempt to address?

The problem that this paper attempts to solve is the lack of evaluation tools for measuring uncertainty in physics experiments. Specifically, although measurement uncertainty (MU) is a key feature in experimental scientific research and an important part of physics laboratory courses, there is currently no widely applicable research - based assessment tool (RBAI) that enables physics teachers to easily measure students' mastery of the concepts and practices of measurement uncertainty. To fill this gap, the authors developed the "Survey of Reasoning about Uncertainty Concepts in Physics Experiments" (SPRUCE) using the Evidence - Centered Design (ECD) method. SPRUCE is a pre - and post - test assessment tool designed for use in junior (first - and second - year) physics laboratory courses to help teachers and researchers identify students' strengths and challenges in measurement uncertainty. Through this study, the authors hope that SPRUCE can help improve teaching, especially in those concepts and practices of measurement uncertainty that are challenging for junior physics laboratory students.

Survey of physics reasoning on uncertainty concepts in experiments: an assessment of measurement uncertainty for introductory physics labs

Representational differences in how students compare measurements

Impact of an introductory lab on students' understanding of measurement uncertainty

Assessing Students' Understanding of Uncertainty in Undergraduate Physics Laboratory Courses at a Major Canadian University: Longitudinal Results and Misconceptions

New perspectives on student reasoning about measurement uncertainty: More or better data

Context affects student thinking about sources of uncertainty in classical and quantum mechanics

Comparing introductory and beyond-introductory students' reasoning about uncertainty

Student reasoning about sources of experimental measurement uncertainty in quantum versus classical mechanics

Uncertainty Principles for Teaching Laboratories

Interview validation of the Physics Lab Inventory of Critical thinking (PLIC)

An epistemology and expectations survey about experimental physics: Development and initial results

Assessment of critical thinking in physics labs

Facilitating Problem Solving in a University Undergraduate Physics Classroom: The Case of Students’ Self-Efficacy

Students' views about the nature of experimental physics

Quantifying critical thinking: Development and validation of the Physics Lab Inventory of Critical thinking (PLIC)

Developing a reasoning inventory for measuring physics quantitative literacy

Using psychometric tools as a window into students' quantitative reasoning in introductory physics

Investigating Systematic Uncertainty and Experimental Design with Projectile Launchers

Race to improve student understanding of uncertainty: Using LEGO race cars in the physics lab

What are we assessing? An analysis of the most common concept inventories in physics

Development and Validation of a conceptual survey instrument to evaluate introductory physics students' understanding of thermodynamics