Assessing the association between pre-course metrics of student preparation and student performance in introductory statistics: Results from early data on simulation-based inference vs. nonsimulation based inference

Nathan Tintle,Jake Clark,Karen Fischer,Beth Chance,George Cobb,Soma Roy,Todd Swanson,Jill VanderStoep

2018-02-27

Abstract:The recent simulation-based inference (SBI) movement in algebra-based introductory statistics courses (Stat 101) has provided preliminary evidence of improved student conceptual understanding and retention. However, little is known about whether these positive effects are preferentially distributed across types of students entering the course. We consider how two metrics of Stat 101 student preparation (pre-course performance on concept inventory and math ACT score) may or may not be associated with end of course student performance on conceptual inventories. Students across all preparation levels tended to show improvement in Stat 101, but more improvement was observed across all student preparation levels in early versions of a SBI course. Furthermore, students' gains tended to be similar regardless of whether students entered the course with more preparation or less. Recent data on a sample of students using a current version of an SBI course showed similar results, though direct comparison with non-SBI students was not possible. Overall, our analysis provides additional evidence that SBI curricula are effective at improving students' conceptual understanding of statistical ideas post-course regardless student preparation. Further work is needed to better understand nuances of student improvement based on other student demographics, prior coursework, as well as instructor and institutional variables.

Other Statistics

What problem does this paper attempt to address?

The main problem that this paper attempts to solve is to evaluate the difference in the impact of Simulation - Based Inference (SBI) courses and traditional introductory statistics courses (Stat 101) on students' conceptual understanding, especially whether these impacts vary according to students' different levels of preparation before enrollment. Specifically, the researchers focus on the following points:

1. **The relationship between student backgrounds and course effectiveness**: Explore how students' pre - enrollment mathematical abilities (such as ACT scores), statistics concept test scores, and college grade point averages (GPA) are related to the changes in their conceptual understanding at the end of the course. The research aims to understand whether the SBI course can better adapt to students with different levels of preparation and improve their understanding of statistical concepts.

2. **The effectiveness of the SBI course**: By comparing the performance of students using the SBI course and those using the traditional course in terms of conceptual understanding, evaluate whether the SBI course is more effective than the traditional course. This includes overall performance as well as performance in specific conceptual areas, such as data collection and design, significance testing, probability/simulation, etc.

3. **The improvement of students with different levels of preparation**: Analyze whether the improvement in conceptual understanding of students with different levels of preparation is consistent after using the SBI course. The researchers pay special attention to whether low - prepared students can also benefit from the SBI course, thereby narrowing the gap with high - prepared students.

Through these analyses, the researchers hope to provide empirical support for statistics education, proving that the SBI course can not only improve students' overall performance but also promote the balanced development of students from different backgrounds in conceptual understanding. This research is of great significance for optimizing the teaching methods of introductory statistics courses.