Math items about real-world content lower test-scores of students from families with low socioeconomic status

Marjolein Muskens,Willem E. Frankenhuis,Lex Borghans
DOI: https://doi.org/10.1038/s41539-024-00228-8
2024-03-16
npj Science of Learning
Abstract:In many countries, standardized math tests are important for achieving academic success. Here, we examine whether content of items, the story that explains a mathematical question, biases performance of low-SES students. In a large-scale cohort study of Trends in International Mathematics and Science Studies (TIMSS)—including data from 58 countries from students in grades 4 and 8 ( N = 5501,165)—we examine whether item content that is more likely related to challenges for low-SES students (money, food, social relationships) improves their performance, compared with their average math performance. Results show that low-SES students scored lower on items with this specific content than expected based on an individual's average performance. The effect sizes are substantial: on average, the chance to answer correctly is 18% lower. From a hidden talents approach, these results are unexpected. However, they align with other theoretical frameworks such as scarcity mindset, providing new insights for fair testing.
psychology, experimental,education & educational research,neurosciences
What problem does this paper attempt to address?
### The Problem the Paper Attempts to Solve This paper explores whether the content of math test questions can bias the performance of students from low socioeconomic status (SES) families. Specifically, the researchers examined data from the Trends in International Mathematics and Science Study (TIMSS) to investigate whether the content of the questions affects the performance of low SES students. The main hypothesis of the paper is that question content related to the daily lives of low SES students (such as money, food, and social relationships) might enhance their performance. However, the research findings show that low SES students scored lower than expected on these specific content areas. This discovery provides new insights into fair testing and offers important information on how to reduce educational inequality.