Abstract:Educational technology (EdTech) designers need to ensure population validity as they attempt to meet the individual needs of all students. EdTech researchers often have access to larger and more diverse samples of student data to test replication across broad demographic contexts as compared to either the small-scale experiments or the larger convenience samples often seen in experimental psychology studies of learning. However, the source of typical EdTech data (i.e., online learning systems) and concerns related to student privacy often limit the opportunity to collect demographic variables from individual students—the sample is diverse, but the researcher does not know how that diversity is realized in individual learners. In order to ensure equitable student outcomes, the EdTech community should make greater efforts to develop new methods for addressing this shortcoming. Recent work has sought to address this issue by investigating publicly-available, school-level differences in demographics, which can be useful when individual-level variation may be difficult or impossible to acquire data for. In this study, we use this approach to better understand the role of social factors in students' self-regulated learning and motivation-related behaviors, behaviors whose effectiveness appears to be highly variable between groups. We demonstrate that school-level demographics can be significantly associated with the relationships between students' help-seeking behavior, motivation, and outcomes (math performance and math self-concept). We do so in the context of reasoning mind, an intelligent tutoring system for elementary mathematics. By studying the conditions under which these relationships vary across different demographic contexts, we challenge implicit assumptions of generalizability and provide an evidence-based commentary on future research practices in the EdTech community surrounding how we consider diversity in our field's investigations.

Eliciting Mathematics Interest: New Directions for Context Personalization and Example Choice

Investigation of a developmental path model for interest in the study of mathematics

The role of situational interest in personalized learning.

The effect of an intervention personalizing mathematics to students’ career and popular culture interests on mathematics interest and learning.

Exploring the Relationship Between Community College Students’ Exposure to Math Contextualization and Educational Outcomes

An intervention to support mathematics self-efficacy in middle school

Understanding the interplay between targeted motivation interventions and motivational teaching practices in mathematics classrooms

Using adaptive learning technologies to personalize instruction to student interests: The impact of relevant contexts on performance and learning outcomes.

Personalizing real‐world problems: Posing own problems increases self‐efficacy expectations, intrinsic value, attainment value, and utility value

Interesting, but Less Interested: Gender Differences and Similarities in Mathematics Interest

Situational interest: Its multifaceted structure in the secondary school mathematics classroom.

Classroom motivational environment influences on emotional and cognitive dimensions of student interest in mathematics

Factors that promote interest and engagement in learning mathematics for low-achieving primary students across three learning settings

Motivational climate in mathematics classrooms: teacher self-efficacy for student engagement, student- and teacher-reported emotional support and student interest

Teacher ability evaluation and changes in elementary student profiles of motivation and performance in mathematics

A growth-theory-of-interest intervention increases interest in math and science coursework among liberal arts undergraduates.

Context Matters: Differing Implications of Motivation and Help-Seeking in Educational Technology

Application of contextual teaching and learning approaches in improving mathematics interest and learning achievement of elementary school students

Changing students' attitudes toward mathematics through creative steam projects designed and executed by them (smart program)

Teacher Enthusiasm, Supportive Instructional Practices, and Student Motivation in Mathematics Classrooms

Using the Elaborative Likelihood Model (ELM) of Persuasion to Improve Pupils’ Pro-mathematics Attitude