Abstract:The revised two-factor Study Process Questionnaire and the Approaches and Study Skills Inventory for Students are two instruments commonly used to measure student learning approach. Although they are designed to measure similar constructs, it is unclear whether the metrics they provide differ in terms of their real-world classification of learning approach. The purpose of this study is to compare outcomes of these two inventories in a study population from an undergraduate (baccalaureate) human anatomy course. The three central goals of this study are to compare the inventories in terms of 1) how students are classified, 2) the relationship between examination performance, time spent studying, and learning approach, and 3) instrument reliability. Results demonstrate that student classifications of corresponding scales of each inventory are significantly correlated, suggesting they measure similar constructs. Although the inventories had similar reliability, neither was consistently strong in predicting examination performance or study habits. Overall, these results suggest that the two inventories are comparable in terms of how they measure learning approach, but the lack of correspondence between learning approach scores and measurement outcomes questions their validity as tools that can be used universally in classrooms.NEW & NOTEWORTHY Although learning approach inventories have been used extensively in education research, there has been no direct comparison of how student classification differs between instruments or how classification influences the interpretation of how learning approach impacts student performance. This is especially relevant in light of recent research questioning the validity of the Study Process Questionnaire (LoGiudice AB, Norman GR, Manzoor S, Monteiro S. Adv Health Sci Educ Theory Pract 28: 47-63, 2023; Johnson SN, Gallagher ED, Vagnozzi AM. PLoS One 16: e0250600, 2021).

A comparison of Hake's g and Cohen's d for analyzing gains on concept inventories

Measuring Learning Gains in Chemical Education: A Comparison of Two Methods

What are we assessing? An analysis of the most common concept inventories in physics

Comparing large lecture mechanics curricula using the Force Concept Inventory: A five thousand student study

Best Practices for Administering Concept Inventories

Dynamic Models of Learning and Education Measurement

Participation rates of in-class vs. online administration of low-stakes research-based assessments

In-class vs. online administration of concept inventories and attitudinal assessments

Applying Cognitive Diagnostic Models to Mechanics Concept Inventories

Gaining Insights into Group-Level Course Difficulty via Differential Course Functioning

Lessons from a Large-Scale Assessment: Results from Conceptual Inventories

Test Fairness: Examining Differential Functioning of the Reading Comprehension Section of the GSEEE in China

Individual gain and engagement with mathematical understanding

Investigating students seriousness during selected conceptual inventory surveys

Gender gap on concept inventories in physics: what is consistent, what is inconsistent, and what factors influence the gap?

Interpretation of the Standardized Mean Difference Effect Size When Distributions Are Not Normal or Homoscedastic

A Comparison of Two Methods of Administering Group Reading Inventories to Diverse Learners

A comparison of two learning approach inventories and their utility in predicting examination performance and study habits

Evaluating item difficulty patterns for assessing student misconceptions in science across physics, chemistry, and biology concepts

An item response theory evaluation of the Light and Spectroscopy Concept Inventory national data set

The Relativity Concept Inventory: development, analysis and results