Abstract:Do commonly used statistical-learning tasks capture stable individual differences in children? Infants, children, and adults are capable of using statistical learning (SL) to extract information about their environment. Although most studies have looked at group-level performance, a growing literature examines individual differences in SL and their relation to language-learning outcomes: Individuals who are better at SL are expected to show better linguistic abilities. Accordingly, studies have shown positive correlations between SL performance and language outcomes in both children and adults. However, these studies have often used tasks designed to explore group-level performance without modifying them, resulting in psychometric shortcomings that impact reliability in adults (Siegelman, Bogaerts, Christiansen, & Frost in Transactions of the Royal Society B, 372, 20160059, 2017a; Siegelman, Bogaerts, & Frost in Behavior Research Methods, 49, 418–432, 2017b). Even though similar measures are used to assess individual differences in children, no study to date has examined the reliability of these measures in development. This study examined the reliability of common SL measures in both children and adults. It assessed the reliability of three SL tasks (two auditory and one visual) twice (two months apart) in adults and children (mean age 8 years). Although the tasks showed moderate reliability in adults, they did not capture stable individual variation in children. None of the tasks were reliable across sessions, and all showed internal consistency measures well below psychometric standards. These findings raise significant concerns about the use of current SL measures to predict and explain individual differences in development. The article ends with a discussion of possible explanations for the difference in reliability between children and adults.

Comparing standard deviation effects across contexts

Effect of Academic Comparisons on the Subjective Well-Being of Chinese Secondary School Students

REVISITING A 90-YEAR-OLD DEBATE: THE ADVANTAGES OF THE MEAN DEVIATION

Assessing the Comparability of School Scores Across Test Forms That Are Not Parallel

Interpretation of the Standardized Mean Difference Effect Size When Distributions Are Not Normal or Homoscedastic

Alternatives to Weighted Item Fit Statistics for Establishing Measurement Invariance in Many Groups

What happens if we compare chopsticks with forks? The impact of making inappropriate comparisons in cross-cultural research.

Aggregating Student Achievement Trends Across States With Different Tests: Using Standardized Slopes as Effect Sizes

The importance of test order in external and standardized test results: The case of PISA 2018

Comparing Ratios of the Mean to a Power of Variance in Two Samples Via Self-Normalized Test Statistics

The Distance Standard Deviation

Do current statistical learning tasks capture stable individual differences in children? An investigation of task reliability across modality

Standard Error of Ability Estimates and the Classification Accuracy and Consistency of Binary Decisions

Representational differences in how students compare measurements

Standard Errors for National Trends in International Large-Scale Assessments in the Case of Cross-National Differential Item Functioning

Discussion of "on State Education Statistics": A Difficulty with Regression Analyses of Regional Test Score Averages

The use of test scores from large-scale assessment surveys: psychometric and statistical considerations

Measurement Models, Estimation, and the Study of Change

Examining the role of context in statistical literacy outcomes using an isomorphic assessment instrument

The Necessity of Testing Measurement Invariance in Cross-Cultural Research: Potential Bias in Cross-Cultural Comparisons With Individualism– Collectivism Self-Report Scales

Best vs. All: Equity and Accuracy of Standardized Test Score Reporting