Abstract:In norm-referenced psychological testing, an individual's performance is expressed in relation to a reference population using a standardized score, like an intelligence quotient score. The reference population can depend on a continuous variable, like age. Current continuous norming methods transform the raw score into an age-dependent standardized score. Such methods have the shortcoming to solely rely on the raw test scores, ignoring valuable information from individual item responses. Instead of modeling the raw test scores, we propose modeling the item scores with a Bayesian two-parameter logistic (2PL) item response theory model with age-dependent mean and variance of the latent trait distribution, 2PL-norm for short. Norms are then derived using the estimated latent trait score and the age-dependent distribution parameters. Simulations show that 2PL-norms are overall more accurate than those from the most popular raw score-based norming methods cNORM and generalized additive models for location, scale, and shape (GAMLSS). Furthermore, the credible intervals of 2PL-norm exhibit clearly superior coverage over the confidence intervals of the raw score-based methods. The only issue of 2PL-norm is its slightly lower performance at the tails of the norms. Among the raw score-based norming methods, GAMLSS outperforms cNORM. For empirical practice this suggests the use of 2PL-norm, if the model assumptions hold. If not, or the interest is solely in the point estimates of the extreme trait positions, GAMLSS-based norming is a better alternative. The use of the 2PL-norm is illustrated and compared with GAMLSS and cNORM using empirical data, and code is provided, so that users can readily apply 2PL-norm to their normative data. (PsycInfo Database Record (c) 2024 APA, all rights reserved).

Model Selection in Continuous Test Norming With GAMLSS

A tutorial on regression-based norming of psychological tests with GAMLSS.

Item response theory-based continuous test norming.

Linear mixed effects models for non‐Gaussian continuous repeated measurement data

Prediction-Oriented Model Selection In Partial Least Squares Path Modeling

Optimal Designs for the Generalized Partial Credit Model

When can categorical variables be treated as continuous? A comparison of robust continuous and categorical SEM estimation methods under suboptimal conditions.

Maximum Likelihood Estimation of Structural Equation Models for Continuous Data: Standard Errors and Goodness of Fit

A Causal View on Bias in Missing Data Imputation: The Impact of Evil Auxiliary Variables on Norming of Test Scores

Adaptive testing with the GGUM-RANK multidimensional forced choice model: Comparison of pair, triplet, and tetrad scoring

The effect of latent and error non-normality on corrections to the test statistic in structural equation modeling

Automatic smoothing parameter selection in GAMLSS with an application to centile estimation

Generalized Dantzig Selector: Application to the k-support norm

The Effect of Latent and Error Non-Normality on Measures of Fit in Structural Equation Modeling

Meta-analysis of prediction model performance across multiple studies: Which scale helps ensure between-study normality for the C-statistic and calibration measures?

Evaluating Small Sample Approaches for Model Test Statistics in Structural Equation Modeling

Effects of Latent Variable Nonnormality and Model Misspecification on Testing Structural Equation Modeling Interactions

Model Selection Criteria for Latent Growth Models Using Bayesian Methods

GMM Weighting Matrices in Cross-Sectional Asset Pricing Tests

Model Selection for Ordinary Differential Equations: A Statistical Testing Approach

Nonlinear Sequential Designs for Logistic Item Response Theory Models with Applications to Computerized Adaptive Tests