Abstract:Item response tree (IRTree) models are a flexible framework to control self-reported trait measurements for response styles. To this end, IRTree models decompose the responses to rating items into sub-decisions, which are assumed to be made on the basis of either the trait being measured or a response style, whereby the effects of such person parameters can be separated from each other. Here we investigate conditions under which the substantive meanings of estimated extreme response style parameters are potentially invalid and do not correspond to the meanings attributed to them, that is, content-unrelated category preferences. Rather, the response style factor may mimic the trait and capture part of the trait-induced variance in item responding, thus impairing the meaningful separation of the person parameters. Such a mimicry effect is manifested in a biased estimation of the covariance of response style and trait, as well as in an overestimation of the response style variance. Both can lead to severely misleading conclusions drawn from IRTree analyses. A series of simulation studies reveals that mimicry effects depend on the distribution of observed responses and that the estimation biases are stronger the more asymmetrically the responses are distributed across the rating scale. It is further demonstrated that extending the commonly used IRTree model with unidimensional sub-decisions by multidimensional parameterizations counteracts mimicry effects and facilitates the meaningful separation of parameters. An empirical example of the Program for International Student Assessment (PISA) background questionnaire illustrates the threat of mimicry effects in real data. The implications of applying IRTree models for empirical research questions are discussed.

Influencing factors of Thurstonian IRT model in faking-resisting forced-choice questionnaire

An Item Response Theory Model for Incorporating Response Times in Forced-Choice Measures

On the Validity of Forced Choice Scores Derived From the Thurstonian Item Response Theory Model

Investigating the Normativity of Trait Estimates from Multidimensional Forced-Choice Data

Linear Factor Analytic Thurstonian Forced-Choice Models: Current Status and Issues

Modeling Faking in the Multidimensional Forced-Choice Format: The Faking Mixture Model

The Generalized Thurstonian Unfolding Model (GTUM): Advancing the Modeling of Forced-Choice Data

Using the multidimensional nominal response model to model faking in questionnaire data: The importance of item desirability characteristics

Forced-Choice Assessment of Work-Related Maladaptive Personality Traits: Preliminary Evidence From an Application of Thurstonian Item Response Modeling

Detecting DIF in Multidimensional Forced Choice Measures Using the Thurstonian Item Response Theory Model

A Mixture Model for Random Responding Behavior in Forced-Choice Noncognitive Assessment: Implication and Application in Organizational Research

Effects of Applicant Faking on Forced-Choice and Likert Scores

Robust Measurement Via A Fused Latent and Graphical Item Response Theory Model

Statistical foundations of person parameter estimation in the Thurstonian IRT model for forced‐choice and pairwise comparison designs

Joint modeling of the two-alternative multidimensional forced-choice personality measurement and its response time by a Thurstonian D-diffusion item response model

Separation of Traits and Extreme Response Style in IRTree Models: The Role of Mimicry Effects for the Meaningful Interpretation of Estimates

Can Forced-Choice Response Format Reduce Faking of Socially Aversive Personality Traits?

Individual random effects model for differences in trait distribution among respondents

Alternative Approaches to Addressing Non-Normal Distributions in the Application of IRT Models to Personality Measures

Testing the Efficacy of a New Faking-mitigation Strategy for Optimizing the Utility of SJTs