Abstract:Our situation: Classical test theory (CTT) and item response theory (IRT) are two measurement models used to evaluate results from examinations, questionnaires, and instruments. To illustrate the benefits of IRT, we compared how results from multiple-choice tests can be interpreted using CTT and IRT. Methodological literature review: IRT encompasses a collection of statistical models that estimate the probability of providing a correct response for a test item. The models are non-linear and generate item characteristic curves that illustrate the relationship between the examinee's ability level and whether they answered the item correctly. Several models can be used to estimate parameters such as item difficulty, discrimination, and guessing. In addition, IRT can generate item and test information functions to illustrate the accuracy of ability estimates. Our recommendations and their applications: Researchers interested in IRT should gather the necessary resources early in the research process and collaborate with those experienced in quantitative and advanced statistical models. Researchers should confirm IRT is the optimal choice and select the model ideal for their needs. Once data are acquired, confirm model assumptions are met and model fit is appropriate. Lastly, researchers should consider disseminating the findings with accompanying visuals. Potential impact: IRT can be a valuable approach in assessment design and evaluation. Potential opportunities include supporting the design of computer adaptive tests, creating equivalent test forms that evaluate a range of examinee abilities, and evaluating whether items perform differently for examinee sub-groups. Further, IRT can have noteworthy visuals such as test information and functions.

Item Response Theory -- A Statistical Framework for Educational and Psychological Measurement

Item response theory in high-stakes pharmacy assessments

Using Item Response Theory as a Tool in Educational Measurement

Item Response Theory: A Modern Measurement Approach to Reliability and Precision for Counseling Researchers

Robust Measurement Via A Fused Latent and Graphical Item Response Theory Model

Handbook of Item Response Theory, Volume 1, Models

The research of item response theory model

Variational Item Response Theory: Fast, Accurate, and Expressive

An introduction to mixture item response theory models

Modeling Item Response Theory with Stochastic Variational Inference

A short tutorial on item response theory in rheumatology

Bayesian Item Response Modeling in R with brms and Stan

Bayesian analysis of dynamic item response models in educational testing

The Mixture Item Response Theory Models and Its Application Traces

Redefining Item Response Models for Small Samples

An Item Response Theory Model for Incorporating Response Times in Forced-Choice Measures

Alternative Approaches to Addressing Non-Normal Distributions in the Application of IRT Models to Personality Measures

Fairness Evaluation with Item Response Theory

A Bayesian Nonparametric IRT Model

Scalable Learning of Item Response Theory Models