Abstract:Our situation: Classical test theory (CTT) and item response theory (IRT) are two measurement models used to evaluate results from examinations, questionnaires, and instruments. To illustrate the benefits of IRT, we compared how results from multiple-choice tests can be interpreted using CTT and IRT. Methodological literature review: IRT encompasses a collection of statistical models that estimate the probability of providing a correct response for a test item. The models are non-linear and generate item characteristic curves that illustrate the relationship between the examinee's ability level and whether they answered the item correctly. Several models can be used to estimate parameters such as item difficulty, discrimination, and guessing. In addition, IRT can generate item and test information functions to illustrate the accuracy of ability estimates. Our recommendations and their applications: Researchers interested in IRT should gather the necessary resources early in the research process and collaborate with those experienced in quantitative and advanced statistical models. Researchers should confirm IRT is the optimal choice and select the model ideal for their needs. Once data are acquired, confirm model assumptions are met and model fit is appropriate. Lastly, researchers should consider disseminating the findings with accompanying visuals. Potential impact: IRT can be a valuable approach in assessment design and evaluation. Potential opportunities include supporting the design of computer adaptive tests, creating equivalent test forms that evaluate a range of examinee abilities, and evaluating whether items perform differently for examinee sub-groups. Further, IRT can have noteworthy visuals such as test information and functions.

Evaluation of student proficiency through a multidimensional finite mixture IRT model

Evaluation of Student Performance through a Multidimensional Finite Mixture IRT Model

A multilevel finite mixture item response model to cluster examinees and schools

A Bayesian Nonparametric IRT Model

An introduction to mixture item response theory models

Implicit assessment of language learning during practice as accurate as explicit testing

Scalable Learning of Item Response Theory Models

Investigating dynamics in attentive and inattentive responding together with their contextual correlates using a novel mixture IRT model for intensive longitudinal data

Multidimensional Item Response Theory in the Style of Collaborative Filtering

Flexible Bayesian modelling in dichotomous item response theory using mixtures of skewed item curves

Modeling Item-Level Heterogeneous Treatment Effects With the Explanatory Item Response Model: Leveraging Large-Scale Online Assessments to Pinpoint the Impact of Educational Interventions

Robust Measurement Via A Fused Latent and Graphical Item Response Theory Model

Application of Item Response Theory to Mathematics High School Exams in Portugal

Investigating Heterogeneity in Response Strategies: A Mixture Multidimensional IRTree Approach

MultiLCIRT: An R package for multidimensional latent class item response models

Simple Structure Detection Through Bayesian Exploratory Multidimensional IRT Models

Modeling repeated self-reported outcome data: A continuous-time longitudinal Item Response Theory model

Approaches to Item-Level Data with Cross-Classified Structure: An Illustration with Student Evaluation of Teaching

Investigating the Impact of Noneffortful Responses on Individual-Level Scores: Can the Effort-Moderated IRT Model Serve as a Solution?

T-BMIRT: Estimating Representations of Student Knowledge and Educational Components in Online Education

Item response theory in high-stakes pharmacy assessments