A Comparison Study for the Four Parameter Logistic Model and Traditional Logistic Models
Yue Liu,Hongyun Liu
2018-01-01
Abstract:High- ability test - takers may on occasion answer an easy question incorrectly,which is called sleeping phenomenon (Wright,1977). In these situations,four parameter logistic model(4PM)may be uniquely suited for characterizing the data. The 4PM was proposed by Barton and Lord(1981),which added the d parameter to allow upper asymptotes to be less than 1. 00. The more gener-al formulation of the 4PM(Waller & Reise,2010)suggestedd as an item-specific upper asymptote. Besides,a three parameter logistic model for reversed data(3PMR)was discussed,which was suited for the situations with no guessing phenomenon but sleeping phenome-non. In the previous researches,the4PM provided good fit for some psychological tests,such as MMPI and so on. However,for achieve-ment tests,Barton and Lord in their earlier work found that the 4PM failed to improve the likelihood or to significantly change any ability estimates for the datasets collected by ETS. Therefore,is it really inappropriate to use the 4PM in achievement tests?Moreover,most previous researches focused on the differences of parameter estimations based on simulated data. However,how often the sleeping phe-nomenon happen in real situations is still worth studying. In our research,we fitted seven models to the Taylor Manifest Anxiety Scale ( TMA)and the large-scale Maths test. Meanwhile,the dataset of Maths tests was used to construct two different distributions:approxi-mately normal distribution(skewness is 0. 097)and negatively skewed distribution(skewness is-0. 199). The models compared were Rasch model,two parameter logistic model(2PM),three parameter logistic model(3PM),3PM with reversing scores on each item(3PM_R),4PM,4PM with equal guessing parameters(4PM_c)and 4PM with equal d parameters(4PM_d). The R package sirt was used to estimate all the models in our study. In order to investigate the differences of these models,we computed:(1)the model fit indexAIC, BIC;(2)the correlations of the item parameter estimations of the best fitted logistic model with d parameter and the second best model without d parameter,for all the items and after the easiest 5,10,and 10 items were deleted;(3)the correlations of the ability parameter estimations of the two models discussed in(2),for all and the top 1000,500,300,200,100 respondents. The results indicated that(1) the Rasch model showed the worst fit for all the datasets. For TMA data,the 3PMR showed the best fit,for the Maths tests,the 4PM showed the best fit;(2)the difficulty parameters were quite similar inthe two compared models,however,there was lager difference be-tween the discrimination parameters,the negatively skewed Standard Maths test data showed similar results;when the easiest items were deleted,the correlation of the discrimination parameters became larger,especially for the negatively skewed Standard Maths test;(3)the ability parameters of two compared models correlated highly across all groups of respondents,however,the correlations for the top 1000, 500,300,200,100 groups were relatively small,especially for the top 100 respondents. In conclusion,the 4PM is necessary in both psy-chological tests and achievement tests. For practitioners who should make a decision about whether to choose the 4PM,the type of the tests,the purpose of the tests,and the complexity of the computation should be considered at the same time.