Evaluating People's Ability to Assess Treatment Claims: Validating a Test in Mandarin from Claim Evaluation Tools Database.

Qi Wang,Astrid Austvoll-Dahlgren,Jingyi Zhang,Yang Yu,Qi Zhou,Nan Yang,Lian Liu,Yaolong Chen
DOI: https://doi.org/10.1111/jebm.12343
2019-01-01
Journal of Evidence-Based Medicine
Abstract:OBJECTIVE:To describe the psychometric testing using Rasch analysis of a test in Mandarin developed from the Claim Evaluation Tools database.METHODS:We translated selected MCQs from the IHC Claim Evaluation Tools database to Mandarin and created a test including 24 MCQs covering 11 key concepts. We used purposeful sampling and surveyed children and adults in the Lanzhou area. In total 389 responses were entered into the analysis. We evaluated the psychometric properties of the test using Rasch analysis and the RUMM2030 software, testing for internal construct validity (multidimensionality), invariance of the items (item-person interaction), and item bias (differential item functioning).RESULTS:Overall, the psychometric properties of the test were found to be satisfactory. Based on findings from the Rasch analysis, we deleted three MCQs with suboptimal fit.CONCLUSIONS:The resulting test includes 21 MCQs and can be used in school and other teaching settings, in randomized trials evaluating outcomes of educational interventions, or in cross-sectional studies in Mandarin-speaking populations in China.
What problem does this paper attempt to address?