HOTs Multiple Choice and Essay Questions: A Validated Instrument to Measure Higher-order Thinking Skills of Prospective Teachers
Ika Maryani,Zuhdan Kun Prasetyo,Insih Wilujeng,Siwi Purwanti,Meita Fitrianawati
DOI: https://doi.org/10.36681/tused.2021.97
2021-12-15
Turkish Journal of Science Education
Abstract:Higher-order thinking skills(HOTs) arevery crucial thinking skillsneeded by teachers to train studentsto develop21st-century learning.This study aimedto develop Multiple Choice and Essay Questions tomeasure the HOTs of the prospective teachersof the elementary school education department. This study used a 4-D model by Thiagarajan which involvedexperts at naturalscience, evaluation studies, and primary schoolpedagogyin thecontent validation. We also involved 156prospective teachers as the test subjects. The assessment of instrument quality by expertsshowed that the question quality was very good. This research succeeded in developing 10 multiple choice questions and 5 essays.The validity testby Rasch Modelshowed that there were 7 multiple choicequestions classified as fit, and 3questions were classified as a misfit,while the 2essay questions are invalidand the other (3 questions) as valid. The reliability test with KR-20 on multiple-choice questions and Cronbach's alpha for the essay questions resulted reliable questions. The discrimination index showed discarded, sufficient, good, and very good. The item difficulty index showed that 3 questions are moderate(num 7, 1, 5) and 7 questions aredifficult(num 4, 10, 6, 3, 2, 8, 9). The distractor efficiency showed that 59.2% of distractorsworked, and40.8% did not work. This instrument can be used to analyze prospective teachers’ HOTs. This data can be used as the reference for developing competency improvement programs for prospective teachers, for example through the HOTs-oriented learning models.