Abstract:To overcome difficulties encountered in the analyses of some factors related to the students’ knowledge and for avoiding expensive or difficult to realize tests, we have combined herein particular features of instruments used for measuring the knowledge and for controlling the quality of the testing, with some statistical tools. Initially we propose to extend the metrics of the standard instruments used for measuring knowledge and testing reliability, as the Rashc model and indexes theory. In this framework, the features of indexes of a certified Concept Inventory test are recognized as responses to specific factors, including latent ones, which affect the overall knowledge state. Specifically, by such a straightforward analysis we estimate the quality of the teaching efficacy in physics, which is not a directly measurable quantity by standard tools. Similarly, some results of the Rash analysis for those certified tests, such as the misfitted occurrences and guessing behavior, are treated as auxiliary indicators of knowledge state and are used for analyzing the cause factors which affect it. Also, the threshold parameter appearing on the polytomous Rasch procedure is considered for evaluating the effort needed to improve the tests’ difficulty perceived by students, and next as a measure of the possible academic achievements and proficiency that can be attained through an appropriate improvement of the learning conditions. This idea is advanced by employing the features of the histograms and distributions of students’ abilities calculated by the Rasch technique. We used for those purposes several certified CI tests in certain groups and circumstances to mimic different initial condition of cause factors, and analyzed similarities and dissimilarities of the outcomes of the Rasch analysis’ seen as the system’s responses. By comparing their results, we achieved a better evidencing of problems on the efficiency of teaching and learning fundamental sciences. Also, the combination of different tools is seen useful to improve the resolution of standard instruments of knowledge measurement. Even though the illustrations of those ideas consist of some particular case -studies, the technique proposed herein is believed to be of a more general nature and can be used for analyses in similar circumstances.

The Value of Using Test Response Data for Content Validity: an Application of the Bifactor-Mirt to a Nursing Knowledge Test

Translation, Revision and Assessment of Reliability and Validity of the Assessment of Interprofessional Team Collaboration Scale

Application of Bi-factor MIRT and Higher-order CDM Models to an In-house EFL Listening Test for Diagnostic Purposes

Applying Unidimensional and Multidimensional Item Response Theory Models in Testlet-Based Reading Assessment

Investigating the reliability of CET-SET using Multi-Facet Rasch Model

Multidimensional item response theory models for testlet-based doubly bounded data

Comparing Two Theories of Grammatical Knowledge Assessment: a Bifactor-Mirt Analysis

Examining the Inseparability of Content Knowledge from LSP Reading Ability: an Approach Combining Bifactor-Multidimensional Item Response Theory and Structural Equation Modeling

Developing Computerized Adaptive Testing for a National Health Professionals Exam: An Attempt from Psychometric Simulations

Validation of the Barthel Index in Chinese nursing home residents: an item response theory analysis

Adaptive testing with the GGUM-RANK multidimensional forced choice model: Comparison of pair, triplet, and tetrad scoring

Using Item Response Theory as a Tool in Educational Measurement

Examining the Construct Validity for the Multiple-Content Testing Programs

A Validation Study of the Mindfulness-Based Interventions Teaching Assessment Criteria for Assessing Mindfulness-Based Intervention Teacher Skill: Inter-Rater Reliability and Predictive Validity

An item response theory and Rasch analysis of the NUDKS: a data literacy scale

Practical Significance of Item Misfit in Educational Assessments

A Thematic Review on the Combination of Statistical Tools and Measuring Instruments for Analyzing Knowledge and Students’ Achievement in Science

Item Response Theory Validation of the Forgotten Joint Score for Persons Undergoing Total Knee Replacement

Item response theory in high-stakes pharmacy assessments

Factor structure and measurement invariance of the Health Education Impact Questionnaire: Does the subjectivity of the response perspective threaten the contextual validity of inferences?

Evaluating the Quality of Multiple-Choice Test Questions in the Postlicensure Environment