snowIRT distractor analysis
Posted: Thu Dec 14, 2023 8:15 am
Hi
Would it be possible to add an additional type of analysis to the one for distractors? In my context (language assessment) I want to get the item-rest value not just for the correct option but also for the distractors. This means that the incorrect options are treated as correct and the outcome has to be a negative correlation. I use this information to make decisions about how well the distractors work for that population.
For example, an older program TiaPlus (created by CITO for the educational testing context) produces this analysis. Here is the link to the user manual: https://tiaplus.cito.nl/TiaPlus_Users_Manual.pdf. Rir and rar are explained on pages 32 and 36 and those are the coefficients that I have in mind. I'm including a screenshot of the results of the analysis for visual illustration, the results with the asterisk are the correct option for the test question.
Many thanks in advance
Marju
Would it be possible to add an additional type of analysis to the one for distractors? In my context (language assessment) I want to get the item-rest value not just for the correct option but also for the distractors. This means that the incorrect options are treated as correct and the outcome has to be a negative correlation. I use this information to make decisions about how well the distractors work for that population.
For example, an older program TiaPlus (created by CITO for the educational testing context) produces this analysis. Here is the link to the user manual: https://tiaplus.cito.nl/TiaPlus_Users_Manual.pdf. Rir and rar are explained on pages 32 and 36 and those are the coefficients that I have in mind. I'm including a screenshot of the results of the analysis for visual illustration, the results with the asterisk are the correct option for the test question.
Many thanks in advance
Marju