A Hierarchical Mixed Membership Model for Multiple-Answer Multiple-Choice Items with Signal Detection Theory

Abstract

Multiple-answers multiple-choice (MAMC) items are widely used in educational testing and social research. However, inadequate studies and resources are allocated to the assessments of MAMC items. In this study, we introduce a new approach to analyze MAMC items using original response data (which alternatives have been selected) without scoring (correct or wrong). It has immense potential to provide rich information relevant for tractable psychological behavior and interpretable educational measurement. We use the signal detection theory (SDT) to measure the decision-making behavior across alternatives. Then, the mixed membership model is applied to capture the grouped data structure in the MAMC item. A simulation study of the HMM-SDT model is presented with a comparison to the tradition treatments in Item Response Theory (IRT)

    Similar works