3 research outputs found
Multiple Choice Question Corpus Analysis for Distractor Characterization
International audienceIn this paper, we present a study of MCQ aiming to define criteria in order to automatically select distractors. We are aiming to show that distractor editing follows rules like syntactic and semantic homogeneity according to associated answer, and the possibility to automatically identify this homogeneity. Manual analysis shows that homogeneity rule is respected to edit distractors and automatic analysis shows the possibility to reproduce these criteria. These ones can be used in future works to automatically select distractors, with the combination of other criteria
Knowledge-Driven Distractor Generation for Cloze-style Multiple Choice Questions
In this paper, we propose a novel configurable framework to automatically
generate distractive choices for open-domain cloze-style multiple-choice
questions, which incorporates a general-purpose knowledge base to effectively
create a small distractor candidate set, and a feature-rich learning-to-rank
model to select distractors that are both plausible and reliable. Experimental
results on datasets across four domains show that our framework yields
distractors that are more plausible and reliable than previous methods. This
dataset can also be used as a benchmark for distractor generation in the
future.Comment: To appear at AAAI 202
Multiple Choice Question Corpus Analysis for Distractor Characterization
In this paper, we present a study of MCQ aiming to define criteria in order to automatically select distractors. We are aiming to show that distractor editing follows rules like syntactic and semantic homogeneity according to associated answer, and the possibility to automatically identify this homogeneity. Manual analysis shows that homogeneity rule is respected to edit distractors and automatic analysis shows the possibility to reproduce these criteria. These ones can be used in future works to automatically select distractors, with the combination of other criteria