Calculating the random guess scores of multiple-response and matching test items

For achievement tests, the guess score is often used as a baseline for the lowest possible grade for score to grade transformations and setting the cut scores. For test item types such as multiple-response, matching and drag-and-drop, determin-ing the guess score requires more elaborate calculations than the more straight-forward calculation of the guess score for True-False and multiple-choice test item formats. For various variants of multiple-response and matching types with respect to dichotomous and polytomous scoring, methods for determining the guess score are presented and illustrated with practical applications. The implica-tions for theory and practice are discussed

The relationships between problem characteristics, achievement-related behaviors, and academic achievement in problem-based learning

This study investigated the influence of five problem characteristics on students' achievement-related classroom behaviors and academic achievement. Data from 5,949 polytechnic students in PBL curricula across 170 courses were analyzed by means of path analysis. The five problem characteristics were: (1) problem clarity, (2) problem familiarity, (3) the extent to which the problem stimulated group discussion, (4) self-study, and (5) identification of learning goals. The results showed that problem clarity led to more group discussion, identification of learning goals, and self-study than problem familiarity. On the other hand, problem familiarity had a stronger and direct impact on academic achievement

Student and tutor perceptions on attributes of effective problems in problem-based learning

This study aimed to identify the attributes that students and tutors associated with effective PBL problems, and assess the extent to which these attributes related to the actual effectiveness of problems. To this end, students and tutors in focus groups were asked to discuss about possible attributes of effective problems. The same participants were then asked to individually and independently judge eight sample problems they had worked with. Text analysis of the focus group discussion transcripts identified eleven problem attributes. Participants' judgments of the sample problems were then frequency-scored on the eleven problem attributes. Relating the participants' judgments with the entire student cohort's grades yielded high and significant correlations, suggesting that the eleven problem attributes reflect aspects of problem effectiveness