Calculating the random guess scores of multiple-response and matching test items

For achievement tests, the guess score is often used as a baseline for the lowest possible grade for score to grade transformations and setting the cut scores. For test item types such as multiple-response, matching and drag-and-drop, determin-ing the guess score requires more elaborate calculations than the more straight-forward calculation of the guess score for True-False and multiple-choice test item formats. For various variants of multiple-response and matching types with respect to dichotomous and polytomous scoring, methods for determining the guess score are presented and illustrated with practical applications. The implica-tions for theory and practice are discussed

The Impact of a SIG on Assessment Literacy

A major aim of professional associations is to provide opportunities for professionals to interact with others, share ideas and develop in their chosen profession. Professional associations exist to provide specialized networking and development opportunities to a specific profession, group of individuals or field of study. To promote and support specialized research and communication, smaller subgroups within an association are often chartered or developed. These subgroups are typically known as Special Interest Groups. According to Jacob et al. (2013), association members join SIGs because they want to go deeper into a specialized content area and they enjoy networking with others who ‘speak the same language.’ The TESOL Arabia Testing, Assessment and Evaluation SIG (TAE SIG) has focused their professional development activities on an important trend in the field, that of language assessment literacy (LAL). Language assessment literacy has been a critical topic in English language teaching since the late 1990s. Unfortunately, this is mainly due to the fact that so many English language teachers are not assessment literate. In other words, many English language teachers lack the knowledge and skills to write effective language tests, evaluate the effectiveness of their tests, and use their test results in meaningful ways. The purpose of this chapter is to critically examine the status of LAL in the Middle East and North Africa (MENA) region and report on activities that the TAE SIG has implemented to increase LAL

Boundaries of Semantic Distraction: Dominance and Lexicality Act at Retrieval

Three experiments investigated memory for semantic information with the goal of determining boundary conditions for the manifestation of semantic auditory distraction. Irrelevant speech disrupted the free recall of semantic category-exemplars to an equal degree regardless of whether the speech coincided with presentation or test phases of the task (Experiment 1) and occurred regardless of whether it comprised random words or coherent sentences (Experiment 2). The effects of background speech were greater when the irrelevant speech was semantically related to the to-be-remembered material, but only when the irrelevant words were high in output dominance (Experiment 3). The implications of these findings in relation to the processing of task material and the processing of background speech is discussed