7 research outputs found
Challenges to Informed Peer Review Matching Algorithms
Get PDFBACKGROUNDPeer review is a beneficial pedagogical tool. Despite the abundance of datainstructors often have about their students, most peer review matching is bysimple random assignment. In fall 2008, a study was conducted to investigatethe impact of an informed algorithmic assignment method, called Un-weightedOverall Need (UON), in a course involving Model-Eliciting Activities(MEAs). The algorithm showed no statistically significant impact on theMEA Final Response scores. A study was then conducted to examine theassumptions underlying the algorithm.PURPOSE (HYPOTHESIS)This research addressed the question: To what extent do the assumptions usedin making informed peer review matches (using the Un-weighted Overall Needalgorithim) for the peer review of solutions to Model-Eliciting Activities decay?DESIGN/METHODAn expert rater evaluated the solutions of 147 teams’ responses to a particularimplementation of MEAs in a first-year engineering course at a large mid-westresearch university. The evaluation was then used to analyze the UONalgorithm’s assumptions when compared to a randomly assigned control group.RESULTSWeak correlation was found in the five UON algorithm’s assumptions: studentscomplete assigned work, teaching assistants can grade MEAs accurately,accurate feedback in peer review is perceived by the reviewed team as beingmore helpful than inaccurate feedback, teaching assistant scores on the firstdraft of an MEA can be used to accurately predict where teams will needassistance on their second draft, and the error a peer review has in evaluating asample MEA solution is an accurate indicator of the error they will have whilesubsequently evaluating a real team’s MEA solution.CONCLUSIONSConducting informed peer review matching requires significant alignmentbetween evaluators and experts to minimize deviations from the algorithm’sdesigned purpose
Challenges to informed peer review matching algorithms
No full textBACKGROUND Peer review is a beneficial pedagogical tool. Despite the abundance of data instructors often have about their students, most peer review matching is by simple random assignment. In fall 2008, a study was conducted to investigate the impact of an informed algorithmic assignment method, called Un-weighted Overall Need (UON), in a course involving Model-Eliciting Activities (MEAs). The algorithm showed no statistically significant impact on the MEA Final Response scores. A study was then conducted to examine the assumptions underlying the algorithm. PURPOSE (HYPOTHESIS) This research addressed the question: To what extent do the assumptions used in making informed peer review matches (using the Un-weighted Overall Need algorithim) for the peer review of solutions to Model-Eliciting Activities decay? DESIGN/METHOD An expert rater evaluated the solutions of 147 teams' responses to a particular implementation of MEAs in a first-year engineering course at a large mid-west research university. The evaluation was then used to analyze the UON algorithm's assumptions when compared to a randomly assigned control group. RESULTS Weak correlation was found in the five UON algorithm's assumptions: students complete assigned work, teaching assistants can grade MEAs accurately, accurate feedback in peer review is perceived by the reviewed team as being more helpful than inaccurate feedback, teaching assistant scores on the first draft of an MEA can be used to accurately predict where teams will need assistance on their second draft, and the error a peer review has in evaluating a sample MEA solution is an accurate indicator of the error they will have while subsequently evaluating a real team's MEA solution. CONCLUSIONS Conducting informed peer review matching requires significant alignment between evaluators and experts to minimize deviations from the algorithm's designed purpose
Globalization, Governance, and the Emergence of Indigenous Autonomy Movements in Latin America: The Case of the Caribbean Coast of Nicaragua
No full textA revisiting of Salvador Marti i Puig's approach to globalization and the turn toward governance in explaining the roots and impact of the political mobilization of Latin America's indigenous peoples since the 1990s recasts governance as a disciplinary regime that in the case of Nicaragua co-opted potentially radical oppositional movements into the neoliberal project that accompanied Latin America's democratic transition. The discussion takes as its empirical case the autonomy process on Nicaragua's Caribbean coast, which in its twenty-fifth year represents the most sustained devolution of power to indigenous peoples in Latin America
