Does participation improve project performance : establishing causality with subjective data

Development practitioners are coming to a consensus that participation by the intended beneficiaries improves project performance. But is there convincing evidence that this is true? Skeptics have three objections: 1)"Participation is not objective -- project rankings are subjective; 2) this subjectivity leads to"halo effects"; 3) better project performance may have increased beneficiary participation rather than the other way around -- a statistical association is not proof of cause and effect. The authors show methodologically how to answer each of these objections. Subjectivity does not preclude reliable cardinal measurement. Halo effects do not appear to induce a strong upward bias in estimating the effect of participation. Finally, instrumental variables estimation can help establish a structural cause and effect relationship between participation and project performance -- at least in the rural water supply projects they studied.Governance Indicators,ICT Policy and Strategies,Health Economics&Finance,Statistical&Mathematical Sciences,Poverty Monitoring&Analysis

Problems and Promises of Using LMS Learner Analytics for Assessment: Case Study of a First-Year English Program

Learning management systems (LMS) are widely used in education. They offer the potential for assessing student learning, but the reality of using them for this is problematic. This case study chronicles efforts by librarians at Marquette University to use LMS data to assess students’ information literacy knowledge in Marquette’s first-year English program

Checking the fact-checkers in 2008: predicting political ad scrutiny and assessing consistency

Which types of political ads are most likely to draw criticism from fact-checkers? Are fact-checkers consistent in their evaluations of political ads? Examining general election television ads from the 2008 U.S. presidential race, and based upon the evaluations of FactCheck.org, PolitiFact.com, and the Washington Post's Fact Checker, this study demonstrates it was the attack ads from candidates that were most likely to draw scrutiny from the fact-checkers. Most importantly, a high level of agreement between the fact-checkers indicates their success at selecting political claims that can be consistently evaluated. While political advertisers are increasingly using evidence to support their claims, what may be more critical in drawing evaluations from fact-checkers is the verifiability of a claim. The implications of consistent fact-checking on the public, political actors, journalism and democracy are discussed. With the revelation that fact-checking can be consistently practiced, localized efforts at fact-checking need encouragement, particularly as political TV ads increasingly drown out other potential sources of information for the public and increasingly are used in downballot races, local initiatives, referendums and judicial races

Using Argument-based Features to Predict and Analyse Review Helpfulness

We study the helpful product reviews identification problem in this paper. We observe that the evidence-conclusion discourse relations, also known as arguments, often appear in product reviews, and we hypothesise that some argument-based features, e.g. the percentage of argumentative sentences, the evidences-conclusions ratios, are good indicators of helpful reviews. To validate this hypothesis, we manually annotate arguments in 110 hotel reviews, and investigate the effectiveness of several combinations of argument-based features. Experiments suggest that, when being used together with the argument-based features, the state-of-the-art baseline features can enjoy a performance boost (in terms of F1) of 11.01\% in average.Comment: 6 pages, EMNLP201

A History of the English Department of Fort Hays State University (1902-1978)

This volume is comprehensive history of the Fort Hays State University English Department from it\u27s inception until 1978. It includes histories on faculty, faculty works, and general University history.https://scholars.fhsu.edu/fort_hays_studies_series/1071/thumbnail.jp

Using Argument-based Features to Predict and Analyse Review Helpfulness

We study the helpful product reviews identification problem in this paper. We observe that the evidence-conclusion discourse relations, also known as arguments, often appear in product reviews, and we hypothesise that some argument-based features, e.g. the percentage of argumentative sentences, the evidences-conclusions ratios, are good indicators of helpful reviews. To validate this hypothesis, we manually annotate arguments in 110 hotel reviews, and investigate the effectiveness of several combinations of argument-based features. Experiments suggest that, when being used together with the argument-based features, the state-of-the-art baseline features can enjoy a performance boost (in terms of F1) of 11.01\% in average.Comment: 6 pages, EMNLP201

Is There a Heaven for a Gangsta? : Hip Hop, Spirituality, and Heaven

A content analysis was conducted on the lyrics of 24 Hip Hop songs to identify how Black male Hip Hop artists discuss heaven. The songs were released between 1993 and 2015 and phenomenology was the theoretical foundation on which the themes were identified. I propose that Black Hip Hop artists create a heaven that reflects their own experiences, values, and traditions, envision a heaven where the weak and oppressed receive vindication from the indignities suffered on earth as well as a way to connect with dead loved ones. Essentially, Black Hip Hop artists’ expressions of heaven acknowledge racial experiences, demonstrates their belief in God and/or a Higher Power, as well as their need to communicate with God and/or a Higher Power. Furthermore, Black male Hip Hop artists’ expressions of heaven highlight their need to seek the direction of God and/or a Higher Power, motivates them to create positive change in their communities, and perceive heaven and/or the afterlife in ways that are based on their earthly relationships and experiences. This study was led by the following two questions: (1) How is heaven described by Black male artists in Hip Hop? (2) How do Black male Hip Hop artists conceptualizations of heaven shape their perceptions of earthly experiences? An analysis of the 24 Hip Hop lyrics revealed Black male Hip Hop artists described heaven in the following five ways: (a) Heaven as Superior to Earth; (b) Heaven as the Ultimate Reward; (c) Heaven as Reunification with Loved Ones; (d) Heaven as Segregated; (e) Heaven as Synonymous with Sensual Love. Qualitative examples are provided to support each of the aforementioned themes

Reputation Agent: Prompting Fair Reviews in Gig Markets

Our study presents a new tool, Reputation Agent, to promote fairer reviews from requesters (employers or customers) on gig markets. Unfair reviews, created when requesters consider factors outside of a worker's control, are known to plague gig workers and can result in lost job opportunities and even termination from the marketplace. Our tool leverages machine learning to implement an intelligent interface that: (1) uses deep learning to automatically detect when an individual has included unfair factors into her review (factors outside the worker's control per the policies of the market); and (2) prompts the individual to reconsider her review if she has incorporated unfair factors. To study the effectiveness of Reputation Agent, we conducted a controlled experiment over different gig markets. Our experiment illustrates that across markets, Reputation Agent, in contrast with traditional approaches, motivates requesters to review gig workers' performance more fairly. We discuss how tools that bring more transparency to employers about the policies of a gig market can help build empathy thus resulting in reasoned discussions around potential injustices towards workers generated by these interfaces. Our vision is that with tools that promote truth and transparency we can bring fairer treatment to gig workers.Comment: 12 pages, 5 figures, The Web Conference 2020, ACM WWW 202

Event-based media monitoring methodology for Human Rights Watch

Executive Summary This report, prepared by a team of researchers from the University of Minnesota for Human Rights Watch (HRW), investigates the use of event-based media monitoring (EMM) to review its application, identify its strengths and weaknesses, and offer suggestions on how HRW can better utilize EMM in its own work. Media monitoring systems include both human-operated (manual) and automated systems, both of which we review throughout the report. The process begins with the selection of news sources, proceeds to the development of a coding manual (for manual searches) or “dictionary” (for automated searches), continues with gathering data, and concludes with the coding of news stories. EMM enables the near real-time tracking of events reported by the media, allowing researchers to get a sense of the scope of and trends in an event, but there are limits to what EMM can accomplish on its own. The media will only cover a portion of a given event, so information will always be missing from EMM data. EMM also introduces research biases of various kinds; mitigating these biases requires careful selection of media sources and clearly defined coding manuals or dictionaries. In manual EMM, coding the gathered data requires human researchers to apply codebook rules in order to collect consistent data from each story they read. In automated EMM, computers apply the dictionary directly to the news stories, automatically picking up the desired information. There are trade-offs in each system. Automated EMM can code stories far more quickly, but the software may incorrectly code stories, requiring manual corrections. Conversely, manual EMM allows for a more nuanced analysis, but the investment of time and effort may diminish the tool’s utility. We believe that both manual and automated EMM, when deployed correctly, can effectively support human rights research and advocacy