On Measuring Bias in Online Information

Bias in online information has recently become a pressing issue, with search engines, social networks and recommendation services being accused of exhibiting some form of bias. In this vision paper, we make the case for a systematic approach towards measuring bias. To this end, we discuss formal measures for quantifying the various types of bias, we outline the system components necessary for realizing them, and we highlight the related research challenges and open problems.Comment: 6 pages, 1 figur

What Makes A Court Problem-Solving: Universal Performance Indicators for Problem-Solving Justice

This report identifies a set of universal performance indicators for specialized "problem-solving courts" and related experiments in problem-solving justice. Traditional performance indicators related to caseload and processing efficiency can assist court managers in monitoring case flow, assigning cases to judges, and adhering to budgetary and statutory due process guidelines. Yet, these indicators are ultimately limited in scope. Faced with the recent explosion of problem solving courts and other experiments seeking to address the underlying problems of litigants, victims, and communities, there is an urgent need to complement traditional court performance indicators with ones of a problem-solving nature. With funding from the State Justice Institute (SJI), the Center for Court Innovation conducted an investigation designed to achieve three purposes. The first was to establish a set of universal performance indicators against which to judge the effectiveness of specialized problem-solving courts, of which there are currently more than 3,000 nationwide. The second purpose was to develop performance indicators specific to each of the four major problem-solving court models: drug, mental health, domestic violence, and community courts. The third purpose was to assist traditional court managers by establishing a more limited set of indicators, designed to capture problem-solving activity throughout the courthouse, not only within a specialized court context

Examining Collegiality and Social Justice in Academia and the Private Sector: an Exploratory SYMLOG Analysis

This research compares the perceptions of the private sector, high-technology employees to the perceptions of university faculty members regarding organizational culture, social justice and collegiality concepts. The SYMLOG assessment technique was used to record the perceptions of respondents to four different concepts of organizational culture, two different aspects of social justice and two measures of collegiality. Comparative findings of gender differences across the eight concepts raise key organizational culture, legal, measurement, governance, and social policy issues for academia and high tech organizations. The development of a conceptual framework to guide future research and a blueprint to discuss desired organizational change are highlighted

Language (Technology) is Power: A Critical Survey of "Bias" in NLP

We survey 146 papers analyzing "bias" in NLP systems, finding that their motivations are often vague, inconsistent, and lacking in normative reasoning, despite the fact that analyzing "bias" is an inherently normative process. We further find that these papers' proposed quantitative techniques for measuring or mitigating "bias" are poorly matched to their motivations and do not engage with the relevant literature outside of NLP. Based on these findings, we describe the beginnings of a path forward by proposing three recommendations that should guide work analyzing "bias" in NLP systems. These recommendations rest on a greater recognition of the relationships between language and social hierarchies, encouraging researchers and practitioners to articulate their conceptualizations of "bias"---i.e., what kinds of system behaviors are harmful, in what ways, to whom, and why, as well as the normative reasoning underlying these statements---and to center work around the lived experiences of members of communities affected by NLP systems, while interrogating and reimagining the power relations between technologists and such communities

Evaluation Framework for Water Quality Trading Programs in the Chesapeake Bay Watershed

Water quality trading programs are being proposed and implemented across the US in a variety of forms and with differing objectives. The programs being proposed and implemented in the Chesapeake Bay region are no exception. Against this background the Chesapeake Bay Program's Scientific and Technical Advisory Committee and the Mid-Atlantic Water Program requested a general framework to inform and guide the evaluation of the performance trading programs. This resulting report was developed by a workgroup comprised of ten individuals with extensive experience in the study, design, and evaluation of trading programs. While the impetus for this report was to improve evaluation of trading programs in the Chesapeake Bay region, the evaluation framework is broad enough to apply to trading programs in general

Towards the development of a resource allocation model for primary, continuing and community care in the health services - Volume 1

This report proposes a resource allocation model for the Irish health services based on the principle that each Irish resident should be provided with access to health services funded from general taxation and in proportion to their need for those services. At the moment, such a system cannot be deployed as some necessary financial information is not available. The information could be made available, and should be done as quickly as possible. If this information were made available, the model proposed here, while very crude, would serve as a good starting point for resource allocation and should be initiated as soon as possible. Any reasonable system of resource allocation would be an improvement on the system that is currently in place