The Intuitive Appeal of Explainable Machines

Algorithmic decision-making has become synonymous with inexplicable decision-making, but what makes algorithms so difficult to explain? This Article examines what sets machine learning apart from other ways of developing rules for decision-making and the problem these properties pose for explanation. We show that machine learning models can be both inscrutable and nonintuitive and that these are related, but distinct, properties. Calls for explanation have treated these problems as one and the same, but disentangling the two reveals that they demand very different responses. Dealing with inscrutability requires providing a sensible description of the rules; addressing nonintuitiveness requires providing a satisfying explanation for why the rules are what they are. Existing laws like the Fair Credit Reporting Act (FCRA), the Equal Credit Opportunity Act (ECOA), and the General Data Protection Regulation (GDPR), as well as techniques within machine learning, are focused almost entirely on the problem of inscrutability. While such techniques could allow a machine learning system to comply with existing law, doing so may not help if the goal is to assess whether the basis for decision-making is normatively defensible. In most cases, intuition serves as the unacknowledged bridge between a descriptive account and a normative evaluation. But because machine learning is often valued for its ability to uncover statistical relationships that defy intuition, relying on intuition is not a satisfying approach. This Article thus argues for other mechanisms for normative evaluation. To know why the rules are what they are, one must seek explanations of the process behind a model’s development, not just explanations of the model itself

On The Impact of Machine Learning Randomness on Group Fairness

Statistical measures for group fairness in machine learning reflect the gap in performance of algorithms across different groups. These measures, however, exhibit a high variance between different training instances, which makes them unreliable for empirical evaluation of fairness. What causes this high variance? We investigate the impact on group fairness of different sources of randomness in training neural networks. We show that the variance in group fairness measures is rooted in the high volatility of the learning process on under-represented groups. Further, we recognize the dominant source of randomness as the stochasticity of data order during training. Based on these findings, we show how one can control group-level accuracy (i.e., model fairness), with high efficiency and negligible impact on the model's overall performance, by simply changing the data order for a single epoch.Comment: 10 pages + Appendi

A descriptive and evaluative bibliography of mathematics filmstrips.

Submitted by A.W. Clark and R.W. Allen for the degree of Master of Arts and by C.H. Gardner and R.F. Sweeney for the degree of Master of Education. Thesis (Ed.M.)--Boston UniversityThe purpose of this paper is to present in one volume (1) a bibliography of all mathematics filmstrips from those suitable for the first grade to those suitable for use in senior high school and college, (2) an accurate description of each filmstrip, and (3) unbiased evaluations of each filmstrip by qualified teachers invited to take part in the project. Concomitant problems. The foregoing three parts were the heart of the problem and the portion nearly completely solved. There were, however, concomitant problems which have been partially solved by this work. The first of these concerns the limited use of filmstrips by mathematics teachers. Undoubtedly many do not believe in using filmstrips in mathematics classes. Others have never given serious thought about the advisability of using filmstrips. In later sections of this chapter and throughout this work evidence is cited to support the contention that filmstrips should have serious consideration, and that they are useful in mathematics classes. The second concomitant problem concerns the revision of current filmstrips and production of new ones. The filmstrip producers were supplied, upon their request, with summaries of the evaluations. Summaries were supplied only at the producer's request; for unless they were interested enough to request the summaries, they probably would not be interested in changing or improving their filmstrips. Summary. The problem, then, had three major parts: listing , describing, and evaluating mathematics filmstrips, and two concomitant parts: arousing the mathematics teacher's interest in filmstrips, and encouraging producers to make better productions and necessary revisions in current productions. [TRUNCATED

Low-level support for socially isolated older people: An evaluation of telephone befriending

In May 2005 Help the Aged and Zurich Community Trust launched a two year national programme ‘A Call in Time’. The purpose of the programme was to provide low level support and befriending services via the telephone to older people who are lonely, isolated or vulnerable. Eight projects were funded across the country. Following the launch of the programme, Help the Aged commissioned the Centre for Health Promotion Research at Leeds Metropolitan University to undertake an evaluation of the programme and to investigate the direct impact of low level support on older people who are vulnerable, isolated or lonely using the telephone as a specific tool of befriending. The main objectives of the evaluation were to: * Measure and identify the effectiveness of telephone befriending services for older people with regards to their mental and physical well-being and their quality of life and the extent to which services were of preventive value. * Examine the components parts of each model of telephone befriending and identify ‘models of good practice’. All eight telephone befriending schemes functioning within a variety of different parameters were included in the evaluation. The participants in this research included project co-ordinators, project volunteers and older people who were in receipt of the services

The indicators of pupil opinion and teacher interactivity for inquiry-based science teaching

In order to establish those practices which underpin a science teaching performance that combines pupil enthusiasm and creative classrooms, it will be necessary to uncover evidence of inquiry-based learning experiences in science that can provide a warrant for theory and practice that will assist new science teachers in recognising and developing opportunities for investigative activity. Remaining aware, however, of the recurring theme in contemporary educational research which suggests that learning to teach has an important affective dimension associated with developing relationships and the formation of a teaching identity – a model of development which thus transcends atheoretical checklists of professional standards or pedagogical steps – the nature of that evidence will necessarily be in the area of the formative development of new teachers’ professional knowledge and understanding

Whose outcomes are they anyway? Report of the pilot evaluation of a joint service\ud

Health and social care partnership working is often predicated on the notion that it improves outcomes for service users. Yet there is a lack of evidence linking partnerships to changes in outcomes. Against this background, the Health Services Management Centre at the University of Birmingham designed the Partnership Outcomes Evaluation Toolkit (POET) specifically to evaluate health and social care partnerships in terms of service user outcomes. This paper reports on the field testing of POET with Sandwell Integrated Support Service. This research provided a number of interesting insights into this service, and indicated some dissonance between staff and service user and carer expectations

Youth and Digital Media: From Credibility to Information Quality

Building upon a process-and context-oriented information quality framework, this paper seeks to map and explore what we know about the ways in which young users of age 18 and under search for information online, how they evaluate information, and how their related practices of content creation, levels of new literacies, general digital media usage, and social patterns affect these activities. A review of selected literature at the intersection of digital media, youth, and information quality -- primarily works from library and information science, sociology, education, and selected ethnographic studies -- reveals patterns in youth's information-seeking behavior, but also highlights the importance of contextual and demographic factors both for search and evaluation. Looking at the phenomenon from an information-learning and educational perspective, the literature shows that youth develop competencies for personal goals that sometimes do not transfer to school, and are sometimes not appropriate for school. Thus far, educational initiatives to educate youth about search, evaluation, or creation have depended greatly on the local circumstances for their success or failure