Slave to the Algorithm? Why a \u27Right to an Explanation\u27 Is Probably Not the Remedy You Are Looking For

Algorithms, particularly machine learning (ML) algorithms, are increasingly important to individuals’ lives, but have caused a range of concerns revolving mainly around unfairness, discrimination and opacity. Transparency in the form of a “right to an explanation” has emerged as a compellingly attractive remedy since it intuitively promises to open the algorithmic “black box” to promote challenge, redress, and hopefully heightened accountability. Amidst the general furore over algorithmic bias we describe, any remedy in a storm has looked attractive. However, we argue that a right to an explanation in the EU General Data Protection Regulation (GDPR) is unlikely to present a complete remedy to algorithmic harms, particularly in some of the core “algorithmic war stories” that have shaped recent attitudes in this domain. Firstly, the law is restrictive, unclear, or even paradoxical concerning when any explanation-related right can be triggered. Secondly, even navigating this, the legal conception of explanations as “meaningful information about the logic of processing” may not be provided by the kind of ML “explanations” computer scientists have developed, partially in response. ML explanations are restricted both by the type of explanation sought, the dimensionality of the domain and the type of user seeking an explanation. However, “subject-centric explanations (SCEs) focussing on particular regions of a model around a query show promise for interactive exploration, as do explanation systems based on learning a model from outside rather than taking it apart (pedagogical versus decompositional explanations) in dodging developers\u27 worries of intellectual property or trade secrets disclosure. Based on our analysis, we fear that the search for a “right to an explanation” in the GDPR may be at best distracting, and at worst nurture a new kind of “transparency fallacy.” But all is not lost. We argue that other parts of the GDPR related (i) to the right to erasure ( right to be forgotten ) and the right to data portability; and (ii) to privacy by design, Data Protection Impact Assessments and certification and privacy seals, may have the seeds we can use to make algorithms more responsible, explicable, and human-centered

The Application of Design Thinking on Evaluating a User Self-Service Data Analytics/Science Platform

This thesis is aimed at utilising design thinking and the first half of the double diamond framework to i) set-up a research and select the appropriate participants, ii) gather requirements and define user personas from those eligible participants, and then iii) define the framework for evaluating a user self-service data analytics/science platform. Derived from the author’s own experiences, both as a Business Analyst (BA) and Citizen Data Scientist, with no-, low-, and code-based data analytics and science platforms are being implemented for enabling user self-service analytics – for users who are completely new to the space of data analysis and science as well as those who are experienced analysts and data scientists across a variety of industries and global regions – and there has been a need to outline an enablement process for this space. Through this research, the current state of the marketplace is researched, analysed, and evaluated alongside user research carried out on the feasibility and applicability of a UI- and UX-centric framework for ensuring human-centred design. A literature review showcases the benefits of human-centred design for humans when it comes to usability and techniques for such an application in various other fields. The key aspects of this research are to understand the users’ capabilities, needs, and wants, then categorise those users into personas, analyse and segment the requirements, create functional and non-functional requirements for platform capabilities, and then, ultimately, provide an evaluation framework for any organisation and/or individual looking for a user self-service data analytics/science platform by carrying out a pilot research study on ten (10) participants

Opportunities and barriers for adoption of a decision-support tool for Alzheimer's Disease

Clinical decision-support tools (DSTs) represent a valuable resource in healthcare. However, lack of Human Factors considerations and early design research has often limited their successful adoption. To complement previous technically focused work, we studied adoption opportunities of a future DST built on a predictive model of Alzheimer’s Disease (AD) progression. Our aim is two-fold: exploring adoption opportunities for DSTs in AD clinical care, and testing a novel combination of methods to support this process. We focused on understanding current clinical needs and practices, and the potential for such a tool to be integrated into the setting, prior to its development. Our user-centred approach was based on field observations and semi-structured interviews, analysed through workflow analysis, user profiles, and a design-reality gap model. The first two are common practice, whilst the latter provided added value in highlighting specific adoption needs. We identified the likely early adopters of the tool as being both psychiatrists and neurologists based in research-oriented clinical settings. We defined ten key requirements for the translation and adoption of DSTs for AD around IT, user, and contextual factors. Future works can use and build on these requirements to stand a greater chance to get adopted in the clinical setting

Methodological development

Book description: Human-Computer Interaction draws on the fields of computer science, psychology, cognitive science, and organisational and social sciences in order to understand how people use and experience interactive technology. Until now, researchers have been forced to return to the individual subjects to learn about research methods and how to adapt them to the particular challenges of HCI. This is the first book to provide a single resource through which a range of commonly used research methods in HCI are introduced. Chapters are authored by internationally leading HCI researchers who use examples from their own work to illustrate how the methods apply in an HCI context. Each chapter also contains key references to help researchers find out more about each method as it has been used in HCI. Topics covered include experimental design, use of eyetracking, qualitative research methods, cognitive modelling, how to develop new methodologies and writing up your research

Strengths and Weaknesses of Persona Creation Methods:Guidelines and Opportunities for Digital Innovations

Persona is a technique for enhancing user understanding and improving the user-centered design of digital products. Persona creation has traditionally been divided into Qualitative, Quantitative, and Mixed Methods approaches. However, no literature systematically contrasts the strengths and weaknesses of these approaches. We review the literature to map the strengths and weaknesses of these approaches and evaluate the potential of personas for the domain of digital innovation. We provide insights for better creation and use of personas by both researchers and practitioners, especially those that are new to personas, deploying personas in a new domain, or familiar with only one of the persona creation approaches

The Student Advice Recommender Agent: SARA

Abstract: SARA, the Student Advice Recommender Agent is a system somewhat like an early alert system, where predictive models of learners' success combined with incremental data on learners' activity in a course can be used to identify students in academic distress. With SARA, rather than give alerts to academic advisors or professors, we provide personalized advice directly to students. An advice string -"A note from SARA" is prepared for each student every week in a semester-long course. The system attempts to direct students to appropriate learning supports and resources according to their individual needs. We have observed a significant year over year improvement in unadjusted student grades after the SARA's advice recommender was implemented in a 1200-student freshman STEM course

Information Design for Personas in Four Professional Domains of User Experience Design, Healthcare, Market Research, and Social Media Strategy

Practitioners in user-centric industries have increasingly recognized the applicability of personas. However, the methods used to create personas in different domains remain inconsistent and unsystematic. We analyzed 51 studies focused on designing personas for professional purposes and found the practice most prevalent in the user experience design, healthcare, market research, and social media strategy domains. Within these domains, user experience design personas are characterized by their focus on user activity goals, health personas on medical patients’ physical symptoms, market research personas on customers’ lifestyles, and social media strategy personas on interactions within and between online communities. We identify and compare the elements in the personas. Based on these, we provide guidelines for professionals interested in developing personas for understanding barriers to positive user experience, recruiting users, and building online communities, including how to represent persona details related to lifestyle and health, contexts of product usage, and scaling of online data

How to Create Personas: Three Persona Creation Methodologies with Implications for Practical Employment

Background: Personas are a technique for enhanced understanding of users and customers to improve the user-centered design of systems and products. Their creation can be categorized using three persona creation methodologies: Qualitative, Quantitative, and Mixed Methods. Despite the apparent differences in these methodologies, no previous review has systemically compared and contrasted the strengths and weaknesses of each of these methodologies for persona development. Method: This manuscript maps and navigates persona literature to identify the benefits and challenges of these three persona creation methodologies. Furthermore, the strategies and opportunities of the different methodologies are presented. Results: The results summarize the strengths and weaknesses of each of the three principal persona creation methodologies and offer suggestions of the benefits of their employment. Conclusion: In conclusion, we offer insights into the construction and usage of personas for practitioners and researchers, and we propose a framework to determine which persona creation methodology is most suitable for a given context. Keywords: Algorithmically-Generated Personas, Persona Analytics, Persona Science