Data Literacy to Support Human-centred Machine Learning

In the past, machine learning applications were mostly developed and deployed in specialist situations where the outputs would be either read by experts, or else interpreted for the public, with the methods hidden from view. In the current data driven society, the general public are increasingly interacting with complex data sets and the outputs of machine learning technologies. Within the domain of the smart city, non-experts are also being brought closer to the design process itself. This paper explores whether improving the overall data literacy of a society can instill within that society a set of core competences that improve the capacity of non-experts in machine learning to engage with machine learning outputs in a more knowledgeable way, or to provide insight and differing perspectives into the design of machine learning applications

Co-designing opportunities for human-centred machine learning in supporting type 1 diabetes decision-making

Type 1 Diabetes (T1D) self-management requires hundreds of daily decisions. Diabetes technologies that use machine learning have significant potential to simplify this process and provide better decision support, but often rely on cumbersome data logging and cognitively demanding reflection on collected data. We set out to use co-design to identify opportunities for machine learning to support diabetes self-management in everyday settings. However, over nine months of interviews and design workshops with 15 people with T1D, we had to re-assess our assumptions about user needs. Our participants reported confidence in their personal knowledge and rejected machine learning based decision support when coping with routine situations, but highlighted the need for technological support in the context of unfamiliar or unexpected situations (holidays, illness, etc.). However, these are the situations where prior data are often lacking and drawing data-driven conclusions is challenging. Reflecting this challenge, we provide suggestions on how machine learning and other artificial intelligence approaches, e.g., expert systems, could enable decision-making support in both routine and unexpected situations

What you see is what you can change: human-centred machine learning by interactive visualization

Visual analytics (VA) systems help data analysts solve complex problems interactively, by integrating automated data analysis and mining, such as machine learning (ML) based methods, with interactive visualizations. We propose a conceptual framework that models human interactions with ML components in the VA process, and that puts the central relationship between automated algorithms and interactive visualizations into sharp focus. The framework is illustrated with several examples and we further elaborate on the interactive ML process by identifying key scenarios where ML methods are combined with human feedback through interactive visualization. We derive five open research challenges at the intersection of ML and visualization research, whose solution should lead to more effective data analysis

Human Agency in AI Configurations Supporting Organizational Decision-making

The integration of human intelligence with Artificial Intelligence (AI) is becoming increasingly essential for leveraging benefits in organizational decision-making. This necessitates to understand human-AI collaboration configurations for managing collaborative intelligence. However, existing literature on Human-AI collaboration lacks structure and is fragmented regarding what exactly human intelligence (HI) contributes to AI collaboration and how AI systems can be configured in the decision-making process. This paper undertakes an organizing literature review to consolidate insights from existing literature. We identify six types of human agency as involved in collaborative intelligence and synthesize the findings into six Human-AI collaborative configurations explained by a matrix framework. By illuminating the complexities of Human-AI collaboration, the framework sheds light on the need for a nuanced understanding of the imbricating roles of HI and AI in decision-making, with important implications for the design and implementation of AI systems for organizational decision-making

Operationalizing human-centered perspectives in explainable AI

The realm of Artificial Intelligence (AI)'s impact on our lives is far reaching - with AI systems proliferating high-stakes domains such as healthcare, finance, mobility, law, etc., these systems must be able to explain their decision to diverse end-users comprehensibly. Yet the discourse of Explainable AI (XAI) has been predominantly focused on algorithm-centered approaches, suffering from gaps in meeting user needs and exacerbating issues of algorithmic opacity. To address these issues, researchers have called for human-centered approaches to XAI. There is a need to chart the domain and shape the discourse of XAI with reflective discussions from diverse stakeholders. The goal of this workshop is to examine how human-centered perspectives in XAI can be operationalized at the conceptual, methodological, and technical levels. Encouraging holistic (historical, sociological, and technical) approaches, we put an emphasis on "operationalizing", aiming to produce actionable frameworks, transferable evaluation methods, concrete design guidelines, and articulate a coordinated research agenda for XAI