Human-Agent Experience Sharing: Creating Social Agents for Elderly People with Dementia

As intelligent technology steadily becomes a part of modern societies, people collaborate with agents more frequently, and so agents need to be socially intelligent, i.e. personalised and context-sensitive. This paper introduces a context-sen-sitive personalisation framework for social agents that fa-cilitates the establishment of human-agent relationships by sharing past experiences through personal conversation, and sharing new experiences by engaging in joint activities together. We apply the framework in a robot application for the dementia care practice: ReJAM - Robots engaging El-derly in Joint Activities with Music.Interactive Intelligenc

On the Effects of Team Size and Communication Load on the Performance in Exploration Games

Exploration games are games where agents (or robots) need to search resources and retrieve these resources. In principle, performance in such games can be improved either by adding more agents or by exchanging more messages. However, both measures are not free of cost and it is important to be able to assess the trade-off between these costs and the potential performance gain. The focus of this paper is on improving our understanding of the performance gain that can be achieved either by adding more agents or by increasing the communication load. Performance gain moreover is studied by taking several other important factors into account such as environment topology and size, resource-redundancy, and task size. Our results suggest that there does not exist a decision function that dominates all other decision functions, i.e. is optimal for all conditions. Instead we find that (i) for different team sizes and communication strategies different agent decision functions perform optimal, and that (ii) optimality of decision functions also depends on environment and task parameters. We also find that it pays off to optimize for environment topologies.Interactive Intelligenc

Detecting Work Stress in Offices by Combining Unobtrusive Sensors

Employees often report the experience of stress at work. In the SWELL project we investigate how new context aware pervasive systems can support knowledge workers to diminish stress. The focus of this paper is on developing automatic classifiers to infer working conditions and stress related mental states from a multimodal set of sensor data (computer logging, facial expressions, posture and physiology). We address two methodological and applied machine learning challenges: 1) Detecting work stress using several (physically) unobtrusive sensors, and 2) Taking into account individual differences. A comparison of several classification approaches showed that, for our SWELL-KW dataset, neutral and stressful working conditions can be distinguished with 90 percent accuracy by means of SVM. Posture yields most valuable information, followed by facial expressions. Furthermore, we found that the subjective variable 'mental effort' can be better predicted from sensor data than, e.g., 'perceived stress'. A comparison of several regression approaches showed that mental effort can be predicted best by a decision tree (correlation of 0.82). Facial expressions yield most valuable information, followed by posture. We find that especially for estimating mental states it makes sense to address individual differences. When we train models on particular subgroups of similar users, (in almost all cases) a specialized model performs equally well or better than a generic model.Accepted Author ManuscriptInteractive Intelligenc

Natural language processing for cognitive therapy: Extracting schemas from thought records

The cognitive approach to psychotherapy aims to change patients’ maladaptive schemas, that is, overly negative views on themselves, the world, or the future. To obtain awareness of these views, they record their thought processes in situations that caused pathogenic emotional responses. The schemas underlying such thought records have, thus far, been largely manually identified. Using recent advances in natural language processing, we take this one step further by automatically extracting schemas from thought records. To this end, we asked 320 healthy participants on Amazon Mechanical Turk to each complete five thought records consisting of several utterances reflecting cognitive processes. Agreement between two raters on manually scoring the utterances with respect to how much they reflect each schema was substantial (Cohen’s κ = 0.79). Natural language processing software pretrained on all English Wikipedia articles from 2014 (GLoVE embeddings) was used to represent words and utterances, which were then mapped to schemas using k-nearest neighbors algorithms, support vector machines, and recurrent neural networks. For the more frequently occurring schemas, all algorithms were able to leverage linguistic patterns. For example, the scores assigned to the Competence schema by the algorithms correlated with the manually assigned scores with Spearman correlations ranging between 0.64 and 0.76. For six of the nine schemas, a set of recurrent neural networks trained separately for each of the schemas outperformed the other algorithms. We present our results here as a benchmark solution, since we conducted this research to explore the possibility of automatically processing qualitative mental health data and did not aim to achieve optimal performance with any of the explored models. The dataset of 1600 thought records comprising 5747 utterances is published together with this article for researchers and machine learning enthusiasts to improve upon our outcomes. Based on our promising results, we see further opportunities for using free-text input and subsequent natural language processing in other common therapeutic tools, such as ecological momentary assessments, automated case conceptualizations, and, more generally, as an alternative to mental health scales.Interactive Intelligenc

The influence of interdependence and a transparent or explainable communication style on human-robot teamwork

Humans and robots are increasingly working together in human-robot teams. Teamwork requires communication, especially when interdependence between team members is high. In previous work, we identified a conceptual difference between sharing what you are doing (i.e., being transparent) and why you are doing it (i.e., being explainable). Although the second might sound better, it is important to avoid information overload. Therefore, an online experiment (n = 72) was conducted to study the effect of communication style of a robot (silent, transparent, explainable, or adaptive based on time pressure and relevancy) on human-robot teamwork. We examined the effects of these communication styles on trust in the robot, workload during the task, situation awareness, reliance on the robot, human contribution during the task, human communication frequency, and team performance. Moreover, we included two levels of interdependence between human and robot (high vs. low), since mutual dependency might influence which communication style is best. Participants collaborated with a virtual robot during two simulated search and rescue tasks varying in their level of interdependence. Results confirm that in general robot communication results in more trust in and understanding of the robot, while showing no evidence of a higher workload when the robot communicates or adds explanations to being transparent. Providing explanations, however, did result in more reliance on RescueBot. Furthermore, compared to being silent, only being explainable results a higher situation awareness when interdependence is high. Results further show that being highly interdependent decreases trust, reliance, and team performance while increasing workload and situation awareness. High interdependence also increases human communication if the robot is not silent, human rescue contribution if the robot does not provide explanations, and the strength of the positive association between situation awareness and team performance. From these results, we can conclude that robot communication is crucial for human-robot teamwork, and that important differences exist between being transparent, explainable, or adaptive. Our findings also highlight the fundamental importance of interdependence in studies on explainability in robots.Interactive Intelligenc

Addressing people’s current and future states in a reinforcement learning algorithm for persuading to quit smoking and to be physically active

Behavior change applications often assign their users activities such as tracking the number of smoked cigarettes or planning a running route. To help a user complete these activities, an application can persuade them in many ways. For example, it may help the user create a plan or mention the experience of peers. Intuitively, the application should thereby pick the message that is most likely to be motivating. In the simplest case, this could be the message that has been most effective in the past. However, one could consider several other elements in an algorithm to choose a message. Possible elements include the user’s current state (e.g., self-efficacy), the user’s future state after reading a message, and the user’s similarity to the users on which data has been gathered. To test the added value of subsequently incorporating these elements into an algorithm that selects persuasive messages, we conducted an experiment in which more than 500 people in four conditions interacted with a text-based virtual coach. The experiment consisted of five sessions, in each of which participants were suggested a preparatory activity for quitting smoking or increasing physical activity together with a persuasive message. Our findings suggest that adding more elements to the algorithm is effective, especially in later sessions and for people who thought the activities were useful. Moreover, while we found some support for transferring knowledge between the two activity types, there was rather low agreement between the optimal policies computed separately for the two activity types. This suggests limited policy generalizability between activities for quitting smoking and those for increasing physical activity. We see our results as supporting the idea of constructing more complex persuasion algorithms. Our dataset on 2,366 persuasive messages sent to 671 people is published together with this article for researchers to build on our algorithm.Interactive Intelligenc

Human Values for Responsible Decision-Support for Fire Services

Artificial Intelligence systems are more and more being introduced into first response; however, this introduction needs to be done responsibly. While generic claims on what this entails already exist, more details are required to understand the exact nature of responsible application of AI within the first response domain. The context in which AI systems are applied largely determines the ethical, legal, and societal impact and how to deal with this impact responsibly. For that reason, we empirically investigate relevant human values that are affected by the introduction of a specific AI-based Decision Aid (AIDA), a decision support system under development for Fire Services in the Netherlands. We held 10 expert group sessions and discussed the impact of AIDA on different stakeholders. This paper presents the design and implementation of the study and, as we are still in process of analyzing the sessions in detail, summarizes preliminary insights and steps forward.Interactive Intelligenc

Health Literature Hybrid AI for Health Improvement: A Design Analysis for Diabetes & Hypertension

Increasingly, front runner patients and practitioners want to use state-of-the-art science for rapid lifestyle based cure of diseases of affluence. However, the number of new health studies per year (>500.000) is overwhelming. How to quickly assess state-of-the-art and use new opportunities for rapid patient DIY (Do-It-Yourself) health improvement? In order to develop a health literature hybrid AI to aid DIY rapid health improvement, we analyze user side functional requirements. A cross case design analysis is conducted for hypertension and T2D (Type 2 Diabetes), two major cardiometabolic conditions in our society. Our analysis shows that current DIY health support is ‘watered down’ advise, prone to medicalizing rather than empowering patients. We propose hybrid AI user requirements and discuss how a 2030 hybrid AI health support system can stimulate new ways of working in health and cure.Green Open Access added to TU Delft Institutional Repository ‘You share, we take care!’ – Taverne project https://www.openaccess.nl/en/you-share-we-take-care Otherwise as indicated in the copyright section: the publisher is the copyright holder of this work and the author uses the Dutch legislation to make this work public.Interactive Intelligenc

An Iterative Interaction-Design Method for Multi-Modal Robot Communication

The design space of human-robot interaction is large and multi-dimensional. A sound design requires a systematic theory-driven exploration, specification and refinement of design variables. There is a need for a practical method and tool to iteratively specify the content of the dialogue (e.g., speech acts) with the accompanying expressive behavior (e.g., gesture openness) as prescribed by social science theory, e.g., task- and person-oriented communication. This paper presents an iterative interaction-design (ID) method for multi-modal robot communication. Following the ID-method, a designer first creates his/her own individual design and, subsequently, provides an iteration to the evolving iterative design. To support the design method, we developed an ID-tool (available for download). The tool support entails (a) selecting the theory-based communication style; (b) creating and linking the dialogue act components for the concerning use case; and (c) setting the associated expression parameters. We conducted a study with Industrial Design students (N=13) who followed the ID-method and used our tool to design person- and task-oriented communications for a reception robot. Our method produced distinctive task- and person-oriented dialogue styles, i.e., provided the predicted theory-based multi-modal communicative behaviors. The task-oriented style showed a more formal, shorter and less chatty communication. Overall, there was a rather smooth design convergence process, in which the individual designs were harmonized into the iterative design. For the selected design problem, the ID-tool had a satisfactory usability. Next steps include validation of the communication styles in an empirical study and, subsequently, identification of reusable design patterns.Virtual/online event due to COVID-19Interactive Intelligenc