Field Evaluation with Cognitively-Impaired Older Adults of Attention Management in the Embodied Conversational Agent Louise

International audienceWe present the first experiment we conducted to evaluate the attention monitoring performance of Louise, following a Wizard of Oz method, during the interactions with a cohort of 8 elderly users in a day hospital environment. Louise is a new, semi-automatic prototype of an Embodied Conversational Agent (ECA), a virtual character interacting with users through social-like communication, adapted to the special needs of older adults with cognitive impairment; it is intended to ultimately provide assistance in their activities of daily living. We recorded and analyzed both videos of the conversation-like interactions and Louise's tracking data. In our experiment, Louise's attention estimation algorithm achieved about 80% accuracy; moreover, in almost all cases, the user's attention was successfully recaptured by Louise after a planned, experimenter-induced distraction. These results are in line with what was observed in previous experiments involving only younger adults, thus suggesting that attention measurement tools embedded in cognitive prostheses will not need to be adapted to elderly patients. Finally, to gain further insights on conversation management and provide evidence-based suggestions for future work, we performed an anthropological analysis of the whole experiment

A Virtual Agent for enhancing performance and engagement of older people with dementia in Serious Games

International audienceOlder people with dementia have many difficulties while using Serious Game for their cognitive training. Besides of the lack of game culture and a limited acceptance toward new technology, memory and cognitive disorders influence negatively also on their performance. We propose a virtual agent that can enhance performance of player using engaging strategies. We assess the efficiency of the agent compared with a therapist through an experiment with 47 older adults distributed in two groups (Mild Cognitive Impairment and Alzheimer). The experimental results report that the agent can help participants producing similar performances (score, precision, learning effect) than in the case with therapist. Moreover, participants have appreciated the agent and desired to continue playing temporarily with the agent instead of the therapist

Impact of Head Motion on the Assistive Robot Expressiveness - Evaluation with Elderly Persons

International audienceIn the near future, robots will support human to perform tasks in many domains (industrial, domestic, educational and health tasks).Such robot behaviors need to take into account the social interaction between robot and human.In this context, we focus on the expressiveness of a moving head for an assistive robot for the elderly.We designed a new moving head for the Kompaï companion robot.On one hand, this new head improves its perception capabilities.On the other hand, we expect to jointly increase its social skills and thus its acceptability.This new head is composed of a tablet to animate a virtual face according to 4 facial expressions and a mechanical neck with 4 degrees of freedom to enhance the robot's expression.Before improving face expressions and adding more complex head movements, it is essential to evaluate the combination of simple head movements with virtual face expressions. A study was held jointly with physicians (psychologists, ergonomists) at the Broca Hospital in Paris to assess the impact to combine head movements with virtual face expressions, and the global acceptability of the Kompaï head by the elderly

Value Co-Creation in Smart Services: A Functional Affordances Perspective on Smart Personal Assistants

In the realm of smart services, smart personal assistants (SPAs) have become a popular medium for value co-creation between service providers and users. The market success of SPAs is largely based on their innovative material properties, such as natural language user interfaces, machine learning-powered request handling and service provision, and anthropomorphism. In different combinations, these properties offer users entirely new ways to intuitively and interactively achieve their goals and thus co-create value with service providers. But how does the nature of the SPA shape value co-creation processes? In this paper, we look through a functional affordances lens to theorize about the effects of different types of SPAs (i.e., with different combinations of material properties) on users’ value co-creation processes. Specifically, we collected SPAs from research and practice by reviewing scientific literature and web resources, developed a taxonomy of SPAs’ material properties, and performed a cluster analysis to group SPAs of a similar nature. We then derived 2 general and 11 cluster-specific propositions on how different material properties of SPAs can yield different affordances for value co-creation. With our work, we point out that smart services require researchers and practitioners to fundamentally rethink value co-creation as well as revise affordances theory to address the dynamic nature of smart technology as a service counterpart

Impact of Head Motion on the Assistive Robot Expressiveness - Evaluation with Elderly Persons

International audienceIn the near future, robots will support human to perform tasks in many domains (industrial, domestic, educational and health tasks).Such robot behaviors need to take into account the social interaction between robot and human.In this context, we focus on the expressiveness of a moving head for an assistive robot for the elderly.We designed a new moving head for the Kompaï companion robot.On one hand, this new head improves its perception capabilities.On the other hand, we expect to jointly increase its social skills and thus its acceptability.This new head is composed of a tablet to animate a virtual face according to 4 facial expressions and a mechanical neck with 4 degrees of freedom to enhance the robot's expression.Before improving face expressions and adding more complex head movements, it is essential to evaluate the combination of simple head movements with virtual face expressions. A study was held jointly with physicians (psychologists, ergonomists) at the Broca Hospital in Paris to assess the impact to combine head movements with virtual face expressions, and the global acceptability of the Kompaï head by the elderly

Training Effects of Adaptive Emotive Responses From Animated Agents in Simulated Environments

Humans are distinct from machines in their capacity to emote, stimulate, and express emotions. Because emotions play such an important role in human interactions, human-like agents used in pedagogical roles for simulation-based training should properly reflect emotions. Currently, research concerning the development of this type of agent focuses on basic agent interface characteristics, as well as character building qualities. However, human-like agents should provide emotion-like qualities that are clearly expressed, properly synchronized, and that simulate complex, real-time interactions through adaptive emotion systems. The research conducted for this dissertation was a quantitative investigation using 3 (within) x 2 (between) x 3 (within) factorial design. A total of 56 paid participants consented to complete the study. Independent variables included emotion intensity (i.e., low, moderate, and high emotion), levels of expertise (novice participant versus experienced participant), and number of trials. Dependent measures included visual attention, emotional response towards the animated agents, simulation performance score, and learners\u27 perception of the pedagogical agent persona while participants interacted with a pain assessment and management simulation. While no relationships were indicated between the levels of emotion intensity portrayed by the animated agents and the participants\u27 visual attention, emotional response towards the animated agent, and simulation performance score, there were significant relationships between the level of expertise of the participant and the visual attention, emotional responses, and performance outcomes. The results indicated that nursing students had higher visual attention during their interaction with the animated agents. Additionally, nursing students expressed more neutral facial expression whereas experienced nurses expressed more emotional facial expressions towards the animated agents. The results of the simulation performance scores indicated that nursing students obtained higher performance scores in the pain assessment and management task than experienced nurses. Both groups of participants had a positive perception of the animated agents persona

A theoretical and practical approach to a persuasive agent model for change behaviour in oral care and hygiene

There is an increased use of the persuasive agent in behaviour change interventions due to the agent‘s features of sociable, reactive, autonomy, and proactive. However, many interventions have been unsuccessful, particularly in the domain of oral care. The psychological reactance has been identified as one of the major reasons for these unsuccessful behaviour change interventions. This study proposes a formal persuasive agent model that leads to psychological reactance reduction in order to achieve an improved behaviour change intervention in oral care and hygiene. Agent-based simulation methodology is adopted for the development of the proposed model. Evaluation of the model was conducted in two phases that include verification and validation. The verification process involves simulation trace and stability analysis. On the other hand, the validation was carried out using user-centred approach by developing an agent-based application based on belief-desire-intention architecture. This study contributes an agent model which is made up of interrelated cognitive and behavioural factors. Furthermore, the simulation traces provide some insights on the interactions among the identified factors in order to comprehend their roles in behaviour change intervention. The simulation result showed that as time increases, the psychological reactance decreases towards zero. Similarly, the model validation result showed that the percentage of respondents‘ who experienced psychological reactance towards behaviour change in oral care and hygiene was reduced from 100 percent to 3 percent. The contribution made in this thesis would enable agent application and behaviour change intervention designers to make scientific reasoning and predictions. Likewise, it provides a guideline for software designers on the development of agent-based applications that may not have psychological reactance

Gesture and Speech in Interaction - 4th edition (GESPIN 4)

International audienceThe fourth edition of Gesture and Speech in Interaction (GESPIN) was held in Nantes, France. With more than 40 papers, these proceedings show just what a flourishing field of enquiry gesture studies continues to be. The keynote speeches of the conference addressed three different aspects of multimodal interaction:gesture and grammar, gesture acquisition, and gesture and social interaction. In a talk entitled Qualitiesof event construal in speech and gesture: Aspect and tense, Alan Cienki presented an ongoing researchproject on narratives in French, German and Russian, a project that focuses especially on the verbal andgestural expression of grammatical tense and aspect in narratives in the three languages. Jean-MarcColletta's talk, entitled Gesture and Language Development: towards a unified theoretical framework,described the joint acquisition and development of speech and early conventional and representationalgestures. In Grammar, deixis, and multimodality between code-manifestation and code-integration or whyKendon's Continuum should be transformed into a gestural circle, Ellen Fricke proposed a revisitedgrammar of noun phrases that integrates gestures as part of the semiotic and typological codes of individuallanguages. From a pragmatic and cognitive perspective, Judith Holler explored the use ofgaze and hand gestures as means of organizing turns at talk as well as establishing common ground in apresentation entitled On the pragmatics of multi-modal face-to-face communication: Gesture, speech andgaze in the coordination of mental states and social interaction.Among the talks and posters presented at the conference, the vast majority of topics related, quitenaturally, to gesture and speech in interaction - understood both in terms of mapping of units in differentsemiotic modes and of the use of gesture and speech in social interaction. Several presentations explored the effects of impairments(such as diseases or the natural ageing process) on gesture and speech. The communicative relevance ofgesture and speech and audience-design in natural interactions, as well as in more controlled settings liketelevision debates and reports, was another topic addressed during the conference. Some participantsalso presented research on first and second language learning, while others discussed the relationshipbetween gesture and intonation. While most participants presented research on gesture and speech froman observer's perspective, be it in semiotics or pragmatics, some nevertheless focused on another importantaspect: the cognitive processes involved in language production and perception. Last but not least,participants also presented talks and posters on the computational analysis of gestures, whether involvingexternal devices (e.g. mocap, kinect) or concerning the use of specially-designed computer software forthe post-treatment of gestural data. Importantly, new links were made between semiotics and mocap data

Intelligent technologies for the aging brain: opportunities and challenges

Intelligent computing is rapidly reshaping healthcare. In light of the global burden of population aging and neurological disorders, dementia and elderly care are among the healthcare sectors that are most likely to benefit from this technological revolution. Trends in artificial intelligence, robotics, ubiquitous computing, neurotechnology and other branches of biomedical engineering are progressively enabling novel opportunities for technology-enhanced care. These Intelligent Assistive Technologies (IATs) open the prospects of supporting older adults with neurocognitive disabilities, maintain their independence, reduce the burden on caregivers and delay the need for long-term care (1, 2). While technology develops fast, yet little knowledge is available to patients and health professionals about the current availability, applicability, and capability of existing IATs. This thesis proposes a state-of-the-art analysis of IATs in dementia and elderly care. Our findings indicate that advances in intelligent technology are resulting in a rapidly expanding number and variety of assistive solutions for older adults and people with neurocognitive disabilities. However, our analysis identifies a number of challenges that negatively affect the optimal deployment and uptake of IATs among target users and care institutions. These include design issues, sub-optimal approaches to product development, translational barriers between lab and clinics, lack of adequate validation and implementation, as well as data security and cyber-risk weaknesses. Additionally, in virtue of their technological novelty, intelligent technologies raise a number of Ethical, Legal and Social Implications (ELSI). Therefore, a significant portion of this thesis is devoted to providing an early ethical Technology Assessment (eTA) of intelligent technology, hence contributing to preparing the terrain for its safe and ethically responsible adoption. This assessment is primarily focused on intelligent technologies at the human-machine interface, as these applications enable an unprecedented exposure of the intimate dimension of individuals to the digital infosphere. Issues of privacy, integrity, equality, and dual-use were addressed at the level of stakeholder analysis, normative ethics and human-rights law. Finally, this thesis is aimed at providing evidence-based recommendations for guiding participatory and responsible development in intelligent technology, and delineating governance strategies that maximize the clinical benefits of IATs for the aging world, while minimizing unintended risks

Do informal caregivers of people with dementia mirror the cognitive deficits of their demented patients?:A pilot study

Recent research suggests that informal caregivers of people with dementia (ICs) experience more cognitive deficits than noncaregivers. The reason for this is not yet clear. Objective: to test the hypothesis that ICs ‘mirror' the cognitive deficits of the demented people they care for. Participants and methods: 105 adult ICs were asked to complete three neuropsychological tests: letter fluency, category fluency, and the logical memory test from the WMS-III. The ICs were grouped according to the diagnosis of their demented patients. One-sample ttests were conducted to investigate if the standardized mean scores (t-scores) of the ICs were different from normative data. A Bonferroni correction was used to correct for multiple comparisons. Results: 82 ICs cared for people with Alzheimer's dementia and 23 ICs cared for people with vascular dementia. Mean letter fluency score of the ICs of people with Alzheimer's dementia was significantly lower than the normative mean letter fluency score, p = .002. The other tests yielded no significant results. Conclusion: our data shows that ICs of Alzheimer patients have cognitive deficits on the letter fluency test. This test primarily measures executive functioning and it has been found to be sensitive to mild cognitive impairment in recent research. Our data tentatively suggests that ICs who care for Alzheimer patients also show signs of cognitive impairment but that it is too early to tell if this is cause for concern or not