Modelling the influence of cultural information on vision-based human home activity recognition

Daily life activities, such as eating and sleeping, are deeply influenced by a person's culture, hence generating differences in the way a same activity is performed by individuals belonging to different cultures. We argue that taking cultural information into account can improve the performance of systems for the automated recognition of human activities. We propose four different solutions to the problem and present a system which uses a Naive Bayes model to associate cultural information with semantic information extracted from still images. Preliminary experiments with a dataset of images of individuals lying on the floor, sleeping on a futon and sleeping on a bed suggest that: i) solutions explicitly taking cultural information into account are more accurate than culture-unaware solutions; and ii) the proposed system is a promising starting point for the development of culture-aware Human Activity Recognition methods

Culturally-Competent Human-Robot Verbal Interaction

The article describes a system for culture-aware human-robot verbal interaction, that constitutes the basis for designing culturally-competent robots for health-care, i.e., robots able to autonomously re–configure their way of acting and speaking, when offering a service, to match the culture, customs, and etiquette of the person they are asstisting. The article shows how culture-aware verbal interaction is tightly related to cultural knowledge representation and acquisition, by describing the methodological and technological solutions adopted, and showing in details one of the preliminary experiments performed to design a culturally-competent robot

Knowledge representation for culturally competent personal robots: requirements, design principles, implementation, and assessment

Culture, intended as the set of beliefs, values, ideas, language, norms and customs which compose a person’s life, is an essential element to know by any robot for personal assistance. Culture, intended as that person’s background, can be an invaluable source of information to drive and speed up the process of discovering and adapting to the person’s habits, preferences and needs. This article discusses the requirements posed by cultural competence on the knowledge management system of a robot. We propose a framework for cultural knowledge representation that relies on (i) a three layer ontology for storing concepts of relevance, culture specific information and statistics, person-specific information and preferences; (ii) an algorithm for the acquisition of person-specific knowledge, which uses culture specific knowledge to drive the search; (iii) a Bayesian Network for speeding up the adaptation to the person by propagating the effects of acquiring one specific information onto interconnected concepts. We have conducted a preliminary evaluation of the framework involving 159 Italian and German volunteers and considering 122 among habits, attitudes and social norms

A Cloud-Based Scene Recognition framework for In-Home Assistive Robot

The rapidly increasing number of elderly people has led to the development of in-home assistive robots for assisting and monitoring elderly people in their daily life. To these ends, indoor scene and human activity recognition is fundamental. However, image processing is an expensive process, in computational, energy, storage and pricing terms, which can be problematic for consumer robots. For this reason, we propose the use of computer vision cloud services and a Naive Bayes model to perform indoor scene and human daily activity recognition. We implement the developed method on the telepresence robot Double to make it autonomously find and approach the person in the environment as well as detect the performed activity

Knowledge Representation for Culturally Competent Personal Robots - Requirement, design principles, implementation, and assessment

Culture, intended as the set of beliefs, values, ideas, language, norms and customs which compose a person\u2019s life, is an essential element to know by any robot for personal assistance. Culture, intended as that person\u2019s background, can be an invaluable source of information to drive and speed up the process of discovering and adapting to the person\u2019s habits, preferences and needs. This article discusses the requirements posed by cultural competence on the knowledge management system of a robot. We propose a framework for cultural knowledge representation that relies on (i) a three layer ontology for storing concepts of relevance, culture specific information and statistics, person-specific information and preferences; (ii) an algorithm for the acquisition of person-specific knowledge, which uses culture specific knowledge to drive the search; (iii) a Bayesian Network for speeding up the adaptation to the person by propagating the effects of acquiring one specific information onto interconnected concepts. We have conducted a preliminary evaluation of the framework involving 159 Italian and German volunteers and considering 122 among habits, attitudes and social norms

The CARESSES Randomised Controlled Trial: Exploring the Health-Related Impact of Culturally Competent Artificial Intelligence Embedded Into Socially Assistive Robots and Tested in Older Adult Care Homes

This trial represents the final stage of the CARESSES project which aimed to develop and evaluate a culturally competent artificial intelligent system embedded into social robots to support older adult wellbeing. A parallel group, single-blind randomised controlled trial was conducted across older adult care homes in England and Japan. Participants randomly allocated to the Experimental Group or Control Group 1 received a Pepper robot for up 18 h across 2 weeks. Two versions of the CARESSES artificial intelligence were tested: a fully culturally competent system (Experimental Group) and a more limited version (Control Group 1). Control Group 2 (Care As Usual) participants did not receive a robot. Quantitative outcomes of interest reported in the current paper were health-related quality of life (SF-36), loneliness (ULS-8), and perceptions of robotic cultural competence (CCATool-Robotics). Thirty-three residents completed all procedures. The difference in SF-36 Emotional Wellbeing scores between Experimental Group and Care As Usual participants over time was significant (F[1] = 6.614, sig = .019, ηp^2 = .258), as was the comparison between Any Robot used and Care As Usual (F[1] = 5.128, sig = .031, ηp＾2 = .146). There were no significant changes in SF-36 physical health subscales. ULS-8 loneliness scores slightly improved among Experimental and Control Group 1 participants compared to Care As Usual participants, but this was not significant. This study brings new evidence which cautiously supports the value of culturally competent socially assistive robots in improving the psychological wellbeing of older adults residing in care settings

CARESSES: the flower that taught robots about culture

The video describes the novel concept of 'culturally competent robotics', which is the main focus of the project CARESSES (Culturally-Aware Robots and Environmental Sensor Systems for Elderly Support). CARESSES a multidisciplinary project whose goal is to design the first socially assistive robots that can adapt to the culture of the older people they are taking care of. Socially assistive robots are required to help the users in many ways including reminding them to take their medication, encouraging them to keep active, helping them keep in touch with family and friends. The video describes a new generation of robots that will perform their actions with attention to the older person's customs, cultural practices and individual preferences

Collaborative Development within a Social Robotic, Multi-Disciplinary Effort: Lesson Learnt from the CARESSES case study

In many cases, complex multidisciplinary research projects may show a lack of coordinated development and integration, and a big effort is often required in the final phase of the projects in order to merge software developed by heterogeneous research groups. This is particularly true in advanced robotic projects: the objective here is to deliver a system that integrates all the hardware and software components, is capable of autonomous behaviour, and needs to be deployed in realworld scenarios toward providing an impact on future research and, ultimately, on society. On the other hand, in recent years there has been a growing interest for techniques related to software integration, but these have been mostly applied to the IT commercial domain. This paper presents the work performed in the context of the project CARESSES, a multidisciplinary research project focusing on socially assistive robotics that involves 9 partners from the EU and Japan. Given the complexity of the project, a huge importance has been placed on software integration, task planning and architecture definition since the first stages of the work: to this aim, some of the practices commonly used in the commercial domain for software integration, such as merging software from the early stage, have been applied. As a case study, the document describes the steps which have been followed in the first year of the project discussing strengths and weaknesses of this approach

Effects on the incidence of cardiovascular events of the addition of pioglitazone versus sulfonylureas in patients with type 2 diabetes inadequately controlled with metformin (TOSCA.IT): a randomised, multicentre trial

Background The best treatment option for patients with type 2 diabetes in whom treatment with metformin alone fails to achieve adequate glycaemic control is debated. We aimed to compare the long-term effects of pioglitazone versus sulfonylureas, given in addition to metformin, on cardiovascular events in patients with type 2 diabetes. Methods TOSCA.IT was a multicentre, randomised, pragmatic clinical trial, in which patients aged 50\ue2\u80\u9375 years with type 2 diabetes inadequately controlled with metformin monotherapy (2\ue2\u80\u933 g per day) were recruited from 57 diabetes clinics in Italy. Patients were randomly assigned (1:1), by permuted blocks randomisation (block size 10), stratified by site and previous cardiovascular events, to add-on pioglitazone (15\ue2\u80\u9345 mg) or a sulfonylurea (5\ue2\u80\u9315 mg glibenclamide, 2\ue2\u80\u936 mg glimepiride, or 30\ue2\u80\u93120 mg gliclazide, in accordance with local practice). The trial was unblinded, but event adjudicators were unaware of treatment assignment. The primary outcome, assessed with a Cox proportional-hazards model, was a composite of first occurrence of all-cause death, non-fatal myocardial infarction, non-fatal stroke, or urgent coronary revascularisation, assessed in the modified intention-to-treat population (all randomly assigned participants with baseline data available and without any protocol violations in relation to inclusion or exclusion criteria). This study is registered with ClinicalTrials.gov, number NCT00700856. Findings Between Sept 18, 2008, and Jan 15, 2014, 3028 patients were randomly assigned and included in the analyses. 1535 were assigned to pioglitazone and 1493 to sulfonylureas (glibenclamide 24 [2%], glimepiride 723 [48%], gliclazide 745 [50%]). At baseline, 335 (11%) participants had a previous cardiovascular event. The study was stopped early on the basis of a futility analysis after a median follow-up of 57\uc2\ub73 months. The primary outcome occurred in 105 patients (1\uc2\ub75 per 100 person-years) who were given pioglitazone and 108 (1\uc2\ub75 per 100 person-years) who were given sulfonylureas (hazard ratio 0\uc2\ub796, 95% CI 0\uc2\ub774\ue2\u80\u931\uc2\ub726, p=0\uc2\ub779). Fewer patients had hypoglycaemias in the pioglitazone group than in the sulfonylureas group (148 [10%] vs 508 [34%], p<0\uc2\ub70001). Moderate weight gain (less than 2 kg, on average) occurred in both groups. Rates of heart failure, bladder cancer, and fractures were not significantly different between treatment groups. Interpretation In this long-term, pragmatic trial, incidence of cardiovascular events was similar with sulfonylureas (mostly glimepiride and gliclazide) and pioglitazone as add-on treatments to metformin. Both of these widely available and affordable treatments are suitable options with respect to efficacy and adverse events, although pioglitazone was associated with fewer hypoglycaemia events. Funding Italian Medicines Agency, Diabete Ricerca, and Italian Diabetes Society