The Sweet-Home speech and multimodal corpus for home automation interaction

International audienceAmbient Assisted Living aims at enhancing the quality of life of older and disabled people at home thanks to Smart Homes and Home Automation. However, many studies do not include tests in real settings, because data collection in this domain is very expensive and challenging and because of the few available data sets. The SWEET-H OME multimodal corpus is a dataset recorded in realistic conditions in D OMUS, a fully equipped Smart Home with microphones and home automation sensors, in which participants performed Activities of Daily living (ADL). This corpus is made of a multimodal subset, a French home automation speech subset recorded in Distant Speech conditions, and two interaction subsets, the first one being recorded by 16 persons without disabilities and the second one by 6 seniors and 5 visually impaired people. This corpus was used in studies related to ADL recognition, context aware interaction and distant speech recognition applied to home automation controled through voice

Speech-based interaction in an AAL context

International audiencePURPOSE The number of older persons in industrialized countries is steadily increasing. Seniors living alone are more numerous, and we must find solutions that will allow them to continue to stay at home comfortably and safely. Smart housings can be one of these solutions. One of the biggest challenges in ambient assisted living (AAL) is to develop smart homes that anticipate and respond to the needs of the inhabitants. Given the diverse profiles of the older adult population, it will therefore be essential to facilitate interaction with the smart home through systems that respond naturally to voice commands rather than using tactile interfaces. METHOD The first step in our study was to evaluate how well ambient assistive speech technology is received by the target population. We report on a user evaluation assessing acceptance and fear of this new technology. The experiment aimed at testing three important aspects of speech interaction: voice command, communication with the outside world, home automation system interrupting a person's activity. Participants were 7 older persons (71-88 years old), 7 relatives and 3 professional carers; the experiments were conducted in a smart home with a voice command using a Wizard-of-Oz technique. The second step in our study was related to the adaptation of speech recognition technologies to the older adult population. Judging by the literature this has not been extensively studied. In fact, it is known that industrialized speech recognition system models are not adapted to seniors but to other categories of the population. In order to do this we recorded a specific speech corpus (voice-age) with 7 older adults (70 to 89 years old) reading sentences (a total of 4 hours of speech). A second corpus (ERES38) of free talking (18 hours of speech) was recorded by 23 speakers (68-98 years old). These corpora were analyzed in a semi-automatic manner to reveal the aged-voice characteristics. RESULTS AND DISCUSSION Regarding the technical aspect, it appears that some phonemes are more affected by age than others. Thus, a specific adaptation of the acoustic models for ASR is required. Regarding the acceptance aspect, voice interfaces appear to have a great potential to ease daily living for older adults and frail persons and would be better accepted than other, more intrusive, solutions. By considering still healthy and independent older persons in the user evaluation, one interesting finding was overall acceptance provided the system is not conducive to a lazy lifestyle by taking control of everything. This particular concern must be addressed in the development of smart homes that support daily living by stressing the ability to control the daily routine rather than altering it. This study shows the great interest of voice interfaces to develop efficient solution to enable the growing number of older persons to continue to live in their own homes as long as possible

Overcoming barriers and increasing independence: service robots for elderly and disabled people

This paper discusses the potential for service robots to overcome barriers and increase independence of elderly and disabled people. It includes a brief overview of the existing uses of service robots by disabled and elderly people and advances in technology which will make new uses possible and provides suggestions for some of these new applications. The paper also considers the design and other conditions to be met for user acceptance. It also discusses the complementarity of assistive service robots and personal assistance and considers the types of applications and users for which service robots are and are not suitable

Views and experiences on the use of voice assistants by family and professionals supporting people with cognitive impairments

The use of voice assistants (e.g., Amazon Alexa, Google Home) is being widely advocated as part of supporting people living with dementia at home. The development of this technology is largely driven by industry, and there is little research to determine how family carers and professionals use voice assistants with people with dementia. This paper presents the findings from further analysis of data from two studies: Study 1—a qualitative study that aimed to explore the views and expectations of family carers and professionals who use voice assistants to support people with a cognitive impairment at home, and Study 2—a qualitative enquiry aiming to identify the views and barriers on using voice assistants by family carers of people with dementia and professionals, together with a pilot case study evaluating a prototype that addresses barriers identified during the enquiry, entitled IntraVox. Based on processing of smart home sensor data, IntraVox uses a personalised human voice to send prompts and reminders to end-users to conduct daily life activities and to activate smart home processes using voice assistants. The results of the qualitative studies indicate that family carers and professionals use voice assistants in their caring role for home automation, skills maintenance and development, prompts and reminders, behaviour and environment monitoring, and for leisure and social interaction support. The findings also show that family carers and professionals have specific challenges that need to be overcome for them to realise the benefits that may be gained through the use of voice assistants within technology enabled care. The pilot case study also provided a useful demonstration that interoperability can be achieved to enable exchanges between IntraVox and voice assistants, with the aim of providing customised and personalised technological solutions that address some of the barriers that people with dementia and their carers face in the use of this technology

Speech analysis for Ambient Assisted Living : technical and user design of a vocal order system

International audienceEvolution of ICT led to the emergence of smart home. A Smart Home consists in a home equipped with data-processing technology which anticipates the needs of its inhabitant while trying to maintain their comfort and their safety by action on the house and by implementing connections with the outside world. Therefore, smart homes equipped with ambient intelligence technology constitute a promising direction to enable the growing number of elderly to continue to live in their own homes as long as possible. However, the technological solutions requested by this part of the population have to suit their specific needs and capabilities. It is obvious that these Smart Houses tend to be equipped with devices whose interfaces are increasingly complex and become difficult to control by the user. The people the most likely to benefit from these new technologies are the people in loss of autonomy such as the disabled people or the elderly which cognitive deficiencies (Alzheimer). Moreover, these people are the less capable of using the complex interfaces due to their handicap or their lack ICT understanding. Thus, it becomes essential to facilitate the daily life and the access to the whole home automation system through the smart home. The usual tactile interfaces should be supplemented by accessible interfaces, in particular, thanks to a system reactive to the voice ; these interfaces are also useful when the person cannot move easily. Vocal orders will allow the following functionality: - To ensure an assistance by a traditional or vocal order. - To set up a indirect order regulation for a better energy management. - To reinforce the link with the relatives by the integration of interfaces dedicated and adapted to the person in loss of autonomy. - To ensure more safety by detection of distress situations and when someone is breaking in the house. This chapter will describe the different steps which are needed for the conception of an audio ambient system. The first step is related to the acceptability and the objection aspects by the end users and we will report a user evaluation assessing the acceptance and the fear of this new technology. The experience aimed at testing three important aspects of speech interaction: voice command, communication with the outside world, home automation system interrupting a person's activity. The experiment was conducted in a smart home with a voice command using a Wizard of OZ technique and gave information of great interest. The second step is related to a general presentation of the audio sensing technology for ambient assisted living. Different aspect of sound and speech processing will be developed. The applications and challenges will be presented. The third step is related to speech recognition in the home environment. Automatic Speech Recognition systems (ASR) have reached good performances with close talking microphones (e.g., head-set), but the performances decrease significantly as soon as the microphone is moved away from the mouth of the speaker (e.g., when the microphone is set in the ceiling). This deterioration is due to a broad variety of effects including reverberation and presence of undetermined background noise such as TV radio and, devices. This part will present a system of vocal order recognition in distant speech context. This system was evaluated in a dedicated flat thanks to some experiments. This chapter will then conclude with a discussion on the interest of the speech modality concerning the Ambient Assisted Living

Internet of robotic things : converging sensing/actuating, hypoconnectivity, artificial intelligence and IoT Platforms

The Internet of Things (IoT) concept is evolving rapidly and influencing newdevelopments in various application domains, such as the Internet of MobileThings (IoMT), Autonomous Internet of Things (A-IoT), Autonomous Systemof Things (ASoT), Internet of Autonomous Things (IoAT), Internetof Things Clouds (IoT-C) and the Internet of Robotic Things (IoRT) etc.that are progressing/advancing by using IoT technology. The IoT influencerepresents new development and deployment challenges in different areassuch as seamless platform integration, context based cognitive network integration,new mobile sensor/actuator network paradigms, things identification(addressing, naming in IoT) and dynamic things discoverability and manyothers. The IoRT represents new convergence challenges and their need to be addressed, in one side the programmability and the communication ofmultiple heterogeneous mobile/autonomous/robotic things for cooperating,their coordination, configuration, exchange of information, security, safetyand protection. Developments in IoT heterogeneous parallel processing/communication and dynamic systems based on parallelism and concurrencyrequire new ideas for integrating the intelligent “devices”, collaborativerobots (COBOTS), into IoT applications. Dynamic maintainability, selfhealing,self-repair of resources, changing resource state, (re-) configurationand context based IoT systems for service implementation and integrationwith IoT network service composition are of paramount importance whennew “cognitive devices” are becoming active participants in IoT applications.This chapter aims to be an overview of the IoRT concept, technologies,architectures and applications and to provide a comprehensive coverage offuture challenges, developments and applications

A Storm in an IoT Cup: The Emergence of Cyber-Physical Social Machines

The concept of social machines is increasingly being used to characterise various socio-cognitive spaces on the Web. Social machines are human collectives using networked digital technology which initiate real-world processes and activities including human communication, interactions and knowledge creation. As such, they continuously emerge and fade on the Web. The relationship between humans and machines is made more complex by the adoption of Internet of Things (IoT) sensors and devices. The scale, automation, continuous sensing, and actuation capabilities of these devices add an extra dimension to the relationship between humans and machines making it difficult to understand their evolution at either the systemic or the conceptual level. This article describes these new socio-technical systems, which we term Cyber-Physical Social Machines, through different exemplars, and considers the associated challenges of security and privacy.Comment: 14 pages, 4 figure