Design Recommendations Based on Speech Analysis for Disability-Friendly Interfaces for the Control of a Home Automation Environment

The objective of this paper is to describe the study on speech interaction mode for home automation control of equipment by impaired people for an inclusive housing. The study is related to the HIP HOPE project concerning a building of 19 inclusive housing units. 7 participants with different types of disabilities were invited to carry out use cases using voice and touch control. Only the results obtained on the voice interaction mode through the Amazon voice assistant are reported here. The results show, according to the type of handicap, the success rates in the speech recognition of the command emitted on the equipment and highlight the errors related to the formulation, the noisy environment, the intelligible speech, the speech segmentation and the bad synchronization of the audio channel opening

Multimodal and ubiquitous computing systems: supporting independent-living older users

We document the rationale and design of a multimodal interface to a pervasive/ubiquitous computing system that supports independent living by older people in their own homes. The Millennium Home system involves fitting a resident’s home with sensors – these sensors can be used to trigger sequences of interaction with the resident to warn them about dangerous events, or to check if they need external help. We draw lessons from the design process and conclude the paper with implications for the design of multimodal interfaces to ubiquitous systems developed for the elderly and in healthcare, as well as for more general ubiquitous computing applications

Simple smart homes web interfaces for blind people

Last-decade great advances in technology have contributed to make home smarter and more comfortable, especially for people with disabilities. A lot of low cost solutions are available on the market, which can be controlled remotely by a Home Automation System (HAS). Unfortunately, the user interfaces are usually designed to be visually oriented which can exclude some user categories, like those who are blind. This paper focuses on the design of usable Web user interfaces for Home Automation Systems, with a special attention to the functions as well as the interface arrangement in order to enhance the interaction via screen reader. The proposed indications could inspire other designers to make the user experience more satisfying and effective for people who interact via screen reader

On the Design of Ambient Intelligent Systems in the Context of Assistive Technologies

The design of Ambient Intelligent Systems (AISs) is discussed in the context of assistive technologies. The main issues include ubiquitous communications, context awareness, natural interactions and heterogeneity, which are analyzed using some examples. A layered architecture is proposed for heterogeneous sub-systems integration with three levels of interactions that may be used as a framework to design assistive AISs.Ministerio de Ciencia y Tecnología TIC2001-1868-C0

Design and development of augmentative and alternative digital home control interface

This paper describes a Digital Home Interface capable of adapting layouts, styles and contents to device capability, user preferences and appliances’ features; designed with a combination of web technologies, standard languages for abstract interface definition and AAC systems. The Home Automation architecture is characterized by devices’ independence, combining eXtensible Markup Language and Cascading Style Sheet, web technologies standard languages for abstract interface definition and two basic Augmentative and Alternative Communication systems with a Java based platform. This paper includes the result of a preliminary experiment, conducted with 4 users with cerebral palsy that are daily users of Augmentative and Alternative Communication systems in October 2011Peer Reviewe

In-home and remote use of robotic body surrogates by people with profound motor deficits

By controlling robots comparable to the human body, people with profound motor deficits could potentially perform a variety of physical tasks for themselves, improving their quality of life. The extent to which this is achievable has been unclear due to the lack of suitable interfaces by which to control robotic body surrogates and a dearth of studies involving substantial numbers of people with profound motor deficits. We developed a novel, web-based augmented reality interface that enables people with profound motor deficits to remotely control a PR2 mobile manipulator from Willow Garage, which is a human-scale, wheeled robot with two arms. We then conducted two studies to investigate the use of robotic body surrogates. In the first study, 15 novice users with profound motor deficits from across the United States controlled a PR2 in Atlanta, GA to perform a modified Action Research Arm Test (ARAT) and a simulated self-care task. Participants achieved clinically meaningful improvements on the ARAT and 12 of 15 participants (80%) successfully completed the simulated self-care task. Participants agreed that the robotic system was easy to use, was useful, and would provide a meaningful improvement in their lives. In the second study, one expert user with profound motor deficits had free use of a PR2 in his home for seven days. He performed a variety of self-care and household tasks, and also used the robot in novel ways. Taking both studies together, our results suggest that people with profound motor deficits can improve their quality of life using robotic body surrogates, and that they can gain benefit with only low-level robot autonomy and without invasive interfaces. However, methods to reduce the rate of errors and increase operational speed merit further investigation.Comment: 43 Pages, 13 Figure

Overcoming barriers and increasing independence: service robots for elderly and disabled people

This paper discusses the potential for service robots to overcome barriers and increase independence of elderly and disabled people. It includes a brief overview of the existing uses of service robots by disabled and elderly people and advances in technology which will make new uses possible and provides suggestions for some of these new applications. The paper also considers the design and other conditions to be met for user acceptance. It also discusses the complementarity of assistive service robots and personal assistance and considers the types of applications and users for which service robots are and are not suitable

On Distant Speech Recognition for Home Automation

The official version of this draft is available at Springer via http://dx.doi.org/10.1007/978-3-319-16226-3_7International audienceIn the framework of Ambient Assisted Living, home automation may be a solution for helping elderly people living alone at home. This study is part of the Sweet-Home project which aims at developing a new home automation system based on voice command to improve support and well-being of people in loss of autonomy. The goal of the study is vocal order recognition with a focus on two aspects: distance speech recognition and sentence spotting. Several ASR techniques were evaluated on a realistic corpus acquired in a 4-room flat equipped with microphones set in the ceiling. This distant speech French corpus was recorded with 21 speakers who acted scenarios of activities of daily living. Techniques acting at the decoding stage, such as our novel approach called Driven Decoding Algorithm (DDA), gave better speech recognition results than the baseline and other approaches. This solution which uses the two best SNR channels and a priori knowledge (voice commands and distress sentences) has demonstrated an increase in recognition rate without introducing false alarms

X10 - are you looking at me?

Various disabilities restrict the ease with which individuals can operate electronic and ICT devices. X10 is a system for home automation control and consequently lends itself for use by disabled individuals, who particularly have mobility restrictions, to control a wide range of devices although the resultant user interface can be cumbersome. The development of an adequate user-centred interface/control which will allow such an individual easily to operate multiple ICT devices is then a considerable challenge. The development of a technique that utilises a user’s point of gaze to select a particular ICT device for subsequent operation, thereby simplifying the user interface, is described. All ICT devices in the environment are first digitally imaged from different angles to identify them to a computer imaging system. Subsequently each device can be automatically recognised. The user’s eye movements are recorded and their direction of gaze related in real time to the known 3D location of the possible ICT devices so enabling device selection prior to operation. The development of the technique and current ongoing research status are described