Location of an Inhabitant for Domotic Assistance Through Fusion of Audio and Non-Visual Data

http://www.pervasivehealth.org/International audienceIn this paper, a new method to locate a person using multimodal non-visual sensors and microphones in a pervasive environment is presented. The information extracted from sensors is combined using a two-level dynamic network to obtain the location hypotheses. This method was tested within two smart homes using data from experiments involving about 25 participants. The preliminary results show that an accuracy of 90% can be reached using several uncertain sources. The use of implicit localisation sources, such as speech recognition, mainly used in this project for voice command, can improv e performances in many cases

Making Context Aware Decision from Uncertain Information in a Smart Home: A Markov Logic Network Approach

International audienceThis research addresses the issue of building home automa- tion systems reactive to voice for improved comfort and autonomy at home. The focus of this paper is on the context-aware decision process which uses a dedicated Markov Logic Network approach to benefit from the formal logical representation of domain knowledge as well as the abil- ity to handle uncertain facts inferred from real sensor data. The approach has been experimented in a real smart home with naive and users with special needs

Localisation d'habitant dans un environnement perceptif non visuel par propagation d'activations multisource

National audienceCet article présente une approche pour localiser une personne dans un environnement perceptif à partir de sources non visuelles. L'information extraite des capteurs (événements) informe sur la localisation d'une personne de manière incertaine. Ces différentes sources sont combinées en utilisant un réseau dynamique à deux niveaux d'hypothèses de localisation et en adaptant une méthode de propagation d'activation pour prendre en compte la dimension temporelle. Les résultats préliminaires sur un enregistrement réel montrent que la fusion d'information permet d'atteindre une exactitude pouvant atteindre 90%

Localisation d'habitant dans un espace perceptif par réseau dynamique

National audienceCet article présente une approche de fusion de données temporelles pour localiser une personne dans un environnement perceptif à partir de sources non visuelles. Ces sources informent sur la localisation de manière incertaine et sont donc combinées en utilisant un réseau dynamique à deux niveaux d'hypo- thèses de localisation et en adaptant une méthode de propagation d'activation pour prendre en compte la validité éphémère et l'ambiguïté des sources. Les ré- sultats sur des enregistrements réels montrent l'intérêt de l'approche

On-line Human Activity Recognition from Audio and Home Automation Sensors: comparison of sequential and non-sequential models in realistic Smart Homes

International audienceAutomatic human Activity Recognition (AR) is an important process for the provision of context-aware services in smart spaces such as voice-controlled smart homes. In this paper, we present an on-line Activities of Daily Living (ADL) recognition method for automatic identification within homes in which multiple sensors, actuators and automation equipment coexist, including audio sensors. Three sequence-based models are presented and compared: a Hidden Markov Model (HMM), Conditional Random Fields (CRF) and a sequential Markov Logic Network (MLN). These methods have been tested in two real Smart Homes thanks to experiments involving more than 30 participants. Their results were compared to those of three non-sequential models: a Support Vector Machine (SVM), a Random Forest (RF) and a non-sequential MLN. This comparative study shows that CRF gave the best results for on-line activity recognition from non-visual, audio and home automation sensors

Contrôle intelligent de la domotique à partir d'informations temporelles multi sources imprécises et incertaines

La Maison Intelligente est une résidence équipée de technologie informatique qui assiste ses habitant dans les situations diverses de la vie domestique en essayant de gérer de manière optimale leur confort et leur sécurité par action sur la maison. La détection des situations anormales est un des points essentiels d'un système de surveillance à domicile. Ces situations peuvent être détectées en analysant les primitives générées par les étages de traitement audio et par les capteurs de l'appartement. Par exemple, la détection de cris et de bruits sourds (chute d'un objet lourd) dans un intervalle de temps réduit permet d'inférer l'occurrence d'une chute. Le but des travaux de cette thèse est la réalisation d'un contrôleur intelligent relié à tous les périphériques de la maison capable de réagir aux demandes de l'habitant (par commande vocale) et de reconnaître des situations à risque ou détresse. Pour accomplir cet objectif, il est nécessaire de représenter formellement et raisonner sur des informations, le plus souvent temporelles, à des niveaux d'abstraction différents. Le principale défi est le traitement de l'incertitude, l'imprécision, et incomplétude, qui caractérisent les informations dans ce domaine d'application. Par ailleurs, les décisions prises par le contrôleur doivent tenir compte du contexte dans lequel une ordre est donné, ce qui nous place dans l'informatique sensible au contexte. Le contexte est composé des informations de haut niveau tels que la localisation, l'activité en cours de réalisation, la période de la journée. Les recherches présentées dans ce manuscrit peuvent être divisés principalement en trois axes: la réalisation des méthodes d'inférence pour acquérir les informations du contexte(notamment, la localisation de l'habitant y l'activité en cours) à partir des informations incertains, la représentation des connaissances sur l'environnement et les situations à risque, et finalement la prise de décision à partir des informations contextuelles. La dernière partie du manuscrit expose les résultats de la validation des méthodes proposées par des évaluations amenées à la plateforme expérimental Domus.A smart home is a residence featuring ambient intelligence technologies in order to help its dwellers in different situations of common life by trying to manage their comfort and security through the execution of actions over the effectors of the house. Detection of abnormal situations is paramount in the development of surveillance systems. These situations can be detected by the analysis of the traces resulting from audio processing and the data provided by the network of sensors installed in the smart home. For instance, detection of cries along with thuds(fall of a heavy object) in a short time interval can help to infer that the resident has fallen. The goal of the research presented in this thesis is the implementation of an intelligence controller connected with the devices in the house that is able to react to user's commands(through vocal interfaces) and recognize dangerous situations. In order to fulfill this goal, it is necessary to create formal representation and to develop reasoning mechanism over informations that are often temporal and having different levels of abstraction. The main challenge is the processing the uncertainty, imprecision, and incompleteness that characterise this domain of application. Moreover, the decisions taken by the intelligent controller must consider the context in which a user command is given, so this work is made in the area of Context Aware Computing. Context includes high level information such as the location of the dweller, the activity she is making, and the time of the day. The research works presented in this thesis can be divided mainly in three parts: the implementation of inference methods to obtain context information(namely, location and activity) from uncertain information, knowledge representation about the environment and dangerous situations, and finally the development of decision making models that use the inferred context information. The last part of this thesis shows the results from the validation of the proposed methods through experiments performed in an experimental platform, the Domus apartment.SAVOIE-SCD - Bib.électronique (730659901) / SudocGRENOBLE1/INP-Bib.électronique (384210012) / SudocGRENOBLE2/3-Bib.électronique (384219901) / SudocSudocFranceF

The Sweet-Home speech and multimodal corpus for home automation interaction

International audienceAmbient Assisted Living aims at enhancing the quality of life of older and disabled people at home thanks to Smart Homes and Home Automation. However, many studies do not include tests in real settings, because data collection in this domain is very expensive and challenging and because of the few available data sets. The SWEET-H OME multimodal corpus is a dataset recorded in realistic conditions in D OMUS, a fully equipped Smart Home with microphones and home automation sensors, in which participants performed Activities of Daily living (ADL). This corpus is made of a multimodal subset, a French home automation speech subset recorded in Distant Speech conditions, and two interaction subsets, the first one being recorded by 16 persons without disabilities and the second one by 6 seniors and 5 visually impaired people. This corpus was used in studies related to ADL recognition, context aware interaction and distant speech recognition applied to home automation controled through voice

Evaluation of a context-aware voice interface for Ambient Assisted Living: qualitative user study vs. quantitative system evaluation

International audienceThis paper presents an experiment with seniors and people with visual impairment in a voice-controlled smart home using the SWEET-HOME system. The experiment shows some weaknesses in automatic speech recognition which must be addressed, as well as the need of better adaptation to the user and the environment. Indeed, users were disturbed by the rigid structure of the grammar and were eager to adapt it to their own preferences. Surprisingly, while no humanoid aspect was introduced in the system, the senior participants were inclined to embody the system. Despite these aspects to improve, the system has been favourably assessed as diminishing most participant fears related to the loss of autonomy

Evaluation of a Real-Time Voice Order Recognition System from Multiple Audio Channels in a Home

International audienceThe SWEET-HOME project aims at providing audio-based interaction technology that lets the user have full control over their home environment, at detecting distress situations and at easing the social inclusion of the elderly and frail population. This paper presents an overview of the project focusing on the implemented techniques for speech and sound recognition as context-aware decision making with uncertainty. A user experiment in a smart home demonstrates the interest of this audio-based technology