Semantic Smart Homes: Towards Knowledge Rich Assisted Living Environments

International audienceThe complexity of the Emergency Supply Chains makes its management very difficult. Hence, we present in this article a comprehensive view of the French emergency supply chain (ESC), we propose an ad hoc relationship model between actors, and a GRAI grid-based model to initiate a new approach for controlling the ESC deficiencies, especially related to decision making. Throughout the article, we discuss the interest of the use of enterprise modelling to model the ESC. We discuss too, the characterization of the different issues related to the steering of the ESC. A literature review based on the GRAI grid model is proposed and discussed too. The GRAI method is used here because it presents the advantage of using the theory of complex systems, and it provides a dynamic model of an organization by focusing on decision-making and decisions communication

Facilitating Inter-Domain Synergies in Ambient Assisted Living Environments

Current Ambient Assisted Living (AAL) environments lack integration of sensors and actuators of other sub-domains. Creating technical and organizational integration is addressed by the BASIS project (Build Automation by a Scalable and Intelligent System), which aims to build a cross-domain home bus system. The main objective of this paper is to present an overview of design, architecture and state of realization of BASIS by describing the requirements development process, underlying hardware design and software architecture. We built a distributed system of one independent building manager with several redundantly meshed segment controllers, each controlling a bus segment with any number of bus nodes. The software system layer is divided into logical partitions representing each sub-domain. Structured data storage is possible with a special FHIR based home centered data warehouse. The system has been implemented in six apartments running under daily living conditions. BASIS integrates a broad range of sub-domains, which poses challenges to all project partners in terms of a common terminology, and project management methods, but enables development of inter-domain synergies like using the same sensor and actuator hardware for a broad range of services and use cases

Situation Aware Cognitive Assistance in Smart Homes

Smart Homes (SH) have emerged as a realistically viable solution capable of providing technology-driven assistive living for the elderly and disabled. Nevertheless, it still remains a challenge to provide situation-aware cognitive assistance for those in need in their Activity of Daily Living (ADL). This paper introduces a systematic approach to providing situation-aware ADL assistances in a smart home environment. The approach makes use of semantic technologies for sensor data modeling, fusion and management, thus creating machine understandable and processable situational data. It exploits intelligent agents for interpreting and reasoning semantic situational (meta)data to enhance situation-aware decision support for cognitive assistance. We analyze the nature and issues of SH-based healthcare for cognitively deficient inhabitants. We discuss the ways in which semantic technologies enhance situation comprehension. We describe a cognitive agent for realizing high-level cognitive capabilities such as prediction and explanation. We outline the implementation of a prototype assistive system and illustrate the proposed approach through simulated and real-time ADL assistance scenarios in the context of situation aware assistive living

Interactive sonification exploring emergent behavior applying models for biological information and listening

Sonification is an open-ended design task to construct sound informing a listener of data. Understanding application context is critical for shaping design requirements for data translation into sound. Sonification requires methodology to maintain reproducibility when data sources exhibit non-linear properties of self-organization and emergent behavior. This research formalizes interactive sonification in an extensible model to support reproducibility when data exhibits emergent behavior. In the absence of sonification theory, extensibility demonstrates relevant methods across case studies. The interactive sonification framework foregrounds three factors: reproducible system implementation for generating sonification; interactive mechanisms enhancing a listener's multisensory observations; and reproducible data from models that characterize emergent behavior. Supramodal attention research suggests interactive exploration with auditory feedback can generate context for recognizing irregular patterns and transient dynamics. The sonification framework provides circular causality as a signal pathway for modeling a listener interacting with emergent behavior. The extensible sonification model adopts a data acquisition pathway to formalize functional symmetry across three subsystems: Experimental Data Source, Sound Generation, and Guided Exploration. To differentiate time criticality and dimensionality of emerging dynamics, are applied between subsystems to maintain scale and symmetry of concurrent processes and temporal dynamics. Tuning functions accommodate sonification design strategies that yield order parameter values to render emerging patterns discoverable as well as , to reproduce desired instances for clinical listeners. Case studies are implemented with two computational models, Chua's circuit and Swarm Chemistry social agent simulation, generating data in real-time that exhibits emergent behavior. is introduced as an informal model of a listener's clinical attention to data sonification through multisensory interaction in a context of structured inquiry. Three methods are introduced to assess the proposed sonification framework: Listening Scenario classification, data flow Attunement, and Sonification Design Patterns to classify sound control. Case study implementations are assessed against these methods comparing levels of abstraction between experimental data and sound generation. Outcomes demonstrate the framework performance as a reference model for representing experimental implementations, also for identifying common sonification structures having different experimental implementations, identifying common functions implemented in different subsystems, and comparing impact of affordances across multiple implementations of listening scenarios

A Platform as a Service Framework for Ambient Assisted Living Services

The primary objective of Ambient Assisted Living (AAL) technology is to provide aid and assistance to individuals, particularly the elderly, in maintaining their independence and residing in their own homes and their known environment for an extended duration. AAL technology is becoming increasingly important due to the continuous decrease of birth-rate and increasing life expectancy, leading to a shrinking proportion of younger population in developed countries. This research proposes a cloud-based platform as a service (PaaS) for AAL that enables service providers to deliver services without the need for the user to invest in expensive technical equipment in advance, thus reducing high start-up costs. This hurdle, as identified by both peer groups and service solution vendors, stands as a pivotal challenge demanding resolution. The PaaS for AAL focuses on adaptation and personalization, as user acceptance of AAL services depends heavily on their situational needs. To provide customization, the PaaS for AAL can dynamically adapt its functionality and presentation of information based on the context of the environment or user, such as the medical state of the user and the condition at home. To store and retrieve information about the user, an ontology-backed database is implemented, and information about the environment is provided through interoperability with existing smart home appliances, directly attached sensors, and external web services. One of the key concerns of potential AAL users according to a field test during the research is privacy-related. A PaaS for AAL places regulatory demands on protecting the user’s privacy and personal information. Consequently, another part of this work focuses on the question of how general data sharing is possible based on the respective context of the user while protecting their privacy: By implementing monitoring, access control, and enforcement of privacy preserving data access, the platform for AAL is further enhanced. The extension of the introduced privacy policy language with context awareness is a significant step towards providing more robust privacy protection in AAL use cases. With a concluding evaluation survey, it can be shown that it allows for more granular control over data access and ensures that sensitive user data is only accessible when necessary and under appropriate conditions

Automatic annotation of musical audio for interactive applications

PhDAs machines become more and more portable, and part of our everyday life, it becomes apparent that developing interactive and ubiquitous systems is an important aspect of new music applications created by the research community. We are interested in developing a robust layer for the automatic annotation of audio signals, to be used in various applications, from music search engines to interactive installations, and in various contexts, from embedded devices to audio content servers. We propose adaptations of existing signal processing techniques to a real time context. Amongst these annotation techniques, we concentrate on low and mid-level tasks such as onset detection, pitch tracking, tempo extraction and note modelling. We present a framework to extract these annotations and evaluate the performances of different algorithms. The first task is to detect onsets and offsets in audio streams within short latencies. The segmentation of audio streams into temporal objects enables various manipulation and analysis of metrical structure. Evaluation of different algorithms and their adaptation to real time are described. We then tackle the problem of fundamental frequency estimation, again trying to reduce both the delay and the computational cost. Different algorithms are implemented for real time and experimented on monophonic recordings and complex signals. Spectral analysis can be used to label the temporal segments; the estimation of higher level descriptions is approached. Techniques for modelling of note objects and localisation of beats are implemented and discussed. Applications of our framework include live and interactive music installations, and more generally tools for the composers and sound engineers. Speed optimisations may bring a significant improvement to various automated tasks, such as automatic classification and recommendation systems. We describe the design of our software solution, for our research purposes and in view of its integration within other systems.EU-FP6-IST-507142 project SIMAC (Semantic Interaction with Music Audio Contents); EPSRC grants GR/R54620; GR/S75802/01

User Interface Abstraction for enabling TV set based Inclusive Access to the Information Society

199 p.The television (TV) set is present in most homes worldwide, and is the most used Information and Communication Technology (ICT). Despite its large implantation in the market, the interactive services consumption on TV set is limited. This thesis focuses on overcoming the following limiting factors: (i) limited Human Computer Interaction and (ii) lack of considering user’s real life context in the digital television (dTV) service integration strategy. Making interactive services accessible to TV set’s large user base, and especially to the most vulnerable ones, is understood as the path to integrate the mankind with the information society. This thesis explores the use of user interface abstraction technologies to reach the introduced goals. The main contributions of this thesis are: (i) an approach to enable the universally accessible remote control of the TV set, (ii) an approach for the provision of universally accessible interactive services through TV sets, and (iii) an approach for the provision of universally accessible services in the TV user’s real life context. We have implemented the contributing approaches for different use cases, and we have evaluated them with real users, achieving good results

An IoT-Aware Approach for Elderly-Friendly Cities

The ever-growing life expectancy of people requires the adoption of proper solutions for addressing the particular needs of elderly people in a sustainable way, both from service provision and economic point of view. Mild cognitive impairments and frailty are typical examples of elderly conditions which, if not timely addressed, can turn out into more complex diseases that are harder and costlier to treat. Information and communication technologies, and in particular Internet of Things technologies, can foster the creation of monitoring and intervention systems, both on an ambient-assisted living and smart city scope, for early detecting behavioral changes in elderly people. This allows to timely detect any potential risky situation and properly intervene, with benefits in terms of treatment's costs. In this context, as part of the H2020-funded City4Age project, this paper presents the data capturing and data management layers of the whole City4Age platform. In particular, this paper deals with an unobtrusive data gathering system implementation to collect data about daily activities of elderly people, and with the implementation of the related linked open data (LOD)-based data management system. The collected data are then used by other layers of the platform to perform risk detection algorithms and generate the proper customized interventions. Through the validation of some use-cases, it is demonstrated how this scalable approach, also characterized by unobtrusive and low-cost sensing technologies, can produce data with a high level of abstraction useful to define a risk profile of each elderly person

Multimodal access to social media services

Tese de mestrado integrado. Engenharia Informática e Computação. Faculdade de Engenharia. Universidade do Porto, Microsoft Language Development Center. 201