An Ambient Agent Model for Monitoring and Analysing Dynamics of Complex Human Behaviour

In ambient intelligent systems, monitoring of a human could consist of more complex tasks than merely identifying whether a certain value of a sensor is above a certain threshold. Instead, such tasks may involve monitoring of complex dynamic interactions between human and environment. In order to enable such more complex types of monitoring, this paper presents a generic agent-based framework. The framework consists of support on various levels of system design, namely: (1) the top level, including the interaction between agents, (2) the agent level, providing support on the design of individual agents, and (3) the level of monitoring complex dynamic behaviour, allowing the specification of the aforementioned complex monitoring properties within the agents. The approach is exemplified by a large case study concerning the assessment of driving behaviour, and is applied to two smaller cases as well (concerning fall detection of elderly, and assistance of naval operations, respectively), which are briefly described. These case studies have illustrated that the presented framework enables developers within ambient intelligence to build systems with more expressiveness regarding their monitoring focus. Moreover, they have shown that the framework is easy to use and applicable in a wide variety of domains. © 2011 - IOS Press and the authors. All rights reserved

Robotic ubiquitous cognitive ecology for smart homes

Robotic ecologies are networks of heterogeneous robotic devices pervasively embedded in everyday environments, where they cooperate to perform complex tasks. While their potential makes them increasingly popular, one fundamental problem is how to make them both autonomous and adaptive, so as to reduce the amount of preparation, pre-programming and human supervision that they require in real world applications. The project RUBICON develops learning solutions which yield cheaper, adaptive and efficient coordination of robotic ecologies. The approach we pursue builds upon a unique combination of methods from cognitive robotics, machine learning, planning and agent- based control, and wireless sensor networks. This paper illustrates the innovations advanced by RUBICON in each of these fronts before describing how the resulting techniques have been integrated and applied to a smart home scenario. The resulting system is able to provide useful services and pro-actively assist the users in their activities. RUBICON learns through an incremental and progressive approach driven by the feed- back received from its own activities and from the user, while also self-organizing the manner in which it uses available sensors, actuators and other functional components in the process. This paper summarises some of the lessons learned by adopting such an approach and outlines promising directions for future work

Human behaviour modelling in complex socio-technical systems : an agent based approach

For many years we have been striving to understand human behaviour and our interactions with our socio-technological environment. By advancing our knowledge in this area, we have helped the design of new or improved work processes and technologies. Historically, much of the work in analysing social interactions has been conducted within the social sciences. However, computer simulation has brought an extra tool in trying to understand and model human behaviours. Using an agent based approach this presentation describes my work in constructing computational models of human behaviour for informing design through simulation. With examples from projects in two main application areas of crisis and emergency management, and energy management I describe how my work addresses some main issues in agent based social simulation. The first concerns the process by which we develop these models. The second lies in the nature of socio-technical systems. Human societies are a perfect example of a complex system exhibiting characteristics of self-organisation, adaptability and showing emergent phenomena such as cooperation and robustness. I describe how complex systems theory may be applied to improve our understanding of socio-technical systems, and how our micro level interactions lead to emergent mutual awareness for problem-solving. From agent based simulation systems I show how context awareness may be modelled. Looking forward to the future, I discuss how the increasing prevalence of artificial agents in our society will cause us to re-examine the new types of interactions and cooperative behaviours that will emerge.Depuis de nombreuses années, nous nous sommes efforcés de comprendre le comportement humain et nos interactions avec l'environnement sociotechnique. Grâce à l'avancée de nos connaissances dans ce domaine, nous avons contribué à la conception de technologies et de processus de travail nouveaux ou améliorés. Historiquement, une part importante du travail d'analyse des interactions sociales fut entreprise au sein des sciences sociales. Cependant, la simulation informatique a apporté un nouvel outil pour tenter de comprendre et de modéliser les comportements humains. En utilisant une approche à base d'agents, cette présentation décrit mon travail sur la construction de modèles informatiques du comportement humain pour guider la conception par la simulation. A l'aide d'exemples issus de projets des deux domaines d'application que sont la gestion des crises et de l'urgence et la gestion de l'énergie, je décris comment mon travail aborde certains problèmes centraux à la simulation sociale à base d'agents. Le premier concerne le processus par lequel nous développons ces modèles. Le second problème provient de la nature des systèmes sociotechniques. Les sociétés humaines constituent un exemple parfait de système complexe possédant des caractéristiques d'auto-organisation et d'adaptabilité, et affichant des phénomènes émergents tels que la coopération et la robustesse. Je décris comment la théorie des systèmes complexes peut être appliquée pour améliorer notre compréhension des systèmes sociotechniques, et comment nos interactions au niveau microscopique mènent à l'émergence d'une conscience mutuelle pour la résolution de problèmes. A partir de systèmes de simulation à base d'agents, je montre comment la conscience du contexte peut être modélisée. En terme de perspectives, j'expliquerai comment la hausse de la prévalence des agents artificiels dans notre société nous forcera à considérer de nouveaux types d'interactions et de comportements coopératifs

Non-Invasive Ambient Intelligence in Real Life: Dealing with Noisy Patterns to Help Older People

This paper aims to contribute to the field of ambient intelligence from the perspective of real environments, where noise levels in datasets are significant, by showing how machine learning techniques can contribute to the knowledge creation, by promoting software sensors. The created knowledge can be actionable to develop features helping to deal with problems related to minimally labelled datasets. A case study is presented and analysed, looking to infer high-level rules, which can help to anticipate abnormal activities, and potential benefits of the integration of these technologies are discussed in this context. The contribution also aims to analyse the usage of the models for the transfer of knowledge when different sensors with different settings contribute to the noise levels. Finally, based on the authors’ experience, a framework proposal for creating valuable and aggregated knowledge is depicted.This research was partially funded by Fundación Tecnalia Research & Innovation, and J.O.-M. also wants to recognise the support obtained from the EU RFCS program through project number 793505 ‘4.0 Lean system integrating workers and processes (WISEST)’ and from the grant PRX18/00036 given by the Spanish Secretaría de Estado de Universidades, Investigación, Desarrollo e Innovación del Ministerio de Ciencia, Innovación y Universidades

Knowledge-based vision and simple visual machines

The vast majority of work in machine vision emphasizes the representation of perceived objects and events: it is these internal representations that incorporate the 'knowledge' in knowledge-based vision or form the 'models' in model-based vision. In this paper, we discuss simple machine vision systems developed by artificial evolution rather than traditional engineering design techniques, and note that the task of identifying internal representations within such systems is made difficult by the lack of an operational definition of representation at the causal mechanistic level. Consequently, we question the nature and indeed the existence of representations posited to be used within natural vision systems (i.e. animals). We conclude that representations argued for on a priori grounds by external observers of a particular vision system may well be illusory, and are at best place-holders for yet-to-be-identified causal mechanistic interactions. That is, applying the knowledge-based vision approach in the understanding of evolved systems (machines or animals) may well lead to theories and models that are internally consistent, computationally plausible, and entirely wrong

An Agent-Based Model for Refined Cognitive Load and Reading Performance in Reading Companion Robot

This paper presents the importance of modeling dynamical behaviors of human cognitive states that serves as a core foundation in creating intelligent and responsive systems. It discusses in detail the development of a dynamical model of cognitive load and reading performance which acts as the central component of creating a reading companion robot. Simulations results show realistic behaviour patterns that adhere to the literature. Finally, the results produced from an automated verification approach to validate the internal correctness of the proposed model using Temporal Trace Language (TTL) are shown

Wearable Computing for Health and Fitness: Exploring the Relationship between Data and Human Behaviour

Health and fitness wearable technology has recently advanced, making it easier for an individual to monitor their behaviours. Previously self generated data interacts with the user to motivate positive behaviour change, but issues arise when relating this to long term mention of wearable devices. Previous studies within this area are discussed. We also consider a new approach where data is used to support instead of motivate, through monitoring and logging to encourage reflection. Based on issues highlighted, we then make recommendations on the direction in which future work could be most beneficial

Analysis of interaction patterns - attention

Dissertação de mestrado em Engenharia InformáticaThe attention, or focus, with which people perform their tasks has an important role on their success. Such tasks can be like study or work. Nowadays, our lifestyle can lead to a scatter of focus, especially when attending to several tasks or filtering loads of information, which in a laptop or desktop, can mean interacting with several applications simultaneously. This project will analyze and monitor the behavior of the users of desktop applications with the main aim to measure changes in user attention and focus throughout the day, and so, to know when a user is more focused and on better conditions to work. Leisure and work applications will also have an important play in this project, as the interaction with the laptop will be analyzed on both applications categories.A atenção, ou concentração, com que realizámos tarefas tem um papel importante na realização com sucesso das mesmas. Tais tarefas podem ser de estudo ou de trabalho. Hoje em dia, o nosso estilo de vida pode levar a uma dispersão da atenção, especialmente quando lidámos com várias tarefas ou informação, que num ambiente de trabalho pode significar interagir com várias aplicações simultaneamente. Este projecto irá analisar e monitorizar o comportamento dos utilizadores em aplicações com o objectivo principal de medir as mudanças na atenção do utilizador durante todo o dia, e assim saber quando um utilizador está mais focado e em melhores condições de realizar trabalho. Aplicações afectas ao lazer e ao trabalho também serão importantes neste projecto, dado que a interacção do utilizador com o portátil serão analisados em ambas as categorias.In order to be more productive at work, being focused is very important, as well as when studying or attending any other task. Nowadays, our lifestyle it can lead to a scatter of focus, especially when attending to several tasks, which in a laptop, or desktop, can mean interacting with several applications simultaneously. This project will analyze the behavior of the users of desktop applications with the main aim to measure changes in user attention and focus throughout the day. For this study data from a group of 20 people will be collected