Enhancing Natural Interaction with Circumstantial Knowledge

This work focuses the circumstantial knowledge management for a specific need: the achievement of Natural Interaction (NI). In first place, a cognitive approach to NI is glanced as the framework for such knowledge management. This approach reflects some certain requirements for the whole interaction system, which are met by a multi-agent system implementation. Finally, a Situation Modeling is proposed for a first approach to the interaction circumstances management.The presented work has been developed within the MAVIR project (S-505/TIC/0267) endorsed by the Regional Government of Madrid, and is being extended through the SOPAT project (CIT-410000-2007-12), supported by the Spanish Ministry of Science and Education.Publicad

Identification of Invariant Sensorimotor Structures as a Prerequisite for the Discovery of Objects

Perceiving the surrounding environment in terms of objects is useful for any general purpose intelligent agent. In this paper, we investigate a fundamental mechanism making object perception possible, namely the identification of spatio-temporally invariant structures in the sensorimotor experience of an agent. We take inspiration from the Sensorimotor Contingencies Theory to define a computational model of this mechanism through a sensorimotor, unsupervised and predictive approach. Our model is based on processing the unsupervised interaction of an artificial agent with its environment. We show how spatio-temporally invariant structures in the environment induce regularities in the sensorimotor experience of an agent, and how this agent, while building a predictive model of its sensorimotor experience, can capture them as densely connected subgraphs in a graph of sensory states connected by motor commands. Our approach is focused on elementary mechanisms, and is illustrated with a set of simple experiments in which an agent interacts with an environment. We show how the agent can build an internal model of moving but spatio-temporally invariant structures by performing a Spectral Clustering of the graph modeling its overall sensorimotor experiences. We systematically examine properties of the model, shedding light more globally on the specificities of the paradigm with respect to methods based on the supervised processing of collections of static images.Comment: 24 pages, 10 figures, published in Frontiers Robotics and A

Action Recognition in Videos: from Motion Capture Labs to the Web

This paper presents a survey of human action recognition approaches based on visual data recorded from a single video camera. We propose an organizing framework which puts in evidence the evolution of the area, with techniques moving from heavily constrained motion capture scenarios towards more challenging, realistic, "in the wild" videos. The proposed organization is based on the representation used as input for the recognition task, emphasizing the hypothesis assumed and thus, the constraints imposed on the type of video that each technique is able to address. Expliciting the hypothesis and constraints makes the framework particularly useful to select a method, given an application. Another advantage of the proposed organization is that it allows categorizing newest approaches seamlessly with traditional ones, while providing an insightful perspective of the evolution of the action recognition task up to now. That perspective is the basis for the discussion in the end of the paper, where we also present the main open issues in the area.Comment: Preprint submitted to CVIU, survey paper, 46 pages, 2 figures, 4 table

First impressions: A survey on vision-based apparent personality trait analysis

© 2019 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes,creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.Personality analysis has been widely studied in psychology, neuropsychology, and signal processing fields, among others. From the past few years, it also became an attractive research area in visual computing. From the computational point of view, by far speech and text have been the most considered cues of information for analyzing personality. However, recently there has been an increasing interest from the computer vision community in analyzing personality from visual data. Recent computer vision approaches are able to accurately analyze human faces, body postures and behaviors, and use these information to infer apparent personality traits. Because of the overwhelming research interest in this topic, and of the potential impact that this sort of methods could have in society, we present in this paper an up-to-date review of existing vision-based approaches for apparent personality trait recognition. We describe seminal and cutting edge works on the subject, discussing and comparing their distinctive features and limitations. Future venues of research in the field are identified and discussed. Furthermore, aspects on the subjectivity in data labeling/evaluation, as well as current datasets and challenges organized to push the research on the field are reviewed.Peer ReviewedPostprint (author's final draft

"So go downtown": simulating pedestrian movement in town centres

Pedestrian movement models have been developed since the 1970s. A review of the literature shows that such models have been developed to explain and predict macro, meso, and micro movement patterns. However, recent developments in modelling techniques, and especially advances in agent-based simulation, open up the possibility of developing integrative and complex models which use existing models as 'building blocks'. In this paper we describe such integrative, modular approach to simulating pedestrian movement behaviour. The STREETS model, developed by using Swarm and GIS, is an agent-based model that focuses on the simulation of the behavioural aspects of pedestrian movement. The modular structure of the simulation is described in detail. This is followed by a discussion of the lessons learned from the development of STREETS, especially the advantages of adopting a modular approach and other aspects of using the agent-based paradigm for modelling

Semantic data mining and linked data for a recommender system in the AEC industry

Even though it can provide design teams with valuable performance insights and enhance decision-making, monitored building data is rarely reused in an effective feedback loop from operation to design. Data mining allows users to obtain such insights from the large datasets generated throughout the building life cycle. Furthermore, semantic web technologies allow to formally represent the built environment and retrieve knowledge in response to domain-specific requirements. Both approaches have independently established themselves as powerful aids in decision-making. Combining them can enrich data mining processes with domain knowledge and facilitate knowledge discovery, representation and reuse. In this article, we look into the available data mining techniques and investigate to what extent they can be fused with semantic web technologies to provide recommendations to the end user in performance-oriented design. We demonstrate an initial implementation of a linked data-based system for generation of recommendations

Exploring movement – similarity analysis of moving objects

Extracting knowledge about the movement of different types of mobile agents (e.g. human, animals, vehicles) and dynamic phenomena (e.g. hurricanes) requires new exploratory data analysis methods for massive movement datasets. Different types of moving objects share similarities but also express differences in terms of their dynamic behavior and the nature of their movement. Extracting such similarities can significantly contribute to the prediction, modeling and simulation dynamic phenomena. Therefore, with the development of a quantitative methodology this research intends to investigate and explore similarities in the dynamics of moving objects by using methods of GIScience in knowledge discovery. This paper presents a summary of the ongoing Ph.D. research project

An Approach to Circumstantial Knowledge Management for Human-Like Interaction

Proceedings of: 16th International Conference on Enterprise Information Systems (ICEIS). Lisbon, Portugal, 27-30 April, 2014. http://www.iceis.org/?y=2014This paper proposes the design of a general-purpose domain-independent knowledge model formalizing and managing the circumstantial knowledge involved in the human interaction process, i.e., a Situation Model. Its design is aimed to be embodied into a human-like interaction system, thus enriching the quality of the interaction by providing context-aware features to the interaction system. The proposal differs from similar work in that it is supported by the spatio-temporal databases technology. Additionally, since the proposed model requires to be fed with real knowledge obtained from each specific interaction domain, this paper also proposes an edition tool for acquiring and managing that circumstantial knowledge. The tool also supports the simulation over the model to check the correctness and completeness of the acquired knowledge. Finally, some scenario examples are provided in order to illustrate how the Situation Model works, and to gain perspective on its future possibilities of application in different systems where context-aware services can make a difference.This work has been be applied in aresearch project funded by the Spanish Ministry of Industry (CADOOH,TSI-020302-2011-21).Publicad