Improvement of the sensory and autonomous capability of robots through olfaction: the IRO Project

Proyecto de Excelencia Junta de Andalucía TEP2012-530Olfaction is a valuable source of information about the environment that has not been su ciently exploited in mobile robotics yet. Certainly, odor information can contribute to other sensing modalities, e.g. vision, to successfully accomplish high-level robot activities, such as task planning or execution in human environments. This paper describes the developments carried out in the scope of the IRO project, which aims at making progress in this direction by investigating mechanisms that exploit odor information (usually coming in the form of the type of volatile and its concentration) in problems like object recognition and scene-activity understanding. A distinctive aspect of this research is the special attention paid to the role of semantics within the robot perception and decisionmaking processes. The results of the IRO project have improved the robot capabilities in terms of efciency, autonomy and usefulness.Universidad de Málaga. Campus de Excelencia Internacional Andalucía Tec

Towards Active Event Recognition

Directing robot attention to recognise activities and to anticipate events like goal-directed actions is a crucial skill for human-robot interaction. Unfortunately, issues like intrinsic time constraints, the spatially distributed nature of the entailed information sources, and the existence of a multitude of unobservable states affecting the system, like latent intentions, have long rendered achievement of such skills a rather elusive goal. The problem tests the limits of current attention control systems. It requires an integrated solution for tracking, exploration and recognition, which traditionally have been seen as separate problems in active vision.We propose a probabilistic generative framework based on a mixture of Kalman filters and information gain maximisation that uses predictions in both recognition and attention-control. This framework can efficiently use the observations of one element in a dynamic environment to provide information on other elements, and consequently enables guided exploration.Interestingly, the sensors-control policy, directly derived from first principles, represents the intuitive trade-off between finding the most discriminative clues and maintaining overall awareness.Experiments on a simulated humanoid robot observing a human executing goal-oriented actions demonstrated improvement on recognition time and precision over baseline systems

Adaptive Bayesian inference system for recognition of walking activities and prediction of gait events using wearable sensors

In this paper, a novel approach for recognition of walking activities and gait events with wearable sensors is presented. This approach, called adaptive Bayesian inference system (BasIS), uses a probabilistic formulation with a sequential analysis method, for recognition of walking activities performed by participants. Recognition of gait events, needed to identify the state of the human body during the walking activity, is also provided by the proposed method. In addition, the BasIS system includes an adaptive action-perception method for the prediction of gait events. The adaptive approach uses the knowledge gained from decisions made over time by the inference system. The actionperception method allows the BasIS system to autonomously adapt its performance, based on the evaluation of its own predictions and decisions made over time. The proposed approach is implemented in a layered architecture and validated with the recognition of three walking activities; level-ground, ramp ascent and ramp descent. The validation process employs real data from three inertial measurements units attached to the thigh, shanks and foot of participants while performing walking activities. The experiments show that mean decision times of 240 ms and 40 ms are needed to achieve mean accuracies of 99.87% and 99.82% for recognition of walking activities and gait events, respectively. The validation experiments also show that the performance, in accuracy and speed, is not significantly affected when noise is added to sensor measurements. These results show that the proposed adaptive recognition system is accurate, fast and robust to sensor noise, but also capable to adapt its own performance over time. Overall, the adaptive BasIS system demonstrates to be a robust and suitable computational approach for the intelligent recognition of activities of daily living using wearable sensors

Attentive monitoring of multiple video streams driven by a Bayesian foraging strategy

In this paper we shall consider the problem of deploying attention to subsets of the video streams for collating the most relevant data and information of interest related to a given task. We formalize this monitoring problem as a foraging problem. We propose a probabilistic framework to model observer's attentive behavior as the behavior of a forager. The forager, moment to moment, focuses its attention on the most informative stream/camera, detects interesting objects or activities, or switches to a more profitable stream. The approach proposed here is suitable to be exploited for multi-stream video summarization. Meanwhile, it can serve as a preliminary step for more sophisticated video surveillance, e.g. activity and behavior analysis. Experimental results achieved on the UCR Videoweb Activities Dataset, a publicly available dataset, are presented to illustrate the utility of the proposed technique.Comment: Accepted to IEEE Transactions on Image Processin