Active Goal Recognition Design

In Goal Recognition Design (GRD), the objective is to modify a domain to facilitate early detection of the goal of a subject agent. Most previous work studies this problem in the offline setting, in which the observing agent performs its interventions before the subject begins acting. In this thesis, we generalize GRD to the online setting in which time passes and the observer\u27s actions are interleaved with those of the subject. We illustrate weaknesses of existing metrics for GRD and propose an alternative better suited to online settings. We provide a formal definition of this Active GRD (AGRD) problem and propose both an optimal algorithm and a suboptimal algorithm for solving it. AGRD occupies an interesting middle ground between passive goal recognition and strategic two-player game settings

Towards Active Event Recognition

Directing robot attention to recognise activities and to anticipate events like goal-directed actions is a crucial skill for human-robot interaction. Unfortunately, issues like intrinsic time constraints, the spatially distributed nature of the entailed information sources, and the existence of a multitude of unobservable states affecting the system, like latent intentions, have long rendered achievement of such skills a rather elusive goal. The problem tests the limits of current attention control systems. It requires an integrated solution for tracking, exploration and recognition, which traditionally have been seen as separate problems in active vision.We propose a probabilistic generative framework based on a mixture of Kalman filters and information gain maximisation that uses predictions in both recognition and attention-control. This framework can efficiently use the observations of one element in a dynamic environment to provide information on other elements, and consequently enables guided exploration.Interestingly, the sensors-control policy, directly derived from first principles, represents the intuitive trade-off between finding the most discriminative clues and maintaining overall awareness.Experiments on a simulated humanoid robot observing a human executing goal-oriented actions demonstrated improvement on recognition time and precision over baseline systems

Towards Contextual Action Recognition and Target Localization with Active Allocation of Attention

Exploratory gaze movements are fundamental for gathering the most relevant information regarding the partner during social interactions. We have designed and implemented a system for dynamic attention allocation which is able to actively control gaze movements during a visual action recognition task. During the observation of a partners reaching movement, the robot is able to contextually estimate the goal position of the partner hand and the location in space of the candidate targets, while moving its gaze around with the purpose of optimizing the gathering of information relevant for the task. Experimental results on a simulated environment show that active gaze control provides a relevant advantage with respect to typical passive observation, both in term of estimation precision and of time required for action recognition. © 2012 Springer-Verlag

An Active Pattern Recognition Architecture for Mobile Robots

An active, attentionally-modulated recognition architecture is proposed for object recognition and scene analysis. The proposed architecture forms part of navigation and trajectory planning modules for mobile robots. Key characteristics of the system include movement planning and execution based on environmental factors and internal goal definitions. Real-time implementation of the system is based on space-variant representation of the visual field, as well as an optimal visual processing scheme utilizing separate and parallel channels for the extraction of boundaries and stimulus qualities. A spatial and temporal grouping module (VWM) allows for scene scanning, multi-object segmentation, and featural/object priming. VWM is used to modulate a tn~ectory formation module capable of redirecting the focus of spatial attention. Finally, an object recognition module based on adaptive resonance theory is interfaced through VWM to the visual processing module. The system is capable of using information from different modalities to disambiguate sensory input.Defense Advanced Research Projects Agency (90-0083); Office of Naval Research (N00014-92-J-1309); Consejo Nacional de Ciencia y Tecnología (63462

Multi-target detection and recognition by UAVs using online POMDPs

This paper tackles high-level decision-making techniques for robotic missions, which involve both active sensing and symbolic goal reaching, under uncertain probabilistic environments and strong time constraints. Our case study is a POMDP model of an online multi-target detection and recognition mission by an autonomous UAV.The POMDP model of the multi-target detection and recognition problem is generated online from a list of areas of interest, which are automatically extracted at the beginning of the flight from a coarse-grained high altitude observation of the scene. The POMDP observation model relies on a statistical abstraction of an image processing algorithm's output used to detect targets. As the POMDP problem cannot be known and thus optimized before the beginning of the flight, our main contribution is an ``optimize-while-execute'' algorithmic framework: it drives a POMDP sub-planner to optimize and execute the POMDP policy in parallel under action duration constraints. We present new results from real outdoor flights and SAIL simulations, which highlight both the benefits of using POMDPs in multi-target detection and recognition missions, and of our`optimize-while-execute'' paradigm

The joint role of trained, untrained, and observed actions at the origins of goal recognition

Recent findings across a variety of domains reveal the benefits of self-produced experience on object exploration, object knowledge, attention, and action perception. The influence of active experience may be particularly important in infancy, when motor development is undergoing great changes. Despite the importance of self-produced experience, we know that infants and young children are eventually able to gain knowledge through purely observational experience. In the current work, three-month-old infants were given experience with object-directed actions in one of three forms and their recognition of the goal of grasping actions was then assessed in a habituation paradigm. All infants were given the chance to manually interact with the toys without assistance (a difficult task for most three-month-olds). Two of the three groups were then given additional experience with object-directed actions, either through active training (in which Velcro mittens helped infants act more efficiently) or observational training. Findings support the conclusion that self-produced experience is uniquely informative for action perception and suggest that individual differences in spontaneous motor activity may interact with observational experience to inform action perception early in life.PostprintPeer reviewe

Investigation of air transportation technology at the Massachusetts Institute of Technology, 1988-1989

There are four areas of research being pursued in 1988 under sponsorship of the FAA/NASA Joint University Research Program, and one area which has been completed. The four active areas were: (1) Automatic Speech Recognition (ASR) in Air Traffic Control. The purpose of this research effort is to demonstrate the feasibility of using ASR technology within the ATC environment and to address the problems involved, especially the relevant human factors issues. (2) A Rule-Based Planning and Scheduling System. Planning denotes the formulation of a detailed scheme, program, or method worked out beforehand for the accomplishment of a goal. It involves the analysis of the desired goal and its division into sub-goals which are subsequently treated in the same way until a set of primitive objectives is obtained. (3) Modeling of Ice Accretion on Aircraft in Glaze Icing Conditions. The work in aircraft icing over the past year has focused on the fundamental aspects of glaze ice accretion, with the goal of improving analytical ice accretion models. Over the past year, studies have been conducted on the generation of surface roughness on accreting ice surfaces with the goal of providing a deterministic surface roughness in the ice accretion models. (4) Cockpit Display of Hazardous Weather Information. Information transfer and display issues associated with the dissemination of hazardous weather warnings are studied in the context of windshear alerts

Integrated plan generation and recognition : a logic-based approach

The work we present in this paper is settled within the field of intelligent help systems. Intelligent help systems aim at supporting users of application systems by the achievements of qualified experts. In order to provide such qualified support our approach is based on the integration of plan generation and plan recognition components. Plan recognition in this context serves to identify the users goals and so forms the basis for an active user support. The planning component dynamically generates plans which are proposed for the user to reach her goal. We introduce a logic-based approach where plan generation and plan recognition is done on a common logical basis and both components work in some kind of cross-talk