Causal simulation and sensor planning in predictive monitoring

Two issues are addressed which arise in the task of detecting anomalous behavior in complex systems with numerous sensor channels: how to adjust alarm thresholds dynamically, within the changing operating context of the system, and how to utilize sensors selectively, so that nominal operation can be verified reliably without processing a prohibitive amount of sensor data. The approach involves simulation of a causal model of the system, which provides information on expected sensor values, and on dependencies between predicted events, useful in assessing the relative importance of events so that sensor resources can be allocated effectively. The potential applicability of this work to the execution monitoring of robot task plans is briefly discussed

Vision-based deep execution monitoring

Execution monitor of high-level robot actions can be effectively improved by visual monitoring the state of the world in terms of preconditions and postconditions that hold before and after the execution of an action. Furthermore a policy for searching where to look at, either for verifying the relations that specify the pre and postconditions or to refocus in case of a failure, can tremendously improve the robot execution in an uncharted environment. It is now possible to strongly rely on visual perception in order to make the assumption that the environment is observable, by the amazing results of deep learning. In this work we present visual execution monitoring for a robot executing tasks in an uncharted Lab environment. The execution monitor interacts with the environment via a visual stream that uses two DCNN for recognizing the objects the robot has to deal with and manipulate, and a non-parametric Bayes estimation to discover the relations out of the DCNN features. To recover from lack of focus and failures due to missed objects we resort to visual search policies via deep reinforcement learning

Monitoring robot actions for error detection and recovery

Reliability is a serious problem in computer controlled robot systems. Although robots serve successfully in relatively simple applications such as painting and spot welding, their potential in areas such as automated assembly is hampered by programming problems. A program for assembling parts may be logically correct, execute correctly on a simulator, and even execute correctly on a robot most of the time, yet still fail unexpectedly in the face of real world uncertainties. Recovery from such errors is far more complicated than recovery from simple controller errors, since even expected errors can often manifest themselves in unexpected ways. Here, a novel approach is presented for improving robot reliability. Instead of anticipating errors, researchers use knowledge-based programming techniques so that the robot can autonomously exploit knowledge about its task and environment to detect and recover from failures. They describe preliminary experiment of a system that they designed and constructed

Diagnosing faults in autonomous robot plan execution

A major requirement for an autonomous robot is the capability to diagnose faults during plan execution in an uncertain environment. Many diagnostic researches concentrate only on hardware failures within an autonomous robot. Taking a different approach, the implementation of a Telerobot Diagnostic System that addresses, in addition to the hardware failures, failures caused by unexpected event changes in the environment or failures due to plan errors, is described. One feature of the system is the utilization of task-plan knowledge and context information to deduce fault symptoms. This forward deduction provides valuable information on past activities and the current expectations of a robotic event, both of which can guide the plan-execution inference process. The inference process adopts a model-based technique to recreate the plan-execution process and to confirm fault-source hypotheses. This technique allows the system to diagnose multiple faults due to either unexpected plan failures or hardware errors. This research initiates a major effort to investigate relationships between hardware faults and plan errors, relationships which were not addressed in the past. The results of this research will provide a clear understanding of how to generate a better task planner for an autonomous robot and how to recover the robot from faults in a critical environment

ECLSS predictive monitoring

On Space Station Freedom (SSF), design iterations have made clear the need to keep the sensor complement small. Along with the unprecendented duration of the mission, it is imperative that decisions regarding placement of sensors be carefully examined and justified during the design phase. In the ECLSS Predictive Monitoring task, we are developing AI-based software to enable design engineers to evaluate alternate sensor configurations. Based on techniques from model-based reasoning and information theory, the software tool makes explicit the quantitative tradeoffs among competing sensor placements, and helps designers explore and justify placement decisions. This work is being applied to the Environmental Control and Life Support System (ECLSS) testbed at MSFC to assist design personnel in placing sensors for test purposes to evaluate baseline configurations and ultimately to select advanced life support system technologies for evolutionary SSF

Towards Social Comparison for Failure Detection

Abstract Social comparison, the process in which individuals compare their behavior and beliefs to those of other agents, is an important process in human societies. Our aim is to utilize theories of this process for synthetic agents, for the purposes of enabling social skills, teamcoordination, and greater individual agent performance. Our current focus is on individual failure detection and recovery in multi-agent settings. We present a novel approach, SOCFAD, inspired by Social Comparison Theory from social psychology. SOCFAD includes the following key novel concepts: (a) utilizing other agents the environment as information sources for failure detection, and (b) a detection and recovery method for previously undetectable failures using abductive inference based on other agents' beliefs 1

Visual search and recognition for robot task execution and monitoring

Visual search of relevant targets in the environment is a crucial robot skill. We propose a preliminary framework for the execution monitor of a robot task, taking care of the robot attitude to visually searching the environment for targets involved in the task. Visual search is also relevant to recover from a failure. The framework exploits deep reinforcement learning to acquire a "common sense" scene structure and it takes advantage of a deep convolutional network to detect objects and relevant relations holding between them. The framework builds on these methods to introduce a vision-based execution monitoring, which uses classical planning as a backbone for task execution. Experiments show that with the proposed vision-based execution monitor the robot can complete simple tasks and can recover from failures in autonomy

Beyond the Baseline 1991: Proceedings of the Space Station Evolution Symposium. Volume 2: Space Station Freedom, part 2

Individual presentations delivered at the Space Station Evolution Symposium in League City, Texas, on August 6, 7, and 8, 1991 are given in viewgraph form. Personnel responsible for Advanced Systems Studies and Advanced Development within the Space Station Freedom Program reported on the results of their work to date. Special attention is given to highlighting changes made during restructuring; a description of the growth paths through the follow-on and evolution stages; identification of the minimum impact provisions to allow flexibility in the baseline; and identification of enhancing and enabling technologies

Proceedings of the NASA Conference on Space Telerobotics, volume 1

The theme of the Conference was man-machine collaboration in space. Topics addressed include: redundant manipulators; man-machine systems; telerobot architecture; remote sensing and planning; navigation; neural networks; fundamental AI research; and reasoning under uncertainty