Design of a strategy to obtain safe paths from collaborative robot teamwork

Documento en PDF a color.figuras, tablasThis doctoral thesis was designed and implemented using a strategy of explorer agents and a management and monitoring system to obtain the shortest and safest paths. The strategy was simulated using Matlab R2016 in 10 test environments. The comparisons were made between the results obtained by considering each robot's work and contrasting it with the results obtained by implementing the cooperative-collaborative strategy. For this purpose, were used two path planning algorithms, they are the A* and the Greedy Best First Search (GBFS). Some changes were made to these classic algorithms to improve their performance to guarantee interactions and comparisons between them, transforming them into Incremental Heuristic (IH) algorithms, which gave rise to a couple of agents with new path planners called IH-A* and IH-GBFS. The cooperative strategy was implemented with IH-A* and IH-GBFS algorithms to obtain the shortest paths. The cooperative process was used 300 times in 100 complete tests (3 times in 10 tests in each of 10 environments), which allowed determining that the strategy decreased the original path (without cooperation) in 79% of the cases. In 20.50% of cases, the author identified that the cooperative process, reduced to less than half the original path. The collaborative strategy was implemented to obtain the safer path, using a communications system that allows the interaction among the explorer agents, the test environment, and the management and monitoring system to generate early warnings and compare the risk between paths. In this work, the risk is due to hidden marks found by the explorer agents; for this reason, it is implemented a potential risk function that allows obtaining the path risk estimated. The path risk estimated metric is the one that facilitates the evaluation and comparison of risk between paths to find safer paths. The AWMRs operates using a kinematic model, a controller, a path planner, and sensors that allow them to navigate through the environment gently and safely. Simultaneously with the explorer agents, the administration and monitoring system as a user interface that facilitates the presentation and consolidation of results were implemented. Subsequently, 16 tests were carried out, implementing the complete cooperative-collaborative strategy in four different environments, which had hidden marks. When analyzing the results, it was determined that the Shortest Safest Estimated Path was found in 62.5% of the tests. A WMR and a square test stage were built. In the test scenario, 240 path tracking tests were carried out (the WMR travelled 24 different paths; the WMR travelled each path ten times). The path data were obtained using odometry with encoders onboard the robot and image processing through an external camera. The author apply a tracking error analysis on the WMR path, travelling a circumference of 3.64 m in length. When comparing the path obtained with the WMR kinematic model with the data obtained using image processing, a Mean Absolute Percentage Error (MAPE) of 2,807% was obtained; and with the odometry data, the MAPE was 1,224%. As a general conclusion, this study has numerically identified the relevance of the implementation of the cooperative-collaborative strategy in robotic teamwork to find shortest and safest paths, a strategy applied in test environments that have obstacles and hidden marks. The cooperative-collaborative strategy can be used in different applications that involve displacement in a dangerous place or environment, such as a minefield or a region at risk of spreading COVID-19.Esta tesis doctoral fue diseñada e implementada utilizando una estrategia de agentes exploradores y un sistema de gestión y seguimiento para obtener caminos más cortos y seguros. La estrategia se simuló utilizando Matlab R2016 en 10 entornos de prueba. Las comparaciones se realizaron entre los resultados obtenidos al considerar el trabajo realizado por cada robot y contrastarlo con los resultados obtenidos al implementar la estrategia cooperativa-colaborativa. Para ello, se utilizaron dos algoritmos de planificación de rutas, que son el A* y el Greedy Best First Search (GBFS). Se realizaron algunos cambios a estos algoritmos clásicos para mejorar su rendimiento para garantizar interacciones y comparaciones entre ellos, transformándolos en algoritmos Heurísticos Incrementales (IH), lo que dio lugar a un par de agentes con nuevos planificadores de rutas denominados IH-A * e IH- GBFS. La estrategia cooperativa se implementó con algoritmos IH-A * e IH-GBFS para obtener los caminos más cortos. El proceso cooperativo se utilizó 300 veces en 100 pruebas completas (3 veces en 10 pruebas en cada uno de los 10 entornos), lo que permitió determinar que la estrategia disminuyó la trayectoria original (sin cooperación) en el 79% de los casos. En el 20,50% de los casos, el autor identificó que el proceso cooperativo, redujo la distancia entre inicio y meta a menos de la mitad del recorrido original. La estrategia colaborativa se implementó para obtener el camino más seguro, utilizando un sistema de comunicaciones que permite la interacción entre los agentes exploradores, el entorno de prueba y el sistema de gestión y monitoreo para generar alertas tempranas y comparar el riesgo entre caminos. En este trabajo, el riesgo se debe a las marcas ocultas encontradas por los agentes exploradores; por ello, se implementa una función de riesgo potencial que permite obtener el riesgo de ruta estimado. La métrica estimada de riesgo de ruta es la que facilita la evaluación y comparación de riesgo entre rutas para encontrar rutas más seguras. Los robots autónomos móviles con ruedas (en inglés AWMR) operan utilizando un modelo cinemático, un controlador, un planificador de rutas y sensores que les permiten navegar por el entorno de manera suave y segura. Simultáneamente con los agentes exploradores, el autor implementó un sistema de administración y monitoreo como interfaz de usuario que facilita la presentación y consolidación de resultados. Posteriormente, se realizaron 16 pruebas, implementando la estrategia cooperativa-colaborativa completa en cuatro entornos diferentes, que tenían marcas ocultas. Al analizar los resultados, se determinó que una ruta estimada más corta y más segura se obtenía en el 62.5% de las pruebas. Se construyeron un WMR y un escenario de prueba cuadrado. En el escenario de prueba, se llevaron a cabo 240 pruebas de seguimiento de ruta (el WMR recorrió 24 rutas diferentes; el WMR recorrió cada ruta diez veces). Los datos de la trayectoria se obtuvieron utilizando odometría con encoders a bordo del robot y procesamiento de imágenes a través de una cámara externa. El autor aplica un análisis de error de seguimiento en la ruta recorrida por el WMR, generando una circunferencia de 3,64 m de longitud. Al comparar la ruta obtenida con el modelo cinemático del WMR con los datos obtenidos usando el procesamiento de imágenesse obtuvo un error de porcentaje absoluto medio (MAPE) de 2.807%; y con los datos de odometría, el MAPE fue de 1,224%. Como conclusión general, este estudio ha identificado numéricamente la relevancia de la implementación de la estrategia cooperativa-colaborativa en el trabajo en equipo robótico para encontrar caminos más cortos y seguros, estrategia aplicada en entornos de prueba que poseen obstáculos y marcas ocultas. La estrategia cooperativa-colaborativa puede ser utilizada en diferentes aplicaciones que involucran el desplazamiento en un lugar o entorno peligroso, como pueden ser un campo minado o una región en riesgo de propagación de COVID-19.DoctoradoDoctor en Ingeniería - Ingeniería Automátic

General Concepts for Human Supervision of Autonomous Robot Teams

For many dangerous, dirty or dull tasks like in search and rescue missions, deployment of autonomous teams of robots can be beneficial due to several reasons. First, robots can replace humans in the workspace. Second, autonomous robots reduce the workload of a human compared to teleoperated robots, and therefore multiple robots can in principle be supervised by a single human. Third, teams of robots allow distributed operation in time and space. This thesis investigates concepts of how to efficiently enable a human to supervise and support an autonomous robot team, as common concepts for teleoperation of robots do not apply because of the high mental workload. The goal is to find a way in between the two extremes of full autonomy and pure teleoperation, by allowing to adapt the robots’ level of autonomy to the current situation and the needs of the human supervisor. The methods presented in this thesis make use of the complementary strengths of humans and robots, by letting the robots do what they are good at, while the human should support the robots in situations that correspond to the human strengths. To enable this type of collaboration between a human and a robot team, the human needs to have an adequate knowledge about the current state of the robots, the environment, and the mission. For this purpose, the concept of situation overview (SO) has been developed in this thesis, which is composed of the two components robot SO and mission SO. Robot SO includes information about the state and activities of each single robot in the team, while mission SO deals with the progress of the mission and the cooperation between the robots. For obtaining SO a new event-based communication concept is presented in this thesis, that allows the robots to aggregate information into discrete events using methods from complex event processing. The quality and quantity of the events that are actually sent to the supervisor can be adapted during runtime by defining positive and negative policies for (not) sending events that fulfill specific criteria. This reduces the required communication bandwidth compared to sending all available data. Based on SO, the supervisor is enabled to efficiently interact with the robot team. Interactions can be initiated either by the human or by the robots. The developed concept for robot-initiated interactions is based on queries, that allow the robots to transfer decisions to another process or the supervisor. Various modes for answering the queries, ranging from fully autonomous to pure human decisions, allow to adapt the robots’ level of autonomy during runtime. Human-initiated interactions are limited to high-level commands, whereas interactions on the action level (e. g., teleoperation) are avoided, to account for the specific strengths of humans and robots. These commands can in principle be applied to quite general classes of task allocation methods for autonomous robot teams, e. g., in terms of specific restrictions, which are introduced into the system as constraints. In that way, the desired allocations emerge implicitly because of the introduced constraints, and the task allocation method does not need to be aware of the human supervisor in the loop. This method is applicable to different task allocation approaches, e. g., instantaneous or time-extended task assignments, and centralized or distributed algorithms. The presented methods are evaluated by a number of different experiments with physical and simulated scenarios from urban search and rescue as well as robot soccer, and during robot competitions. The results show that with these methods a human supervisor can significantly improve the robot team performance

Assessing the Role of Critical Value Factors (CVFs) on Users’ Resistance of Urban Search and Rescue Robotics

Natural and manmade disasters have brought urban search and rescue (USAR) robots to the technology forefront as a means of providing additional support for search and rescue workers. The loss of life among victims and rescue workers necessitates the need for a wider acceptance of this assistive technology. Disasters, such as hurricane Harvey in 2017, hurricane Sandy in 2012, the 2012 United States tornadoes that devastated 17 states, the 2011 Australian floods, the 2011 Japan and 2010 Haiti earthquakes, the 2010 West Virginia coal mine explosions, the 2009 Typhoon caused mudslides in Taiwan, the 2001 Collapse of the World Trade Center, the 2005 Hurricane Katrina, the 1995 Oklahoma City bombing, and the 1995 Kobe Japan earthquake all benefited from the use of USAR. While there has been a push for use of USAR for disaster, user resistance to such technology is still significantly understudied. This study applied a mixed quantitative and qualitative approach to identify important system characteristics and critical value factors (CVFs) that contribute to team members’ resistance to use such technology. The populations for this study included 2,500 USAR team members from the Houston Professional Fire Fighters Association (HPFFA), and the expected sample size of approximately 250 respondents. The main goal of this quantitative study was to examine system characteristics and CVFs that contribute to USAR team members’ resistance to use such technology. System characteristics and CVFs are associated with USAR. Furthermore, the study utilized multivariate linear regression (MLR) and multivariate analysis of covariance (ANCOVA) to determine if, and to what extent, CVFs and computer self-efficacy (CSE) interact to influence USAR team members’ resistance to use such technology. This quantitative study will test for significant differences on CVF’s, CSE, and resistance to use such technology based on age, gender, prior experience with USAR events, years of USAR experience, and organizational role. The contribution of this study was to reduce USAR team members’ resistance to use such technology in an effort minimize risk to USAR team members while maintaining their lifesaving capability

Recognizing Teamwork Activity In Observations Of Embodied Agents

This thesis presents contributions to the theory and practice of team activity recognition. A particular focus of our work was to improve our ability to collect and label representative samples, thus making the team activity recognition more efficient. A second focus of our work is improving the robustness of the recognition process in the presence of noisy and distorted data. The main contributions of this thesis are as follows: We developed a software tool, the Teamwork Scenario Editor (TSE), for the acquisition, segmentation and labeling of teamwork data. Using the TSE we acquired a corpus of labeled team actions both from synthetic and real world sources. We developed an approach through which representations of idealized team actions can be acquired in form of Hidden Markov Models which are trained using a small set of representative examples segmented and labeled with the TSE. We developed set of team-oriented feature functions, which extract discrete features from the high-dimensional continuous data. The features were chosen such that they mimic the features used by humans when recognizing teamwork actions. We developed a technique to recognize the likely roles played by agents in teams even before the team action was recognized. Through experimental studies we show that the feature functions and role recognition module significantly increase the recognition accuracy, while allowing arbitrary shuffled inputs and noisy data

DSAAR: distributed software architecture for autonomous robots

Dissertação apresentada na Faculdade de Ciências e Tecnologia da Universidade Nova de Lisboa para obtenção do grau de Mestre em Engenharia ElectrotécnicaThis dissertation presents a software architecture called the Distributed Software Architecture for Autonomous Robots (DSAAR), which is designed to provide the fast development and prototyping of multi-robot systems. The DSAAR building blocks allow engineers to focus on the behavioural model of robots and collectives. This architecture is of special interest in domains where several human, robot, and software agents have to interact continuously. Thus, fast prototyping and reusability is a must. DSAAR tries to cope with these requirements towards an advanced solution to the n-humans and m-robots problem with a set of design good practices and development tools. This dissertation will also focus on Human-Robot Interaction, mainly on the subject of teleoperation. In teleoperation human judgement is an integral part of the process, heavily influenced by the telemetry data received from the remote environment. So the speed in which commands are given and the telemetry data is received, is of crucial importance. Using the DSAAR architecture a teleoperation approach is proposed. This approach was designed to provide all entities present in the network a shared reality, where every entity is an information source in an approach similar to the distributed blackboard. This solution was designed to accomplish a real time response, as well as, the completest perception of the robots’ surroundings. Experimental results obtained with the physical robot suggest that the system is able to guarantee a close interaction between users and robot

A Survey and Analysis of Multi-Robot Coordination

International audienceIn the field of mobile robotics, the study of multi-robot systems (MRSs) has grown significantly in size and importance in recent years. Having made great progress in the development of the basic problems concerning single-robot control, many researchers shifted their focus to the study of multi-robot coordination. This paper presents a systematic survey and analysis of the existing literature on coordination, especially in multiple mobile robot systems (MMRSs). A series of related problems have been reviewed, which include a communication mechanism, a planning strategy and a decision-making structure. A brief conclusion and further research perspectives are given at the end of the paper

Multi-Robot Coordination and Scheduling for Deactivation & Decommissioning

Large quantities of high-level radioactive waste were generated during WWII. This waste is being stored in facilities such as double-shell tanks in Washington, and the Waste Isolation Pilot Plant in New Mexico. Due to the dangerous nature of radioactive waste, these facilities must undergo periodic inspections to ensure that leaks are detected quickly. In this work, we provide a set of methodologies to aid in the monitoring and inspection of these hazardous facilities. This allows inspection of dangerous regions without a human operator, and for the inspection of locations where a person would not be physically able to enter. First, we describe a robot equipped with sensors which uses a modified A* path-planning algorithm to navigate in a complex environment with a tether constraint. This is then augmented with an adaptive informative path planning approach that uses the assimilated sensor data within a Gaussian Process distribution model. The model\u27s predictive outputs are used to adaptively plan the robot\u27s path, to quickly map and localize areas from an unknown field of interest. The work was validated in extensive simulation testing and early hardware tests. Next, we focused on how to assign tasks to a heterogeneous set of robots. Task assignment is done in a manner which allows for task-robot dependencies, prioritization of tasks, collision checking, and more realistic travel estimates among other improvements from the state-of-the-art. Simulation testing of this work shows an increase in the number of tasks which are completed ahead of a deadline. Finally, we consider the case where robots are not able to complete planned tasks fully autonomously and require operator assistance during parts of their planned trajectory. We present a sampling-based methodology for allocating operator attention across multiple robots, or across different parts of a more sophisticated robot. This allows few operators to oversee large numbers of robots, allowing for a more scalable robotic infrastructure. This work was tested in simulation for both multi-robot deployment, and high degree-of-freedom robots, and was also tested in multi-robot hardware deployments. The work here can allow robots to carry out complex tasks, autonomously or with operator assistance. Altogether, these three components provide a comprehensive approach towards robotic deployment within the deactivation and decommissioning tasks faced by the Department of Energy

Virtual Reality Games for Motor Rehabilitation

This paper presents a fuzzy logic based method to track user satisfaction without the need for devices to monitor users physiological conditions. User satisfaction is the key to any product’s acceptance; computer applications and video games provide a unique opportunity to provide a tailored environment for each user to better suit their needs. We have implemented a non-adaptive fuzzy logic model of emotion, based on the emotional component of the Fuzzy Logic Adaptive Model of Emotion (FLAME) proposed by El-Nasr, to estimate player emotion in UnrealTournament 2004. In this paper we describe the implementation of this system and present the results of one of several play tests. Our research contradicts the current literature that suggests physiological measurements are needed. We show that it is possible to use a software only method to estimate user emotion