Decentralized Autonomous Navigation Strategies for Multi-Robot Search and Rescue

In this report, we try to improve the performance of existing approaches for search operations in multi-robot context. We propose three novel algorithms that are using a triangular grid pattern, i.e., robots certainly go through the vertices of a triangular grid during the search procedure. The main advantage of using a triangular grid pattern is that it is asymptotically optimal in terms of the minimum number of robots required for the complete coverage of an arbitrary bounded area. We use a new topological map which is made and shared by robots during the search operation. We consider an area that is unknown to the robots a priori with an arbitrary shape, containing some obstacles. Unlike many current heuristic algorithms, we give mathematically proofs of convergence of the algorithms. The computer simulation results for the proposed algorithms are presented using a simulator of real robots and environment. We evaluate the performance of the algorithms via experiments with real robots. We compare the performance of our own algorithms with three existing algorithms from other researchers. The results demonstrate the merits of our proposed solution. A further study on formation building with obstacle avoidance for a team of mobile robots is presented in this report. We propose a decentralized formation building with obstacle avoidance algorithm for a group of mobile robots to move in a defined geometric configuration. Furthermore, we consider a more complicated formation problem with a group of anonymous robots; these robots are not aware of their position in the final configuration and need to reach a consensus during the formation process. We propose a randomized algorithm for the anonymous robots that achieves the convergence to a desired configuration with probability 1. We also propose a novel obstacle avoidance rule, used in the formation building algorithm.Comment: arXiv admin note: substantial text overlap with arXiv:1402.5188 by other author

Decentralized Autonomous Navigation Strategies for Multi-Robot Search and Rescue

Use of multi-robot systems has many advantages over single robot systems in various applications. However, it comes with its own complexity and challenges. In this thesis, we try to improve the performance of existing approaches for search operations in multi-robot context. We propose three novel algorithms that are using a triangular grid pattern, i.e., robots certainly go through the vertices of a triangular grid during the search procedure. The main advantage of using a triangular grid pattern is that it is asymptotically optimal in terms of the minimum number of robots required for the complete coverage of an arbitrary bounded area. Therefore, using the vertices of this triangular grid coverage guarantees complete search of a region as well as shorter search duration. We use a new topological map which is made and shared by robots during the search operation. We consider an area that is unknown to the robots a priori with an arbitrary shape, containing some obstacles. Unlike many current heuristic algorithms, we give mathematically rigorous proofs of convergence with probability 1 of the algorithms. The computer simulation results for the proposed algorithms are presented using a simulator of real robots and environment. We evaluate the performance of the algorithms via experiments with real Pioneer 3DX mobile robots. We compare the performance of our own algorithms with three existing algorithms from other researchers. The results demonstrate the merits of our proposed solution. A further study on formation building with obstacle avoidance for a team of mobile robots is presented in this thesis. We propose a robust decentralized formation building with obstacle avoidance algorithm for a group of mobile robots to move in a defined geometric configuration. Furthermore, we consider a more complicated formation problem with a group of anonymous robots; these robots are not aware of their position in the final configuration and need to reach a consensus during the formation process. We propose a randomized algorithm for the anonymous robots that achieves the convergence to a desired configuration with probability 1. We also propose a novel obstacle avoidance rule, used in the formation building algorithm. A mathematically rigorous proof of the proposed algorithm is given. The performance and applicability of the proposed algorithm are confirmed by the computer simulation results

Proceedings of the 9th Conference on Autonomous Robot Systems and Competitions

Welcome to ROBOTICA 2009. This is the 9th edition of the conference on Autonomous Robot Systems and Competitions, the third time with IEEE‐Robotics and Automation Society Technical Co‐Sponsorship. Previous editions were held since 2001 in Guimarães, Aveiro, Porto, Lisboa, Coimbra and Algarve. ROBOTICA 2009 is held on the 7th May, 2009, in Castelo Branco , Portugal. ROBOTICA has received 32 paper submissions, from 10 countries, in South America, Asia and Europe. To evaluate each submission, three reviews by paper were performed by the international program committee. 23 papers were published in the proceedings and presented at the conference. Of these, 14 papers were selected for oral presentation and 9 papers were selected for poster presentation. The global acceptance ratio was 72%. After the conference, eighth papers will be published in the Portuguese journal Robótica, and the best student paper will be published in IEEE Multidisciplinary Engineering Education Magazine. Three prizes will be awarded in the conference for: the best conference paper, the best student paper and the best presentation. The last two, sponsored by the IEEE Education Society ‐ Student Activities Committee. We would like to express our thanks to all participants. First of all to the authors, whose quality work is the essence of this conference. Next, to all the members of the international program committee and reviewers, who helped us with their expertise and valuable time. We would also like to deeply thank the invited speaker, Jean Paul Laumond, LAAS‐CNRS France, for their excellent contribution in the field of humanoid robots. Finally, a word of appreciation for the hard work of the secretariat and volunteers. Our deep gratitude goes to the Scientific Organisations that kindly agreed to sponsor the Conference, and made it come true. We look forward to seeing more results of R&D work on Robotics at ROBOTICA 2010, somewhere in Portugal

Design of a strategy to obtain safe paths from collaborative robot teamwork

Documento en PDF a color.figuras, tablasThis doctoral thesis was designed and implemented using a strategy of explorer agents and a management and monitoring system to obtain the shortest and safest paths. The strategy was simulated using Matlab R2016 in 10 test environments. The comparisons were made between the results obtained by considering each robot's work and contrasting it with the results obtained by implementing the cooperative-collaborative strategy. For this purpose, were used two path planning algorithms, they are the A* and the Greedy Best First Search (GBFS). Some changes were made to these classic algorithms to improve their performance to guarantee interactions and comparisons between them, transforming them into Incremental Heuristic (IH) algorithms, which gave rise to a couple of agents with new path planners called IH-A* and IH-GBFS. The cooperative strategy was implemented with IH-A* and IH-GBFS algorithms to obtain the shortest paths. The cooperative process was used 300 times in 100 complete tests (3 times in 10 tests in each of 10 environments), which allowed determining that the strategy decreased the original path (without cooperation) in 79% of the cases. In 20.50% of cases, the author identified that the cooperative process, reduced to less than half the original path. The collaborative strategy was implemented to obtain the safer path, using a communications system that allows the interaction among the explorer agents, the test environment, and the management and monitoring system to generate early warnings and compare the risk between paths. In this work, the risk is due to hidden marks found by the explorer agents; for this reason, it is implemented a potential risk function that allows obtaining the path risk estimated. The path risk estimated metric is the one that facilitates the evaluation and comparison of risk between paths to find safer paths. The AWMRs operates using a kinematic model, a controller, a path planner, and sensors that allow them to navigate through the environment gently and safely. Simultaneously with the explorer agents, the administration and monitoring system as a user interface that facilitates the presentation and consolidation of results were implemented. Subsequently, 16 tests were carried out, implementing the complete cooperative-collaborative strategy in four different environments, which had hidden marks. When analyzing the results, it was determined that the Shortest Safest Estimated Path was found in 62.5% of the tests. A WMR and a square test stage were built. In the test scenario, 240 path tracking tests were carried out (the WMR travelled 24 different paths; the WMR travelled each path ten times). The path data were obtained using odometry with encoders onboard the robot and image processing through an external camera. The author apply a tracking error analysis on the WMR path, travelling a circumference of 3.64 m in length. When comparing the path obtained with the WMR kinematic model with the data obtained using image processing, a Mean Absolute Percentage Error (MAPE) of 2,807% was obtained; and with the odometry data, the MAPE was 1,224%. As a general conclusion, this study has numerically identified the relevance of the implementation of the cooperative-collaborative strategy in robotic teamwork to find shortest and safest paths, a strategy applied in test environments that have obstacles and hidden marks. The cooperative-collaborative strategy can be used in different applications that involve displacement in a dangerous place or environment, such as a minefield or a region at risk of spreading COVID-19.Esta tesis doctoral fue diseñada e implementada utilizando una estrategia de agentes exploradores y un sistema de gestión y seguimiento para obtener caminos más cortos y seguros. La estrategia se simuló utilizando Matlab R2016 en 10 entornos de prueba. Las comparaciones se realizaron entre los resultados obtenidos al considerar el trabajo realizado por cada robot y contrastarlo con los resultados obtenidos al implementar la estrategia cooperativa-colaborativa. Para ello, se utilizaron dos algoritmos de planificación de rutas, que son el A* y el Greedy Best First Search (GBFS). Se realizaron algunos cambios a estos algoritmos clásicos para mejorar su rendimiento para garantizar interacciones y comparaciones entre ellos, transformándolos en algoritmos Heurísticos Incrementales (IH), lo que dio lugar a un par de agentes con nuevos planificadores de rutas denominados IH-A * e IH- GBFS. La estrategia cooperativa se implementó con algoritmos IH-A * e IH-GBFS para obtener los caminos más cortos. El proceso cooperativo se utilizó 300 veces en 100 pruebas completas (3 veces en 10 pruebas en cada uno de los 10 entornos), lo que permitió determinar que la estrategia disminuyó la trayectoria original (sin cooperación) en el 79% de los casos. En el 20,50% de los casos, el autor identificó que el proceso cooperativo, redujo la distancia entre inicio y meta a menos de la mitad del recorrido original. La estrategia colaborativa se implementó para obtener el camino más seguro, utilizando un sistema de comunicaciones que permite la interacción entre los agentes exploradores, el entorno de prueba y el sistema de gestión y monitoreo para generar alertas tempranas y comparar el riesgo entre caminos. En este trabajo, el riesgo se debe a las marcas ocultas encontradas por los agentes exploradores; por ello, se implementa una función de riesgo potencial que permite obtener el riesgo de ruta estimado. La métrica estimada de riesgo de ruta es la que facilita la evaluación y comparación de riesgo entre rutas para encontrar rutas más seguras. Los robots autónomos móviles con ruedas (en inglés AWMR) operan utilizando un modelo cinemático, un controlador, un planificador de rutas y sensores que les permiten navegar por el entorno de manera suave y segura. Simultáneamente con los agentes exploradores, el autor implementó un sistema de administración y monitoreo como interfaz de usuario que facilita la presentación y consolidación de resultados. Posteriormente, se realizaron 16 pruebas, implementando la estrategia cooperativa-colaborativa completa en cuatro entornos diferentes, que tenían marcas ocultas. Al analizar los resultados, se determinó que una ruta estimada más corta y más segura se obtenía en el 62.5% de las pruebas. Se construyeron un WMR y un escenario de prueba cuadrado. En el escenario de prueba, se llevaron a cabo 240 pruebas de seguimiento de ruta (el WMR recorrió 24 rutas diferentes; el WMR recorrió cada ruta diez veces). Los datos de la trayectoria se obtuvieron utilizando odometría con encoders a bordo del robot y procesamiento de imágenes a través de una cámara externa. El autor aplica un análisis de error de seguimiento en la ruta recorrida por el WMR, generando una circunferencia de 3,64 m de longitud. Al comparar la ruta obtenida con el modelo cinemático del WMR con los datos obtenidos usando el procesamiento de imágenesse obtuvo un error de porcentaje absoluto medio (MAPE) de 2.807%; y con los datos de odometría, el MAPE fue de 1,224%. Como conclusión general, este estudio ha identificado numéricamente la relevancia de la implementación de la estrategia cooperativa-colaborativa en el trabajo en equipo robótico para encontrar caminos más cortos y seguros, estrategia aplicada en entornos de prueba que poseen obstáculos y marcas ocultas. La estrategia cooperativa-colaborativa puede ser utilizada en diferentes aplicaciones que involucran el desplazamiento en un lugar o entorno peligroso, como pueden ser un campo minado o una región en riesgo de propagación de COVID-19.DoctoradoDoctor en Ingeniería - Ingeniería Automátic

Multi-Agent Systems

A multi-agent system (MAS) is a system composed of multiple interacting intelligent agents. Multi-agent systems can be used to solve problems which are difficult or impossible for an individual agent or monolithic system to solve. Agent systems are open and extensible systems that allow for the deployment of autonomous and proactive software components. Multi-agent systems have been brought up and used in several application domains

Probabilistic Human-Robot Information Fusion

This thesis is concerned with combining the perceptual abilities of mobile robots and human operators to execute tasks cooperatively. It is generally agreed that a synergy of human and robotic skills offers an opportunity to enhance the capabilities of today’s robotic systems, while also increasing their robustness and reliability. Systems which incorporate both human and robotic information sources have the potential to build complex world models, essential for both automated and human decision making. In this work, humans and robots are regarded as equal team members who interact and communicate on a peer-to-peer basis. Human-robot communication is addressed using probabilistic representations common in robotics. While communication can in general be bidirectional, this work focuses primarily on human-to-robot information flow. More specifically, the approach advocated in this thesis is to let robots fuse their sensor observations with observations obtained from human operators. While robotic perception is well-suited for lower level world descriptions such as geometric properties, humans are able to contribute perceptual information on higher abstraction levels. Human input is translated into the machine representation via Human Sensor Models. A common mathematical framework for humans and robots reinforces the notion of true peer-to-peer interaction. Human-robot information fusion is demonstrated in two application domains: (1) scalable information gathering, and (2) cooperative decision making. Scalable information gathering is experimentally demonstrated on a system comprised of a ground vehicle, an unmanned air vehicle, and two human operators in a natural environment. Information from humans and robots was fused in a fully decentralised manner to build a shared environment representation on multiple abstraction levels. Results are presented in the form of information exchange patterns, qualitatively demonstrating the benefits of human-robot information fusion. The second application domain adds decision making to the human-robot task. Rational decisions are made based on the robots’ current beliefs which are generated by fusing human and robotic observations. Since humans are considered a valuable resource in this context, operators are only queried for input when the expected benefit of an observation exceeds the cost of obtaining it. The system can be seen as adjusting its autonomy at run-time based on the uncertainty in the robots’ beliefs. A navigation task is used to demonstrate the adjustable autonomy system experimentally. Results from two experiments are reported: a quantitative evaluation of human-robot team effectiveness, and a user study to compare the system to classical teleoperation. Results show the superiority of the system with respect to performance, operator workload, and usability

Advances in Reinforcement Learning

Reinforcement Learning (RL) is a very dynamic area in terms of theory and application. This book brings together many different aspects of the current research on several fields associated to RL which has been growing rapidly, producing a wide variety of learning algorithms for different applications. Based on 24 Chapters, it covers a very broad variety of topics in RL and their application in autonomous systems. A set of chapters in this book provide a general overview of RL while other chapters focus mostly on the applications of RL paradigms: Game Theory, Multi-Agent Theory, Robotic, Networking Technologies, Vehicular Navigation, Medicine and Industrial Logistic

Training of Crisis Mappers and Map Production from Multi-sensor Data: Vernazza Case Study (Cinque Terre National Park, Italy)

This aim of paper is to presents the development of a multidisciplinary project carried out by the cooperation between Politecnico di Torino and ITHACA (Information Technology for Humanitarian Assistance, Cooperation and Action). The goal of the project was the training in geospatial data acquiring and processing for students attending Architecture and Engineering Courses, in order to start up a team of "volunteer mappers". Indeed, the project is aimed to document the environmental and built heritage subject to disaster; the purpose is to improve the capabilities of the actors involved in the activities connected in geospatial data collection, integration and sharing. The proposed area for testing the training activities is the Cinque Terre National Park, registered in the World Heritage List since 1997. The area was affected by flood on the 25th of October 2011. According to other international experiences, the group is expected to be active after emergencies in order to upgrade maps, using data acquired by typical geomatic methods and techniques such as terrestrial and aerial Lidar, close-range and aerial photogrammetry, topographic and GNSS instruments etc.; or by non conventional systems and instruments such us UAV, mobile mapping etc. The ultimate goal is to implement a WebGIS platform to share all the data collected with local authorities and the Civil Protectio

Human Interaction with Robot Swarms: A Survey

Recent advances in technology are delivering robots of reduced size and cost. A natural outgrowth of these advances are systems comprised of large numbers of robots that collaborate autonomously in diverse applications. Research on effective autonomous control of such systems, commonly called swarms, has increased dramatically in recent years and received attention from many domains, such as bioinspired robotics and control theory. These kinds of distributed systems present novel challenges for the effective integration of human supervisors, operators, and teammates that are only beginning to be addressed. This paper is the first survey of human–swarm interaction (HSI) and identifies the core concepts needed to design a human–swarm system. We first present the basics of swarm robotics. Then, we introduce HSI from the perspective of a human operator by discussing the cognitive complexity of solving tasks with swarm systems. Next, we introduce the interface between swarm and operator and identify challenges and solutions relating to human–swarm communication, state estimation and visualization, and human control of swarms. For the latter, we develop a taxonomy of control methods that enable operators to control swarms effectively. Finally, we synthesize the results to highlight remaining challenges, unanswered questions, and open problems for HSI, as well as how to address them in future works