Design and Development of an Integrated Mobile Robot System for Use in Simple Formations

In recent years, formation control of autonomous unmanned vehicles has become an active area of research with its many broad applications in areas such as transportation and surveillance. The work presented in this thesis involves the design and implementation of small unmanned ground vehicles to be used in leader-follower formations. This mechatronics project involves breadth in areas of mechanical, electrical, and computer engineering design. A vehicle with a unicycle-type drive mechanism is designed in 3D CAD software and manufactured using 3D printing capabilities. The vehicle is then modeled using the unicycle kinematic equations of motion and simulated in MATLAB/Simulink. Simple motion tasks are then performed onboard the vehicle utilizing the vehicle model via software, and leader-follower formations are implemented with multiple vehicles

Optimal Multi-UAV Trajectory Planning for Filming Applications

Teams of multiple Unmanned Aerial Vehicles (UAVs) can be used to record large-scale outdoor scenarios and complementary views of several action points as a promising system for cinematic video recording. Generating the trajectories of the UAVs plays a key role, as it should be ensured that they comply with requirements for system dynamics, smoothness, and safety. The rise of numerical methods for nonlinear optimization is finding a ourishing field in optimization-based approaches to multi- UAV trajectory planning. In particular, these methods are rather promising for video recording applications, as they enable multiple constraints and objectives to be formulated, such as trajectory smoothness, compliance with UAV and camera dynamics, avoidance of obstacles and inter-UAV con icts, and mutual UAV visibility. The main objective of this thesis is to plan online trajectories for multi-UAV teams in video applications, formulating novel optimization problems and solving them in real time. The thesis begins by presenting a framework for carrying out autonomous cinematography missions with a team of UAVs. This framework enables media directors to design missions involving different types of shots with one or multiple cameras, running sequentially or concurrently. Second, the thesis proposes a novel non-linear formulation for the challenging problem of computing optimal multi-UAV trajectories for cinematography, integrating UAV dynamics and collision avoidance constraints, together with cinematographic aspects such as smoothness, gimbal mechanical limits, and mutual camera visibility. Lastly, the thesis describes a method for autonomous aerial recording with distributed lighting by a team of UAVs. The multi-UAV trajectory optimization problem is decoupled into two steps in order to tackle non-linear cinematographic aspects and obstacle avoidance at separate stages. This allows the trajectory planner to perform in real time and to react online to changes in dynamic environments. It is important to note that all the methods in the thesis have been validated by means of extensive simulations and field experiments. Moreover, all the software components have been developed as open source.Los equipos de vehículos aéreos no tripulados (UAV) son sistemas prometedores para grabar eventos cinematográficos, en escenarios exteriores de grandes dimensiones difíciles de cubrir o para tomar vistas complementarias de diferentes puntos de acción. La generación de trayectorias para este tipo de vehículos desempeña un papel fundamental, ya que debe garantizarse que se cumplan requisitos dinámicos, de suavidad y de seguridad. Los enfoques basados en la optimización para la planificación de trayectorias de múltiples UAVs se pueden ver beneficiados por el auge de los métodos numéricos para la resolución de problemas de optimización no lineales. En particular, estos métodos son bastante prometedores para las aplicaciones de grabación de vídeo, ya que permiten formular múltiples restricciones y objetivos, como la suavidad de la trayectoria, el cumplimiento de la dinámica del UAV y de la cámara, la evitación de obstáculos y de conflictos entre UAVs, y la visibilidad mutua. El objetivo principal de esta tesis es planificar trayectorias para equipos multi-UAV en aplicaciones de vídeo, formulando novedosos problemas de optimización y resolviéndolos en tiempo real. La tesis comienza presentando un marco de trabajo para la realización de misiones cinematográficas autónomas con un equipo de UAVs. Este marco permite a los directores de medios de comunicación diseñar misiones que incluyan diferentes tipos de tomas con una o varias cámaras, ejecutadas de forma secuencial o concurrente. En segundo lugar, la tesis propone una novedosa formulación no lineal para el difícil problema de calcular las trayectorias óptimas de los vehículos aéreos no tripulados en cinematografía, integrando en el problema la dinámica de los UAVs y las restricciones para evitar colisiones, junto con aspectos cinematográficos como la suavidad, los límites mecánicos del cardán y la visibilidad mutua de las cámaras. Por último, la tesis describe un método de grabación aérea autónoma con iluminación distribuida por un equipo de UAVs. El problema de optimización de trayectorias se desacopla en dos pasos para abordar los aspectos cinematográficos no lineales y la evitación de obstáculos en etapas separadas. Esto permite al planificador de trayectorias actuar en tiempo real y reaccionar en línea a los cambios en los entornos dinámicos. Es importante señalar que todos los métodos de la tesis han sido validados mediante extensas simulaciones y experimentos de campo. Además, todos los componentes del software se han desarrollado como código abierto

Swarm Robotics

Collectively working robot teams can solve a problem more efficiently than a single robot, while also providing robustness and flexibility to the group. Swarm robotics model is a key component of a cooperative algorithm that controls the behaviors and interactions of all individuals. The robots in the swarm should have some basic functions, such as sensing, communicating, and monitoring, and satisfy the following properties

해양 작업 지원선의 자율 운항 및 설치 작업 지원을 위한 시뮬레이션 방법

학위논문 (박사)-- 서울대학교 대학원 : 공과대학 조선해양공학과, 2019. 2. 노명일.Autonomous ships have gained a huge amount of interest in recent years, like their counterparts on land{autonomous cars, because of their potential to significantly lower the cost of operation, attract seagoing professionals and increase transportation safety. Technologies developed for the autonomous ships have potential to notably reduce maritime accidents where 75% cases can be attributed to human error and a significant proportion of these are caused by fatigue and attention deficit. However, developing a high-level autonomous system which can operate in an unstructured and unpredictable environment is still a challenging task. When the autonomous ships are operating in the congested waterway with other manned or unmanned vessels, the collision avoidance algorithm is the crucial point in keeping the safety of both the own ship and any encountered ships. Instead of developing new traffic rules for the autonomous ships to avoid collisions with each other, autonomous ships are expected to follow the existing guidelines based on the International Regulations for Preventing Collisions at Sea (COLREGs). Furthermore, when using the crane on the autonomous ship to transfer and install subsea equipment to the seabed, the heave and swaying phenomenon of the subsea equipment at the end of flexible wire ropes makes its positioning at an exact position is very difficult. As a result, an Anti-Motion Control (AMC) system for the crane is necessary to ensure the successful installation operation. The autonomous ship is highly relying on the effectiveness of autonomous systems such as autonomous path following system, collision avoidance system, crane control system and so on. During the previous two decades, considerable attention has been paid to develop robust autonomous systems. However, several are facing challenges and it is worthwhile devoting much effort to this. First of all, the development and testing of the proposed control algorithms should be adapted across a variety of environmental conditions including wave, wind, and current. This is one of the challenges of this work aimed at creating an autonomous path following and collision avoidance system in the ship. Secondly, the collision avoidance system has to comply with the regulations and rules in developing an autonomous ship. Thirdly, AMC system with anti-sway abilities for a knuckle boom crane remains problems regarding its under-actuated mechanism. At last, the performance of the control system should be evaluated in advance of the operation to perform its function successfully. In particular, such performance analysis is often very costly and time-consuming, and realistic conditions are typically impossible to establish in a testing environment. Consequently, to address these issues, we proposed a simulation framework with the following scenarios, which including the autonomous navigation scenario and crane operation scenario. The research object of this study is an autonomous offshore support vessel (OSV), which provides support services to offshore oil and gas field development such as offshore drilling, pipe laying, and oil producing assets (production platforms and FPSOs) utilized in EP (Exploration Production) activities. Assume that the autonomous OSV confronts an urgent mission under the harsh environmental conditions: on the way to an imperative offshore construction site, the autonomous OSV has to avoid target ships while following a predefined path. When arriving at the construction site, it starts to install a piece of subsea equipment on the seabed. So what technologies are needed, what should be invested for ensuring the autonomous OSV could robustly kilometers from shore, and how can an autonomous OSV be made at least as safe as the conventional ship. In this dissertation, we focus on the above critical activities for answering the above questions. In the general context of the autonomous navigation and crane control problem, the objective of this dissertation is thus fivefold: • Developing a COLREGs-compliant collision avoidance system. • Building a robust path following and collision avoidance system which can handle the unknown and complicated environment. • Investigating an efficient multi-ship collision avoidance method enable it easy to extend. • Proposing a hardware-in-the-loop simulation environment for the AHC system. • Solving the anti-sway problem of the knuckle boom crane on an autonomous OSV. First of all, we propose a novel deep reinforcement learning (RL) algorithm to achieve effective and efficient capabilities of the path following and collision avoidance system. To perform and verify the proposed algorithm, we conducted simulations for an autonomous ship under unknown environmental disturbance iiito adjust its heading in real-time. A three-degree-of-freedom dynamic model of the autonomous ship was developed, and the Line-of-sight (LOS) guidance system was used to converge the autonomous ship to follow the predefined path. Then, a proximal policy optimization (PPO) algorithm was implemented on the problem. By applying the advanced deep RL method, in which the autonomous OSV learns the best behavior through repeated trials to determine a safe and economical avoidance behavior in various circumstances. The simulation results showed that the proposed algorithm has the capabilities to guarantee collision avoidance of moving encountered ships while ensuring following a predefined path. Also, the algorithm demonstrated that it could manage complex scenarios with various encountered ships in compliance with COLREGs and have the excellent adaptability to the unknown, sophisticated environment. Next, the AMC system includes Anti-Heave Control (AHC) and Anti-Sway Control (ASC), which is applied to install subsea equipment in regular and irregular for performance analysis. We used the proportional-integral-derivative (PID) control method and the sliding mode control method respectively to achieve the control objective. The simulation results show that heave and sway motion could be significantly reduced by the proposed control methods during the construction. Moreover, to evaluate the proposed control system, we have constructed the HILS environment for the AHC system, then conducted a performance analysis of it. The simulation results show the AHC system could be evaluated effectively within the HILS environment. We can conclude that the proposed or adopted methods solve the problems issued in autonomous system design.해양 작업 지원선 (Offshore Support Vessel: OSV)의 경우 극한의 환경에도 불구하고 출항하여 해상에서 작업을 수행해야 하는 경우가 있다. 이러한 위험에의 노출을 최소화하기 위해 자율 운항에 대한 요구가 증가하고 있다. 여기서의 자율 운항은 선박이 출발지에서 목적지까지 사람의 도움 없이 이동함을 의미한다. 자율 운항 방법은 경로 추종 방법과 충돌 회피 방법을 포함한다. 우선, 운항 및 작업 중 환경 하중 (바람, 파도, 조류 등)에 대한 고려를 해야 하고, 국제 해상 충돌 예방 규칙 (Convention of the International Regulations for Preventing Collisions at Sea, COLREGs)에 의한 선박간의 항법 규정을 고려하여 충돌 회피 규칙을 준수해야 한다. 특히 연근해의 복잡한 해역에서는 많은 선박을 자동으로 회피할 필요가 있다. 기존의 해석적인 방법을 사용하기 위해서는 선박들에 대한 정확한 시스템 모델링이 되어야 하며, 그 과정에서 경험 (experience)에 의존하는 파라미터 튜닝이 필수적이다. 또한, 회피해야 할 선박 수가 많아질 경우 시스템 모델이 커지게 되고 계산 양과 계산 시간이 늘어나 실시간 적용이 어렵다는 단점이 있다. 또한, 경로 추종 및 충돌 회피를 포함하여 자율 운항 방법을 적용하기가 어렵다. 따라서 본 연구에서는 강화 학습 (Reinforcement Learning: RL) 기법을 이용하여 기존 해석적인 방법의 문제점을 극복할 수 있는 방법을 제안하였다. 경로를 추종하는 선박 (agent)은 외부 환경 (environment)과 상호작용하면서 학습을 진행한다. State S_0 (선박의 움직임과 관련된 각종 상태) 가지는 agent는 policy (현재 위치에서 어떤 움직임을 선택할 것인가)에 따라 action A_0 (움직일 방향) 취한다. 이에 environment는 agent의 다음 state S_1 을 계산하고, 그에 따른 보상 R_0 (해당 움직임의 적합성)을 결정하여 agent에게 전달한다. 이러한 작업을 반복하면서 보상이 최대가 되도록 policy를 학습하게 된다. 한편, 해상에서 크레인을 이용한 장비의 이동이나 설치 작업 시 위험을 줄이기 위해 크레인의 거동 제어에 대한 요구가 증가하고 있다. 특히 해상에서는 선박의 운동에 의해 크레인에 매달린 물체가 상하 동요 (heave)와 크레인을 기준으로 좌우 동요 (sway)가 발생하는데, 이러한 운동은 작업을 지연시키고, 정확한 위치에 물체를 놓지 못하게 하며, 자칫 주변 구조물과의 충돌을 야기할 수 있다. 이와 같은 동요를 최소화하는 Anti-Motion Control (AMC) 시스템은 Anti-Heave Control (AHC)과 Anti-Sway Control (ASC)을 포함한다. 본 연구에서는 해양 작업 지원선에 적합한 AMC 시스템의 설계 및 검증 방법을 연구하였다. 먼저 상하 동요를 최소화하기 위해 크레인의 와이어 길이를 능동적으로 조정하는 AHC 시스템을 설계하였다. 또한, 기존의 제어 시스템의 검증 방법은 실제 선박이나 해양 구조물에 해당 제어 시스템을 직접 설치하기 전에는 그 성능을 테스트하기가 힘들었다. 이를 해결하기 위해 본 연구에서는 Hardware-In-the-Loop Simulation (HILS) 기법을 활용하여 AHC 시스템의 검증 방법을 연구하였다. 또한, ASC 시스템을 설계할 때 제어 대상이 under-actuated 시스템이기 때문에 제어하기가 매우 어렵다. 따라서 본 연구에서는 sliding mode control 알고리즘을 이용하며 다관절 크레인 (knuckle boom crane)의 관절 (joint) 각도를 제어하여 좌우 동요를 줄일 수 있는 ASC 시스템을 설계하였다.Chapter 1 Introduction 1 1.1 Background and Motivation . . . . . . . . . . . . . . . . . . . . . 1 1.2 Requirements for Autonomous Operation . . . . . . . . . . . . . 5 1.2.1 Path Following for Autonomous Ship . . . . . . . . . . . . 5 1.2.2 Collision Avoidance for Autonomous Ship . . . . . . . . . 5 1.2.3 Anti-Motion Control System for Autonomous Ship . . . . 6 1.3 Related Work . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 9 1.3.1 Related Work for Path Following System . . . . . . . . . 9 1.3.2 Related Work for Collision Avoidance System . . . . . . . 9 1.3.3 Related Work for Anti-Heave Control System . . . . . . . 13 1.3.4 Related Work for Anti-Sway Control System . . . . . . . 14 1.4 Configuration of Simulation Framework . . . . . . . . . . . . . . 16 1.4.1 Application Layer . . . . . . . . . . . . . . . . . . . . . . 16 1.4.2 Autonomous Ship Design Layer . . . . . . . . . . . . . . . 17 1.4.3 General Technique Layer . . . . . . . . . . . . . . . . . . 17 1.5 Contributions (Originality) . . . . . . . . . . . . . . . . . . . . . 19 Chapter 2 Theoretical Backgrounds 20 2.1 Maneuvering Model for Autonomous Ship . . . . . . . . . . . . . 20 2.1.1 Kinematic Equation for Autonomous Ship . . . . . . . . . 20 2.1.2 Kinetic Equation for Autonomous Ship . . . . . . . . . . 21 2.2 Multibody Dynamics Model for Knuckle Boom Crane of Autonomous Ship. . . 25 2.2.1 Embedding Techniques . . . . . . . . . . . . . . . . . . . . 25 2.3 Control System Design . . . . . . . . . . . . . . . . . . . . . . . . 31 2.3.1 Proportional-Integral-Derivative (PID) Control . . . . . . 31 2.3.2 Sliding Mode Control . . . . . . . . . . . . . . . . . . . . 31 2.4 Deep Reinforcement Learning Algorithm . . . . . . . . . . . . . . 34 2.4.1 Value Based Learning Method . . . . . . . . . . . . . . . 36 2.4.2 Policy Based Learning Method . . . . . . . . . . . . . . . 37 2.4.3 Actor-Critic Method . . . . . . . . . . . . . . . . . . . . . 41 2.5 Hardware-in-the-Loop Simulation . . . . . . . . . . . . . . . . . . 43 2.5.1 Integrated Simulation Method . . . . . . . . . . . . . . . 43 Chapter 3 Path Following Method for Autonomous OSV 46 3.1 Guidance System . . . . . . . . . . . . . . . . . . . . . . . . . . . 46 3.1.1 Line-of-sight Guidance System . . . . . . . . . . . . . . . 46 3.2 Deep Reinforcement Learning for Path Following System . . . . . 50 3.2.1 Deep Reinforcement Learning Setup . . . . . . . . . . . . 50 3.2.2 Neural Network Architecture . . . . . . . . . . . . . . . . 56 3.2.3 Training Process . . . . . . . . . . . . . . . . . . . . . . . 58 3.3 Implementation and Simulation Result . . . . . . . . . . . . . . . 62 3.3.1 Implementation for Path Following System . . . . . . . . 62 3.3.2 Simulation Result . . . . . . . . . . . . . . . . . . . . . . 65 3.4 Comparison Results . . . . . . . . . . . . . . . . . . . . . . . . . 83 3.4.1 Comparison Result of PPO with PID . . . . . . . . . . . 83 3.4.2 Comparison Result of PPO with Deep Q-Network (DQN) 87 Chapter 4 Collision Avoidance Method for Autonomous OSV 89 4.1 Deep Reinforcement Learning for Collision Avoidance System . . 89 4.1.1 Deep Reinforcement Learning Setup . . . . . . . . . . . . 89 4.1.2 Neural Network Architecture . . . . . . . . . . . . . . . . 93 4.1.3 Training Process . . . . . . . . . . . . . . . . . . . . . . . 94 4.2 Implementation and Simulation Result . . . . . . . . . . . . . . . 95 4.2.1 Implementation for Collision Avoidance System . . . . . . 95 4.2.2 Simulation Result . . . . . . . . . . . . . . . . . . . . . . 100 4.3 Implementation and Simulation Result for Multi-ship Collision Avoidance Method . . . . . . . . . . . . . . . . . . . . . . . . . . 107 4.3.1 Limitations of Multi-ship Collision Avoidance Method - 1 107 4.3.2 Limitations of Multi-ship Collision Avoidance Method - 2 108 4.3.3 Implementation of Multi-ship Collision Avoidance Method 110 4.3.4 Simulation Result of Multi-ship Collision Avoidance Method 118 Chapter 5 Anti-Motion Control Method for Knuckle Boom Crane 129 5.1 Configuration of HILS for Anti-Heave Control System . . . . . . 129 5.1.1 Virtual Mechanical System . . . . . . . . . . . . . . . . . 132 5.1.2 Virtual Sensor and Actuator . . . . . . . . . . . . . . . . 138 5.1.3 Control System Design . . . . . . . . . . . . . . . . . . . . 141 5.1.4 Integrated Simulation Interface . . . . . . . . . . . . . . . 142 5.2 Implementation and Simulation Result of HILS for Anti-Heave Control System . . . . . . . . 145 5.2.1 Implementation of HILS for Anti-Heave Control System . 145 5.2.2 Simulation Result of HILS for Anti-Heave Control System 146 5.3 Validation of HILS for Anti-Heave Control System . . . . . . . . 159 5.3.1 Hardware Setup . . . . . . . . . . . . . . . . . . . . . . . 159 5.3.2 Comparison Result . . . . . . . . . . . . . . . . . . . . . . 161 5.4 Configuration of Anti-Sway Control System . . . . . . . . . . . . 162 5.4.1 Mechanical System for Knuckle Boom Crane . . . . . . . 162 5.4.2 Anti-Sway Control System Design . . . . . . . . . . . . . 165 5.4.3 Implementation and Simulation Result of Anti-Sway Control . . . . . . . . . . . . . . 168 Chapter 6 Conclusions and Future Works 176 Bibliography 178 Chapter A Appendix 186 국문초록 188Docto

Decentralized Autonomous Navigation Strategies for Multi-Robot Search and Rescue

In this report, we try to improve the performance of existing approaches for search operations in multi-robot context. We propose three novel algorithms that are using a triangular grid pattern, i.e., robots certainly go through the vertices of a triangular grid during the search procedure. The main advantage of using a triangular grid pattern is that it is asymptotically optimal in terms of the minimum number of robots required for the complete coverage of an arbitrary bounded area. We use a new topological map which is made and shared by robots during the search operation. We consider an area that is unknown to the robots a priori with an arbitrary shape, containing some obstacles. Unlike many current heuristic algorithms, we give mathematically proofs of convergence of the algorithms. The computer simulation results for the proposed algorithms are presented using a simulator of real robots and environment. We evaluate the performance of the algorithms via experiments with real robots. We compare the performance of our own algorithms with three existing algorithms from other researchers. The results demonstrate the merits of our proposed solution. A further study on formation building with obstacle avoidance for a team of mobile robots is presented in this report. We propose a decentralized formation building with obstacle avoidance algorithm for a group of mobile robots to move in a defined geometric configuration. Furthermore, we consider a more complicated formation problem with a group of anonymous robots; these robots are not aware of their position in the final configuration and need to reach a consensus during the formation process. We propose a randomized algorithm for the anonymous robots that achieves the convergence to a desired configuration with probability 1. We also propose a novel obstacle avoidance rule, used in the formation building algorithm.Comment: arXiv admin note: substantial text overlap with arXiv:1402.5188 by other author

Reactive Control Of Autonomous Dynamical Systems

This thesis mainly consists of five independent papers concerning the reactive control design of autonomous mobile robots in the context of target tracking and cooperative formation keeping with obstacle avoidance in the static/dynamic environment. Technical contents of this thesis are divided into three parts. The first part consists of the first two papers, which consider the target-tracking and obstacle avoidance in the static environment. Especially, in the static environment, a fundamental issue of reactive control design is the local minima problem(LMP) inherent in the potential field methods(PFMs). Through introducing a state-dependent planned goal, the first paper proposes a switching control strategy to tackle this problem. The control law for the planned goal is presented. When trapped into local minima, the robot can escape from local minima by following the planned goal. The proposed control law also takes into account the presence of possible saturation constraints. In addition, a time-varying continuous control law is proposed in the second paper to tackle this problem. Challenges of finding continuous control solutions of LMP are discussed and explicit design strategies are then proposed. The second part of this thesis deals with target-tracking and obstacle avoidance in the dynamic environment. In the third paper, a reactive control design is presented for omnidirectional mobile robots with limited sensor range to track targets while avoiding static and moving obstacles in a dynamically evolving environment. Towards this end, a multiiii objective control problem is formulated and control is synthesized by generating a potential field force for each objective and combining them through analysis and design. Different from standard potential field methods, the composite potential field described in this paper is time-varying and planned to account for moving obstacles and vehicle motion. In order to accommodate a larger class of mobile robots, the fourth paper proposes a reactive control design for unicycle-type mobile robots. With the relative motion among the mobile robot, targets, and obstacles being formulated in polar coordinates, kinematic control laws achieving target-tracking and obstacle avoidance are synthesized using Lyapunov based technique, and more importantly, the proposed control laws also take into account possible kinematic control saturation constraints. The third part of this thesis investigates the cooperative formation control with collision avoidance. In the fifth paper, firstly, the target tracking and collision avoidance problem for a single agent is studied. Instead of directly extending the single agent controls to the multiagents case, the single agent controls are incorporated with the cooperative control design presented in [1]. The proposed decentralized control is reactive, considers the formation feedback and changes in the communication networks. The proposed control is based on a potential field method, its inherent oscillation problem is also studied to improve group transient performance

Mobile Robots Navigation

Mobile robots navigation includes different interrelated activities: (i) perception, as obtaining and interpreting sensory information; (ii) exploration, as the strategy that guides the robot to select the next direction to go; (iii) mapping, involving the construction of a spatial representation by using the sensory information perceived; (iv) localization, as the strategy to estimate the robot position within the spatial map; (v) path planning, as the strategy to find a path towards a goal location being optimal or not; and (vi) path execution, where motor actions are determined and adapted to environmental changes. The book addresses those activities by integrating results from the research work of several authors all over the world. Research cases are documented in 32 chapters organized within 7 categories next described

Underwater Vehicles

For the latest twenty to thirty years, a significant number of AUVs has been created for the solving of wide spectrum of scientific and applied tasks of ocean development and research. For the short time period the AUVs have shown the efficiency at performance of complex search and inspection works and opened a number of new important applications. Initially the information about AUVs had mainly review-advertising character but now more attention is paid to practical achievements, problems and systems technologies. AUVs are losing their prototype status and have become a fully operational, reliable and effective tool and modern multi-purpose AUVs represent the new class of underwater robotic objects with inherent tasks and practical applications, particular features of technology, systems structure and functional properties

Adaptive and learning-based formation control of swarm robots

Autonomous aerial and wheeled mobile robots play a major role in tasks such as search and rescue, transportation, monitoring, and inspection. However, these operations are faced with a few open challenges including robust autonomy, and adaptive coordination based on the environment and operating conditions, particularly in swarm robots with limited communication and perception capabilities. Furthermore, the computational complexity increases exponentially with the number of robots in the swarm. This thesis examines two different aspects of the formation control problem. On the one hand, we investigate how formation could be performed by swarm robots with limited communication and perception (e.g., Crazyflie nano quadrotor). On the other hand, we explore human-swarm interaction (HSI) and different shared-control mechanisms between human and swarm robots (e.g., BristleBot) for artistic creation. In particular, we combine bio-inspired (i.e., flocking, foraging) techniques with learning-based control strategies (using artificial neural networks) for adaptive control of multi- robots. We first review how learning-based control and networked dynamical systems can be used to assign distributed and decentralized policies to individual robots such that the desired formation emerges from their collective behavior. We proceed by presenting a novel flocking control for UAV swarm using deep reinforcement learning. We formulate the flocking formation problem as a partially observable Markov decision process (POMDP), and consider a leader-follower configuration, where consensus among all UAVs is used to train a shared control policy, and each UAV performs actions based on the local information it collects. In addition, to avoid collision among UAVs and guarantee flocking and navigation, a reward function is added with the global flocking maintenance, mutual reward, and a collision penalty. We adapt deep deterministic policy gradient (DDPG) with centralized training and decentralized execution to obtain the flocking control policy using actor-critic networks and a global state space matrix. In the context of swarm robotics in arts, we investigate how the formation paradigm can serve as an interaction modality for artists to aesthetically utilize swarms. In particular, we explore particle swarm optimization (PSO) and random walk to control the communication between a team of robots with swarming behavior for musical creation

Distributed Control of a Swarm of Autonomous Unmanned Aerial Vehicles

With the increasing use of Unmanned Aerial Vehicles (UAV)s military operations, there is a growing need to develop new methods of control and navigation for these vehicles. This investigation proposes the use of an adaptive swarming algorithm that utilizes local state information to influence the overall behavior of each individual agent in the swarm based upon the agent\u27s current position in the battlespace. In order to investigate the ability of this algorithm to control UAVs in a cooperative manner, a swarm architecture is developed that allows for on-line modification of basic rules. Adaptation is achieved by using a set of behavior coefficients that define the weight at which each of four basic rules is asserted in an individual based upon local state information. An Evolutionary Strategy (ES) is employed to create initial metrics of behavior coefficients. Using this technique, three distinct emergent swarm behaviors are evolved, and each behavior is investigated in terms of the ability of the adaptive swarming algorithm to achieve the desired emergent behavior by modifying the simple rules of each agent. Finally, each of the three behaviors is analyzed visually using a graphical representation of the simulation, and numerically, using a set of metrics developed for this investigation