Adaptive and learning-based formation control of swarm robots

Autonomous aerial and wheeled mobile robots play a major role in tasks such as search and rescue, transportation, monitoring, and inspection. However, these operations are faced with a few open challenges including robust autonomy, and adaptive coordination based on the environment and operating conditions, particularly in swarm robots with limited communication and perception capabilities. Furthermore, the computational complexity increases exponentially with the number of robots in the swarm. This thesis examines two different aspects of the formation control problem. On the one hand, we investigate how formation could be performed by swarm robots with limited communication and perception (e.g., Crazyflie nano quadrotor). On the other hand, we explore human-swarm interaction (HSI) and different shared-control mechanisms between human and swarm robots (e.g., BristleBot) for artistic creation. In particular, we combine bio-inspired (i.e., flocking, foraging) techniques with learning-based control strategies (using artificial neural networks) for adaptive control of multi- robots. We first review how learning-based control and networked dynamical systems can be used to assign distributed and decentralized policies to individual robots such that the desired formation emerges from their collective behavior. We proceed by presenting a novel flocking control for UAV swarm using deep reinforcement learning. We formulate the flocking formation problem as a partially observable Markov decision process (POMDP), and consider a leader-follower configuration, where consensus among all UAVs is used to train a shared control policy, and each UAV performs actions based on the local information it collects. In addition, to avoid collision among UAVs and guarantee flocking and navigation, a reward function is added with the global flocking maintenance, mutual reward, and a collision penalty. We adapt deep deterministic policy gradient (DDPG) with centralized training and decentralized execution to obtain the flocking control policy using actor-critic networks and a global state space matrix. In the context of swarm robotics in arts, we investigate how the formation paradigm can serve as an interaction modality for artists to aesthetically utilize swarms. In particular, we explore particle swarm optimization (PSO) and random walk to control the communication between a team of robots with swarming behavior for musical creation

????????? ????????? ????????? ???????????? ????????? ?????? ?????? ??? ?????? ??????

Department of Mechanical EngineeringThe potential danger of invisible hazardous substance leakage accident is increasing, such as hazardous chemical leakage accidents in industrial complexes, potential risks of aging nuclear power plants, and international chemical terrorism threats. In particular, hazardous chemical, biological, or radioactive substances leaked into the atmosphere cause irreversible damage to nature, and there is a risk of human damage if prompt action is not taken. Therefore, estimating the emission source and the amount of invisible hazardous substances is required to minimize human casualties and increase public safety. As the risk of hazardous material leakage and potential terrorism increases in random places, it is difficult using traditional systems such as pre-installed ground sensors in a specific area. This thesis proposes autonomous search method for estimating the source of hazardous materials using a mobile sensor attached to an unmanned aerial vehicle (UAV). Since the mobile sensor can be freely deployed to any arbitrary places, it is possible to monitor a wider area with a relatively low cost. Besides, this approach is an unmanned autonomous system, so it has the advantage of minimizing secondary human casualties that may additionally occur during search. The source term estimation (STE) using mobile sensors is considered to be a challenging problem because the sensor measurements from atmospheric gas dispersion are sparse, intermittent, and time-varying due to the turbulence and the sensor noise. Thus, Bayesian inference-based estimation technique, sequential Monte Carlo method (i.e., particle filter), is used to estimate the source by using the inaccurate measurements which is easily influenced by air turbulence and sensor noise in this thesis. The autonomous search algorithms using information theory are also proposed. In the proposed algorithms, the information entropy (i.e., uncertainty of estimation) is calculated by using information theory and the agent choose the action to move to the next sensing location that can minimize the expected uncertainty. In other words, the proposed information-theoretic search algorithm is reward-based decision making approaches that use information entropy as a reward. The receding horizon and Gaussian mixture model clustering approaches are adopted to improve the search performance in various environment. Since the time required to compute all of the respective rewards increases as the number of action candidates increases, the policy-based autonomous source term search and estimation algorithm is proposed using deep neural network and reinforcement learning approach to determine efficient search path considering continuous action space. Furthermore, this thesis proposes a cooperative search method for multiple unmanned mobile vehicles based on game theory. The inaccuracy of sensor measurement values can be reduced by using multiple mobile sensors with the fusion approach, so the source of hazardous substances can be quickly estimated. The negotiation based on the game theory can improve the group search performance for source term estimation and search. Finally, to verify the performance of the proposed algorithm, numerical simulation and flight test results using an actual gas measurement sensor and multicopter drone are presented.ope

Intelligent Autonomous Decision-Making and Cooperative Control Technology of High-Speed Vehicle Swarms

This book is a reprint of the Special Issue “Intelligent Autonomous Decision-Making and Cooperative Control Technology of High-Speed Vehicle Swarms”,which was published in Applied Sciences

A Decentralized Architecture for Active Sensor Networks

This thesis is concerned with the Distributed Information Gathering (DIG) problem in which a Sensor Network is tasked with building a common representation of environment. The problem is motivated by the advantages offered by distributed autonomous sensing systems and the challenges they present. The focus of this study is on Macro Sensor Networks, characterized by platform mobility, heterogeneous teams, and long mission duration. The system under consideration may consist of an arbitrary number of mobile autonomous robots, stationary sensor platforms, and human operators, all linked in a network. This work describes a comprehensive framework called Active Sensor Network (ASN) which addresses the tasks of information fusion, decistion making, system configuration, and user interaction. The main design objectives are scalability with the number of robotic platforms, maximum flexibility in implementation and deployment, and robustness to component and communication failure. The framework is described from three complementary points of view: architecture, algorithms, and implementation. The main contribution of this thesis is the development of the ASN architecture. Its design follows three guiding principles: decentralization, modularity, and locality of interactions. These principles are applied to all aspects of the architecture and the framework in general. To achieve flexibility, the design approach emphasizes interactions between components rather than the definition of the components themselves. The architecture specifies a small set of interfaces sufficient to implement a wide range of information gathering systems. In the area of algorithms, this thesis builds on the earlier work on Decentralized Data Fusion (DDF) and its extension to information-theoretic decistion making. It presents the Bayesian Decentralized Data Fusion (BDDF) algorithm formulated for environment features represented by a general probability density function. Several specific representations are also considered: Gaussian, discrete, and the Certainty Grid map. Well known algorithms for these representations are shown to implement various aspects of the Bayesian framework. As part of the ASN implementation, a practical indoor sensor network has been developed and tested. Two series of experiments were conducted, utilizing two types of environment representation: 1) point features with Gaussian position uncertainty and 2) Certainty Grid maps. The network was operational for several days at a time, with individual platforms coming on and off-line. On several occasions, the network consisted of 39 software components. The lessons learned during the system's development may be applicable to other heterogeneous distributed systems with data-intensive algorithms

Minimum time search in real-world scenarios using multiple UAVs with onboard orientable cameras

This paper proposes a new evolutionary planner to determine the trajectories of several Unmanned Aerial Vehicles (UAVs) and the scan direction of their cameras for minimizing the expected detection time of a nondeterministically moving target of uncertain initial location. To achieve this, the planner can reorient the UAVs cameras and modify the UAVs heading, speed, and height with the purpose of making the UAV reach and the camera observe faster the areas with high probability of target presence. Besides, the planner uses a digital elevation model of the search region to capture its influence on the camera likelihood (changing the footprint dimensions and the probability of detection) and to help the operator to construct the initial belief of target presence and target motion model. The planner also lets the operator include intelligence information in the initial target belief and motion model, in order to let him/her model real-world scenarios systematically. All these characteristics let the planner adapt the UAV trajectories and sensor poses to the requirements of minimum time search operations over real-world scenarios, as the results of the paper, obtained over 3 scenarios built with the modeling aid-tools of the planner, show.This work was supported by Airbus under SAVIER AER30459 projec