Analysis of multi-agent systems under varying degrees of trust, cooperation, and competition

Multi-agent systems rely heavily on coordination and cooperation to achieve a variety of tasks. It is often assumed that these agents will be fully cooperative, or have reliable and equal performance among group members. Instead, we consider cooperation as a spectrum of possible interactions, ranging from performance variations within the group to adversarial agents. This thesis examines several scenarios where cooperation and performance are not guaranteed. Potential applications include sensor coverage, emergency response, wildlife management, tracking, and surveillance. We use geometric methods, such as Voronoi tessellations, for design insight and Lyapunov-based stability theory to analyze our proposed controllers. Performance is verified through simulations and experiments on a variety of ground and aerial robotic platforms. First, we consider the problem of Voronoi-based coverage control, where a group of robots must spread out over an environment to provide coverage. Our approach adapts online to sensing and actuation performance variations with the group. The robots have no prior knowledge of their relative performance, and in a distributed fashion, compensate by assigning weaker robots a smaller portion of the environment. Next, we consider the problem of multi-agent herding, akin to shepherding. Here, a group of dog-like robots must drive a herd of non-cooperative sheep-like agents around the environment. Our key insight in designing the control laws for the herders is to enforce geometrical relationships that allow for the combined system dynamics to reduce to a single nonholonomic vehicle. We also investigate the cooperative pursuit of an evader by a group of quadrotors in an environment with no-fly zones. While the pursuers cannot enter the no-fly zones, the evader moves freely through the zones to avoid capture. Using tools for Voronoi-based coverage control, we provide an algorithm to distribute the pursuers around the zone's boundary and minimize capture time once the evader emerges. Finally, we present an algorithm for the guaranteed capture of multiple evaders by one or more pursuers in a bounded, convex environment. The pursuers utilize properties of the evader's Voronoi cell to choose a control strategy that minimizes the safe-reachable area of the evader, which in turn leads to the evader's capture

Decentralized Motion Planning with Collision Avoidance for a Team of UAVs under High Level Goals

This paper addresses the motion planning problem for a team of aerial agents under high level goals. We propose a hybrid control strategy that guarantees the accomplishment of each agent's local goal specification, which is given as a temporal logic formula, while guaranteeing inter-agent collision avoidance. In particular, by defining 3-D spheres that bound the agents' volume, we extend previous work on decentralized navigation functions and propose control laws that navigate the agents among predefined regions of interest of the workspace while avoiding collision with each other. This allows us to abstract the motion of the agents as finite transition systems and, by employing standard formal verification techniques, to derive a high-level control algorithm that satisfies the agents' specifications. Simulation and experimental results with quadrotors verify the validity of the proposed method.Comment: Submitted to the IEEE International Conference on Robotics and Automation (ICRA), Singapore, 201

Game-Theoretic Safety Assurance for Human-Centered Robotic Systems

In order for autonomous systems like robots, drones, and self-driving cars to be reliably introduced into our society, they must have the ability to actively account for safety during their operation. While safety analysis has traditionally been conducted offline for controlled environments like cages on factory floors, the much higher complexity of open, human-populated spaces like our homes, cities, and roads makes it unviable to rely on common design-time assumptions, since these may be violated once the system is deployed. Instead, the next generation of robotic technologies will need to reason about safety online, constructing high-confidence assurances informed by ongoing observations of the environment and other agents, in spite of models of them being necessarily fallible.This dissertation aims to lay down the necessary foundations to enable autonomous systems to ensure their own safety in complex, changing, and uncertain environments, by explicitly reasoning about the gap between their models and the real world. It first introduces a suite of novel robust optimal control formulations and algorithmic tools that permit tractable safety analysis in time-varying, multi-agent systems, as well as safe real-time robotic navigation in partially unknown environments; these approaches are demonstrated on large-scale unmanned air traffic simulation and physical quadrotor platforms. After this, it draws on Bayesian machine learning methods to translate model-based guarantees into high-confidence assurances, monitoring the reliability of predictive models in light of changing evidence about the physical system and surrounding agents. This principle is first applied to a general safety framework allowing the use of learning-based control (e.g. reinforcement learning) for safety-critical robotic systems such as drones, and then combined with insights from cognitive science and dynamic game theory to enable safe human-centered navigation and interaction; these techniques are showcased on physical quadrotors—flying in unmodeled wind and among human pedestrians—and simulated highway driving. The dissertation ends with a discussion of challenges and opportunities ahead, including the bridging of safety analysis and reinforcement learning and the need to ``close the loop'' around learning and adaptation in order to deploy increasingly advanced autonomous systems with confidence

Mosquito-inspired Swarming and Pursuit for Autonomous Rotorcraft

The long-term goal of this research is to design cooperative-control algorithms for autonomous vehicles inspired by the collective behaviors in animal groups. The specific research objectives of this dissertation are twofold: (1) to analyze and model the swarming and pursuit behaviors observed in the mating swarms of mosquitoes, and (2) to design mosquito-inspired control algorithms to perform swarming and pursuit with autonomous rotorcraft. The first part of this dissertation analyzes the reconstructed flight data of the malarial mosquito Anopheles gambiae to characterize the velocity-alignment interaction between male mosquitoes, who aggregate to form mating swarms and subsequently pursue a female mosquito. Both swarming and pursuit behaviors are represented using self-propelled particle models. The model is used together with tools from control theory to investigate the connection between velocity-alignment behavior and success in pursuit. The results of this research have a potential impact on vector-control methods for malaria, and are also utilized in the second part of this dissertation. The second part of this dissertation studies two types of pursuit problems inspired by the collective behavior in mosquito swarms. The first problem considers the strategy for a single pursuer chasing a single target. This problem has been studied extensively for the application to missile guidance and navigation. Here, we tailor the assumptions on the dynamics of the agents as well as the design criteria for the application to small and agile rotorcraft. The second pursuit problem incorporates the swarming behavior by considering a scenario in which multiple guardian vehicles are deployed to protect an area against fast intruders. We derive necessary and sufficient conditions for capturing the intruder. We also present swarming strategies to maximize the performance of the guardians, inspired by the random-oscillatory motion and the velocity-alignment behavior of male mosquitoes

Visibility maximization with unmanned aerial vehicles in complex environments

Thesis (S.M.)--Massachusetts Institute of Technology, Dept. of Aeronautics and Astronautics, 2010.This electronic version was submitted by the student author. The certified thesis is available in the Institute Archives and Special Collections.Cataloged from student-submitted PDF version of thesis.Includes bibliographical references (p. 157-164).Unmanned aerial vehicles are used extensively in persistent surveillance, search and track, border patrol, and environment monitoring applications. Each of these applications requires the obtainment of information using a dynamic observer equipped with a constrained sensor. Information can only be gained when visibility exists between the sensor and a number of targets in a cluttered environment. Maximizing visibility is therefore essential for acquiring as much information about targets as possible, to subsequently enable informed decision making. Proposed is an algorithm that can design a maximum visibility path given models of the vehicle, target, sensor, environment, and visibility. An approximate visibility, finite-horizon dynamic programming approach is used to find flyable, maximum visibility paths. This algorithm is compared against a state-of-the-art optimal control solver for validation. Complex scenarios involving multiple stationary or moving targets are considered, leading to loiter patterns or pursuit paths which negotiate planar, three-dimensional, or elevation environment models. Robustness to disturbances is addressed by treating targets as regions instead of points, to improve visibility performance in the presence of uncertainty. A testbed implementation validates the algorithm in a hardware setting with a quadrotor observer, multiple moving ground vehicle targets, and an urban-like setting providing occlusions to visibility.by Kenneth Lee.S.M

Design of autonomous sustainable unmanned aerial vehicle - A novel approach to its dynamic wireless power transfer

A thesis submitted in partial fulfilment of the requirements of the University of Wolverhampton for the degree of Doctor of Philosophy.Electric UAVs are presently being used widely in civilian duties such as security, surveillance, and disaster relief. The use of Unmanned Aerial Vehicle (UAV) has increased dramatically over the past years in different areas/fields such as marines, mountains, wild environments. Nowadays, there are many electric UAVs development with fast computational speed and autonomous flying has been a reality by fusing many sensors such as camera tracking sensor, obstacle avoiding sensor, radar sensor, etc. But there is one main problem still not able to overcome which is power requirement for continuous autonomous operation. When the operation needs more power, but batteries can only give for 20 to 30 mins of flight time. These types of system are not reliable for long term civilian operation because we need to recharge or replace batteries by landing the craft every time when we want to continue the operation. The large batteries also take more loads on the UAV which is also not a reliable system. To eliminate these obstacles, there should a recharging wireless power station in ground which can transmit power to these small UAVs wirelessly for long term operation. There will be camera attached in the drone to detect and hover above the Wireless Power Transfer device which got receiving and transmitting station can be use with deep learning and sensor fusion techniques for more reliable flight operations. This thesis explores the use of dynamic wireless power to transfer energy using novel rotating WPT charging technique to the UAV with improved range, endurance, and average speed by giving extra hours in the air. The hypothesis that was created has a broad application beyond UAVs. The drone autonomous charging was mostly done by detecting a rotating WPT receiver connected to main power outlet that served as a recharging platform using deep neural vision capabilities. It was the purpose of the thesis to provide an alternative to traditional self-charging systems that relies purely on static WPT method and requires little distance between the vehicle and receiver. When the UAV camera detect the WPT receiving station, it will try to align and hover using onboard sensors for best power transfer efficiency. Since this strategy relied on traditional automatic drone landing technique, but the target is rotating all the time which needs smart approaches like deep learning and sensor fusion. The simulation environment was created and tested using robot operating system on a Linux operating system using a model of the custom-made drone. Experiments on the charging of the drone confirmed that the intelligent dynamic wireless power transfer (DWPT) method worked successfully while flying on air