Optimal steering for kinematic vehicles with applications to spatially distributed agents

The recent technological advances in the field of autonomous vehicles have resulted in a growing impetus for researchers to improve the current framework of mission planning and execution within both the military and civilian contexts. Many recent efforts towards this direction emphasize the importance of replacing the so-called monolithic paradigm, where a mission is planned, monitored, and controlled by a unique global decision maker, with a network centric paradigm, where the same mission related tasks are performed by networks of interacting decision makers (autonomous vehicles). The interest in applications involving teams of autonomous vehicles is expected to significantly grow in the near future as new paradigms for their use are constantly being proposed for a diverse spectrum of real world applications. One promising approach to extend available techniques for addressing problems involving a single autonomous vehicle to those involving teams of autonomous vehicles is to use the concept of Voronoi diagram as a means for reducing the complexity of the multi-vehicle problem. In particular, the Voronoi diagram provides a spatial partition of the environment the team of vehicles operate in, where each element of this partition is associated with a unique vehicle from the team. The partition induces, in turn, a graph abstraction of the operating space that is in a one-to-one correspondence with the network abstraction of the team of autonomous vehicles; a fact that can provide both conceptual and analytical advantages during mission planning and execution. In this dissertation, we propose the use of a new class of Voronoi-like partitioning schemes with respect to state-dependent proximity (pseudo-) metrics rather than the Euclidean distance or other generalized distance functions, which are typically used in the literature. An important nuance here is that, in contrast to the Euclidean distance, state-dependent metrics can succinctly capture system theoretic features of each vehicle from the team (e.g., vehicle kinematics), as well as the environment-vehicle interactions, which are induced, for example, by local winds/currents. We subsequently illustrate how the proposed concept of state-dependent Voronoi-like partition can induce local control schemes for problems involving networks of spatially distributed autonomous vehicles by examining different application scenarios.PhDCommittee Chair: Tsiotras Panagiotis; Committee Member: Egerstedt Magnus; Committee Member: Feron Eric; Committee Member: Haddad Wassim; Committee Member: Shamma Jef

Stability of a class of multi-agent tracking systems with unstable subsystems

In this work, we pre-deploy a large number of smart agents to monitor an area of interest. This area could be divided into many Voronoi cells by using the knowledge of Voronoi diagram and every Voronoi site agent is responsible for monitoring and tracking the target in its cell. Then, a cooperative relay tracking strategy is proposed such that during the tracking process, when a target enters a new Voronoi cell, this event triggers the switching of both tracking agents and communication topology. This is significantly different from the traditional switching topologies. In addition, during the tracking process, the topology and tracking agents switch, which may lead the tracking system to be stable or unstable. The system switches either among consecutive stable subsystems and consecutive unstable subsystems or between stable and unstable subsystems. The objective of this paper is to design a tracking strategy guaranteeing overall successful tracking despite the existence of unstable subsystems. We also address extended discussions on the case where the dynamics of agents are subject to disturbances and the disturbance attenuation level is achieved. Finally, the proposed tracking strategy is verified by a set of simulations

Swarm Coordination for Pursuit Evasion Games Using Sensor Networks

Abstract — In this work we consider the problem of pursuit evasion games (PEGs) where a group of pursuers is required to detect, chase and capture a group of evaders with the aid of a sensor network in minimum time. Differently from standards PEGs where the environment and the location of evaders is unknown and a probabilistic map is built based on the pursuer onboard sensors, here we consider a scenario where a sensor network, previously deployed in the region of concern, can detect the presence of moving vehicles and can relay this information to the pursuers. Here we propose a general framework for the design of a hierarchical control architecture that exploit the advantages of a sensor networks by combining both centralized and decentralized real-time control algorithms. We also propose a coordination scheme for the pursuers to minimize the time-to-capture of all evaders. In particular, we focus on PEGs with sensor networks orbiting in space for artificial space debris detection and removal. Index Terms — Sensor networks, pursuit evasion games, vehicle coordination, space vehicles, space debris over the area of interest. This constraint makes designing a cooperative pursuit algorithm harder because lack of complete observability only allows for suboptimal pursuit policies. See Figure 1(left). Furthermore, a smart evaders makes the map-building process dynamic since their location changes over time. The map-learning phase is, by itself, time-consuming and computationally intensive even for simple two-dimensional rectilinear environments [5]. Moreover, inaccurate sensors complicate this process and a probabilistic approach is often required [21]. I

An Optimal Evader Strategy in a Two-Pursuer One-Evader Problem

Copyright © 2014 IEEEPresented at the 53rd IEEE Conference on Decision and Control, Los Angeles, CA, Dec. 15-17, 2014DOI: http://dx.doi.org/10.1109/CDC.2014.7040054We consider a relay pursuit-evasion problem with two pursuers and one evader. We reduce the problem to a one-pursuer/one-evader problem subject to a state constraint. A suboptimal control strategy for the evader to prolong capture is proposed and is compared to the optimal evading strategy. Extensions to the multiple-pursuer/one-evader case are also presented and evaluated via numerical simulations

Differential LG - Game of Many Participant Players

In this article, we have considered a simple motion differential game of   pursuers and one evader in. Here controls of the pursuers are subjected to linear constraints which is the generalization of both integral and geometrical constraints, and control of the evader is subjected to a geometrical constraint. To solve a pursuit problem, the attainability domain of each pursuer has been constructed and therefore, necessary and sufficient conditions have been obtained by intersection of them

Games of Pursuit-Evasion with Multiple Agents and Subject to Uncertainties

Over the past decade, there have been constant efforts to induct unmanned aerial vehicles (UAVs) into military engagements, disaster management, weather monitoring, and package delivery, among various other applications. With UAVs starting to come out of controlled environments into real-world scenarios, uncertainties that can be either exogenous or endogenous play an important role in the planning and decision-making aspects of deploying UAVs. At the same time, while the demand for UAVs is steadily increasing, major governments are working on their regulations. There is an urgency to design surveillance and security systems that can efficiently regulate the traffic and usage of these UAVs, especially in secured airspaces. With this motivation, the thesis primarily focuses on airspace security, providing solutions for safe planning under uncertainties while addressing aspects concerning target acquisition and collision avoidance. In this thesis, we first present our work on solutions developed for airspace security that employ multiple agents to capture multiple targets in an efficient manner. Since multi-pursuer multi-evader problems are known to be intractable, heuristics based on the geometry of the game are employed to obtain task-allocation algorithms that are computationally efficient. This is achieved by first analyzing pursuit-evasion problems involving two pursuers and one evader. Using the insights obtained from this analysis, a dynamic allocation algorithm for the pursuers, which is independent of the evader's strategy, is proposed. The algorithm is further extended to solve multi-pursuer multi-evader problems for any number of pursuers and evaders, assuming both sets of agents to be heterogeneous in terms of speed capabilities. Next, we consider stochastic disturbances, analyzing pursuit-evasion problems under stochastic flow fields using forward reachability analysis, and covariance steering. The problem of steering a Gaussian in adversarial scenarios is first analyzed under the framework of general constrained games. The resulting covariance steering problem is solved numerically using iterative techniques. The proposed approach is applied to the missile endgame guidance problem. Subsequently, using the theory of covariance steering, an approach to solve pursuit-evasion problems under external stochastic flow fields is discussed. Assuming a linear feedback control strategy, a chance-constrained covariance game is constructed around the nominal solution of the players. The proposed approach is tested on realistic linear and nonlinear flow fields. Numerical simulations suggest that the pursuer can effectively steer the game towards capture. Finally, the uncertainties are assumed to be parametric in nature. To this end, we first formalize optimal control under parametric uncertainties while introducing sensitivity functions and costates based techniques to address robustness under parametric variations. Utilizing the sensitivity functions, we address the problem of safe path planning in environments containing dynamic obstacles with an uncertain motion model. The sensitivity function based-approach is then extended to address game-theoretic formulations that resemble a "fog of war" situation.Ph.D

Pursuing an evader through cooperative relaying in multi-agent surveillance networks

We provide a distributed control strategy for each mobile agent in a surveillance network in the plane to cooperatively pursue an evader. The pursuit task is relayed from one agent to another when the evader crosses the boundary of the Voronoi regions divided according to the agents’ positions. The dynamics of the resulted cooperative relay-pursuit network are described by a novel model of impulsive systems. As a result, to guarantee the stability of the closed-loop network system, the controllers’ gains are chosen effectively using the solution of an algebraic Riccati equation. The proof of the stability is based on the construction of a switched Lyapunov function. We also show that the proposed controller is able to deal with delays if some sufficient conditions in the form of a set of linear inequalities are satisfied. A numerical example is provided to validate the performance of the proposed controller