Scale-Invariant Specifications for Human-Swarm Systems

We present a method for controlling a swarm using its spectral decomposition -- that is, by describing the set of trajectories of a swarm in terms of a spatial distribution throughout the operational domain -- guaranteeing scale invariance with respect to the number of agents both for computation and for the operator tasked with controlling the swarm. We use ergodic control, decentralized across the network, for implementation. In the DARPA OFFSET program field setting, we test this interface design for the operator using the STOMP interface -- the same interface used by Raytheon BBN throughout the duration of the OFFSET program. In these tests, we demonstrate that our approach is scale-invariant -- the user specification does not depend on the number of agents; it is persistent -- the specification remains active until the user specifies a new command; and it is real-time -- the user can interact with and interrupt the swarm at any time. Moreover, we show that the spectral/ergodic specification of swarm behavior degrades gracefully as the number of agents goes down, enabling the operator to maintain the same approach as agents become disabled or are added to the network. We demonstrate the scale-invariance and dynamic response of our system in a field relevant simulator on a variety of tactical scenarios with up to 50 agents. We also demonstrate the dynamic response of our system in the field with a smaller team of agents. Lastly, we make the code for our system available.Comment: Journal of Field Robotics, Accepted for Publication. 25 page

Industry Led Use-Case Development for Human-Swarm Operations

In the domain of unmanned vehicles, autonomous robotic swarms promise to deliver increased efficiency and collective autonomy. How these swarms will operate in the future, and what communication requirements and operational boundaries will arise are yet to be sufficiently defined. A workshop was conducted with 11 professional unmanned-vehicle operators and designers with the objective of identifying use-cases for developing and testing robotic swarms. Three scenarios were defined by experts and were then compiled to produce a single use case outlining the scenario, objectives, agents, communication requirements and stages of operation when collaborating with highly autonomous swarms. Our compiled use case is intended for researchers, designers, and manufacturers alike to test and tailor their design pipeline to accommodate for some of the key issues in human-swarm ininteraction. Examples of application include informing simulation development, forming the basis of further design workshops, and identifying trust issues that may arise between human operators and the swarm.Comment: Accepted at AAAI 2022 Spring Symposium Series (Putting AI in the Critical Loop: Assured Trust and Autonomy in Human-Machine Teams

Autonomous Swarms of Unmanned Vehicles: Software Control System and Ground Vehicle Testing

Unmanned vehicles are being developed for a wide variety of scientific, and military uses. Using a coordinated team allows for greater robustness, flexibility or ease of use. While there are several unmanned vehicle systems in use for a variety of applications, work on swarming has been largely theoretical. This thesis presents Woodstock, a software system implementing a swarming control law. The control law moves the swarm through waypoints specified by GPS coordinates. It was tested using a set of ground vehicles, which are also described. It is shown to be robust to noise, and superior to a previous implementation. The previous implementation was client server, making it vulnerable to a single vehicle loss, while the new system is peer to peer and thus more robust. The system is flexible enough to be portable to other vehicle systems easily

Defensive swarm: an agent-based modeling analysis

Security at remote military bases is a difficult, yet critical, mission. Remote locations are generally closer to enemy combatants and farther from supporting forces; the individuals charged with defending the bases do so with less equipment. These locations are also usually reliant on air-resupply missions to maintain mission readiness and effectiveness. This thesis analyzes how swarms of small autonomous unmanned aerial vehicles (UAVs) could assist in defensive operations. To accomplish this, I created an agent-based computer simulation model, which creates a tactical problem (enemies attempting to attack or infiltrate a notional base) that a swarm of UAVs attempts to defend against. Results indicate that a swarm can effectively deter 95% of attackers if each UAV is responsible for covering no more than 0.18 square miles and at least 40% of the UAVs are armed. I conclude that UAVs are an excellent addition to base defense and are particularly helpful at remote outposts with less organic capability (limited field of view, defensive assets, etc.). While this research deals specifically with countering a threat to a central base, the algorithms for swarm dynamics could be applied to future problems in mobile convoy or aircraft defense, and even peacetime applications like search and rescue.http://archive.org/details/defensiveswarmng1094556777Major, United States Air ForceApproved for public release; distribution is unlimited

Design and Test of a UAV Swarm Architecture over a Mesh Ad-Hoc Network

The purpose of this research was to develop a testable swarm architecture such that the swarm of UAVs collaborate as a team rather than acting as several independent vehicles. Commercial-off-the-shelf (COTS) components were used as they were low-cost, readily available, and previously proven to work with at least two networked UAVs. Initial testing was performed via software-in-the-loop (SITL) demonstrating swarming of three simulated multirotor aircraft, then transitioned to real hardware. The architecture was then tested in an outdoor nylon netting enclosure. Command and control (C2) was provided by software implementing an enhanced version of Reynolds’ flocking rules via an onboard companion computer, and UDP multicast messages over a W-Fi mesh ad-hoc network. Experimental results indicate a standard deviation between vehicles of two meters or less, at airspeeds up to two meters per second. This aligns with navigation instrumentation error, permitting safe operation of multiple vehicles within five meters of each other. Qualitative observations indicate this architecture is robust enough to handle more aircraft, pass additional sensor data, and incorporate different swarming algorithms and missions

Industry Led Use-Case Development for Human-Swarm Operations

In the domain of unmanned vehicles, autonomous robotic swarms promise to deliver increased efficiency and collective autonomy. How these swarms will operate in the future, and what communication requirements and operational boundaries will arise are yet to be sufficiently defined. A workshop was conducted with 11 professional unmanned-vehicle operators and designers with the objective of identifying use-cases for developing and testing robotic swarms. Three scenarios were defined by experts and were then compiled to produce a single use case outlining the scenario, objectives, agents, communication requirements and stages of operation when collaborating with highly autonomous swarms. Our compiled use case is intended for researchers, designers, and manufacturers alike to test and tailor their design pipeline to accommodate for some of the key issues in human-swarm ininteraction. Examples of application include informing simulation development, forming the basis of further design workshops, and identifying trust issues that may arise between human operators and the swarm

Flight coordination solutions for multirotor unmanned aerial vehicles

[EN] As the popularity and the number of Unmanned Aerial Vehicles (UAVs) increases, new protocols are needed to coordinate them when flying without direct human control, and to avoid that these UAVs collide with each other. Testing such novel protocols on real UAVs is a complex procedure that requires investing much time, money and research efforts. Hence, it becomes necessary to first test the developed solutions using simulation. Unfortunately, existing tools present significant limitations: some of them only simulate accurately the flight behavior of a single UAV, while some other simulators can manage several UAVs simultaneously, but not in real time, thus losing accuracy regarding the mobility pattern of the UAV. In this work we address such problem by introducing Arducopter Simulator (ArduSim), a novel simulation platform that allows controlling in soft real-time the flight and communications of multiple UAVs, being the developed protocols directly portable to real devices. Moreover, ArduSim includes a realistic model for the WiFi communications link between UAVs, which was proposed based on real experiments. The chances that two UAVs get close to each other during their flights is increasing as more and more of them populate our skies, causing concerns regarding potential collisions. Therefore, this thesis also proposes the Mission Based Collision Avoidance Protocol (MBCAP), a novel UAV collision avoidance protocol applicable to all types of multicopters flying autonomously. It relies on wireless communications in order to detect nearby UAVs, and to negotiate the procedure to avoid any potential collision. Experimental and simulation results demonstrate the validity and effectiveness of the proposed solution, which typically introduces a small overhead in the range of 15 to 42 seconds for each risky situation successfully handled. The previous solution aims at UAVs performing independent flights, but they can also form a swarm, where more constraints have to be met to avoid collisions among them, and to allow them to complete their task efficiently. Deploying an UAV swarm instead of a single UAV can provide additional benefits when, for example, cargo carrying requirements exceed the lifting power of a single UAV, or when the deployment of several UAVs simultaneously can accelerate the accomplishment of the mission, and broaden the covered area. To this aim, in this work we present the Mission-based UAV Swarm Coordination Protocol (MUSCOP), a solution that allows multiple UAVs to perfectly coordinate their flight when performing planned missions. Experimental results show that the proposed protocol is able to achieve a high degree of swarm cohesion independently of the flight formation adopted, and even in the presence of very lossy channels, achieving minimal synchronization delays and very low position offsets with regard to the ideal case. Currently, there are some other scenarios, such as search and rescue operations, where the deployment of manually guided swarms of UAVs can be necessary. In such cases, the pilot's commands are unknown a priori (unpredictable), meaning that the UAVs must respond in near real-time to the movements of the leader UAV in order to maintain swarm consistency. Hence, in this thesis we also propose the FollowMe protocol for the coordination of UAVs in a swarm where the swarm leader is controlled by a real pilot, and the other UAVs must follow it in real-time to maintain swarm cohesion. Simulation results show the validity of the proposed swarm coordination protocol, detailing the responsiveness limits of our solution, and finding the minimum distances between UAVs to avoid collisions.[ES] A medida que la popularidad de los Vehículos Aéreos No Tripulados (VANTs) se incrementa, también se hacen necesarios nuevos protocolos para coordinarlos en vuelos sin control humano directo, y para evitar que colisionen entre sí. Probar estos nuevos protocolos en VANTs reales es un proceso complejo que requiere invertir mucho tiempo, dinero y esfuerzo investigador. Por lo tanto, es necesario probar en simulación las soluciones previamente implementadas. Lamentablemente, las herramientas actuales tienen importantes limitaciones: algunas simulan con precisión el vuelo de un único VANT, mientras que otros simuladores pueden gestionar varios VANTs simultáneamente aunque no en tiempo real, perdiendo por lo tanto precisión en el patrón de movilidad del VANT. En este trabajo abordamos este problema introduciendo Arducopter Simulator (ArduSim), una nueva plataforma de simulación que permite controlar en tiempo real el vuelo y la comunicación entre múltiples VANTs, permitiendo llevar los protocolos desarrollados a dispositivos reales con facilidad. Además, ArduSim incluye un modelo realista de un enlace de comunicaciones WiFi entre VANTs, el cual está basado en el resultado obtenido de experimentos con VANTs reales. La posibilidad de que dos VANTs se aproximen entre sí durante el vuelo se incrementa a medida que hay más aeronaves de este tipo surcando los cielos, introduciendo peligro por posibles colisiones. Por ello, esta tesis propone Mission Based Collision Avoidance Protocol (MBCAP), un nuevo protocolo de evitación de colisiones para VANTs aplicable a todo tipo de multicópteros mientras vuelan autónomamente. MBCAP utiliza comunicaciones inalámbricas para detectar VANTs cercanos y para negociar el proceso de evitación de la colisión. Los resultados de simulaciones y experimentos reales demuestran la validez y efectividad de la solución propuesta, que introduce un pequeño aumento del tiempo de vuelo de entre 15 y 42 segundos por cada situación de riesgo correctamente resuelta. La solución anterior está orientada a VANTs que realizan vuelos independientes, pero también pueden formar un enjambre, donde hay que cumplir más restricciones para evitar que colisionen entre sí, y para que completen la tarea de forma eficiente. Desplegar un enjambre de VANTs en vez de uno solo proporciona beneficios adicionales cuando, por ejemplo, la necesidad de carga excede la capacidad de elevación de un único VANT, o cuando al desplegar varios VANTs simultáneamente se acelera la misión y se cubre un área mayor. Con esta finalidad, en este trabajo presentamos el protocolo Mission-based UAV Swarm Coordination Protocol (MUSCOP), una solución que permite a varios VANTs coordinar perfectamente el vuelo mientras realizan misiones planificadas. Los resultados experimentales muestran que el protocolo propuesto permite al enjambre alcanzar un grado de cohesión elevado independientemente de la formación de vuelo adoptada, e incluso en presencia de un canal de comunicación con muchas pérdidas, consiguiendo retardos en la sincronización insignificantes y desfases mínimos en la posición con respecto al caso ideal. Actualmente hay otros escenarios, como las operaciones de búsqueda y rescate, donde el despliegue de enjambres de VANTs guiados manualmente puede ser necesario. En estos casos, las órdenes del piloto son desconocidas a priori (impredecibles), lo que significa que los VANTs deben responder prácticamente en tiempo real a los movimientos del VANT líder para mantener la consistencia del enjambre. Por ello, en esta tesis proponemos el protocolo FollowMe para la coordinación de VANTs en un enjambre donde el líder es controlado por un piloto, y el resto de VANTs lo siguen en tiempo real para mantener la cohesión del enjambre. Las simulaciones muestran la validez del protocolo de coordinación de enjambres propuesto, detallando los límites de la solución, y definiendo la distancia mínima entre VANTs para evita[CA] A mesura que la popularitat dels Vehicles Aeris No Tripulats (VANTs) s'incrementa, també es fan necessaris nous protocols per a coordinar-los en vols sense control humà directe, i per a evitar que col·lisionen entre si. Provar aquests nous protocols en VANTs reals és un procés complex que requereix invertir molt de temps, diners i esforç investigador. Per tant, és necessari provar en simulació les solucions prèviament implementades. Lamentablement, les eines actuals tenen importants limitacions: algunes simulen amb precisió el vol d'un únic VANT, mentre que altres simuladors poden gestionar diversos VANTs simultàniament encara que no en temps real, perdent per tant precisió en el patró de mobilitat del VANT. En aquest treball abordem aquest problema introduint Arducopter Simulator (ArduSim), una nova plataforma de simulació que permet controlar en temps real el vol i la comunicació entre múltiples VANTs, permetent portar els protocols desenvolupats a dispositius reals amb facilitat. A més, ArduSim inclou un model realista d'un enllaç de comunicacions WiFi entre VANTs, que està basat en el resultat obtingut d'experiments amb VANTs reals. La possibilitat que dues VANTs s'aproximen entre si durant el vol s'incrementa a mesura que hi ha més aeronaus d'aquest tipus solcant els cels, introduint perill per possibles col·lisions. Per això, aquesta tesi proposa Mission Based Collision Avoidance Protocol (MBCAP), un nou protocol d'evitació de col·lisions per a VANTs aplicable a tota mena de multicòpters mentre volen autònomament. MBCAP utilitza comunicacions sense fils per a detectar VANTs pròxims i per a negociar el procés d'evitació de la col·lisió. Els resultats de simulacions i experiments reals demostren la validesa i efectivitat de la solució proposada, que introdueix un xicotet augment del temps de vol de entre 15 i 42 segons per cada situació de risc correctament resolta. La solució anterior està orientada a VANTs que realitzen vols independents, però també poden formar un eixam, on cal complir més restriccions per a evitar que col·lisionen entre si, i perquè completen la tasca de forma eficient. Desplegar un eixam de VANTs en comptes d'un només proporciona beneficis addicionals quan, per exemple, la necessitat de càrrega excedeix la capacitat d'elevació d'un únic VANT, o quan en desplegar diversos VANTs simultàniament s'accelera la missió i es cobreix una àrea major. Amb aquesta finalitat, en aquest treball presentem el protocol Mission-based UAV Swarm Coordination Protocol (MUSCOP), una solució que permet a diversos VANTs coordinar perfectament el vol mentre realitzen missions planificades. Els resultats experimentals mostren que el protocol proposat permet a l'eixam aconseguir un grau de cohesió elevat independentment de la formació de vol adoptada, i fins i tot en presència d'un canal de comunicació amb moltes pèrdues, aconseguint retards en la sincronització insignificants i desfasaments mínims en la posició respecte al cas ideal. Actualment hi ha altres escenaris, com les operacions de cerca i rescat, on el desplegament d'eixams de VANTs guiats manualment pot ser necessari. En aquests casos, les ordres del pilot són desconegudes a priori (impredictibles), el que significa que els VANTs han de respondre pràcticament en temps real als moviments del VANT líder per a mantindre la consistència de l'eixam. Per això, en aquesta tesi proposem el protocol FollowMe per a la coordinació de VANTs en un eixam on el líder és controlat per un pilot, i la resta de VANTs ho segueixen en temps real per a mantindre la cohesió de l'eixam. Les simulacions mostren la validesa del protocol de coordinació d'eixams proposat, detallant els límits de la solució, i definint la distància mínima entre VANTs per a evitar col·lisions.Fabra Collado, FJ. (2020). Flight coordination solutions for multirotor unmanned aerial vehicles [Tesis doctoral no publicada]. Universitat Politècnica de València. https://doi.org/10.4995/Thesis/10251/147857TESI