A Cloud Based Service for Management and Planning of Autonomous UAV Missions in Smart City Scenarios

Cloud Robotics is an emerging paradigm in which robots, seen as abstract agents, have the possibility to connect to a common network and share on a complex infrastructure the information and knowledge they gather about the physical world; or conversely consume the data collected by other agents or made available on accessible database and repositories. In this paper we propose an implementation of an emergency-management service exploiting the possibilities offered by cloud robotics in a smart city scenario. A high-level cloud-platform manages a number of unmanned aerial vehicles (quadrotor UAVs) with the goal of providing aerial support to citizens that require it via a dedicated mobile app. The UAV reaches the citizen while forwarding a realtime video streaming to a privileged user (police officer),connected to the same cloud platform, that is allowed to teleoperate it by remote

Real-time UAV Complex Missions Leveraging Self-Adaptive Controller with Elastic Structure

The expectation of unmanned air vehicles (UAVs) pushes the operation environment to narrow spaces, where the systems may fly very close to an object and perform an interaction. This phase brings the variation in UAV dynamics: thrust and drag coefficient of the propellers might change under different proximity. At the same time, UAVs may need to operate under external disturbances to follow time-based trajectories. Under these challenging conditions, a standard controller approach may not handle all missions with a fixed structure, where there may be a need to adjust its parameters for each different case. With these motivations, practical implementation and evaluation of an autonomous controller applied to a quadrotor UAV are proposed in this work. A self-adaptive controller based on a composite control scheme where a combination of sliding mode control (SMC) and evolving neuro-fuzzy control is used. The parameter vector of the neuro-fuzzy controller is updated adaptively based on the sliding surface of the SMC. The autonomous controller possesses a new elastic structure, where the number of fuzzy rules keeps growing or get pruned based on bias and variance balance. The interaction of the UAV is experimentally evaluated in real time considering the ground effect, ceiling effect and flight through a strong fan-generated wind while following time-based trajectories.Comment: 18 page

Use of Unmanned Aerial Systems in Civil Applications

Interest in drones has been exponentially growing in the last ten years and these machines are often presented as the optimal solution in a huge number of civil applications (monitoring, agriculture, emergency management etc). However the promises still do not match the data coming from the consumer market, suggesting that the only big field in which the use of small unmanned aerial vehicles is actually profitable is the video-makers’ one. This may be explained partly with the strong limits imposed by existing (and often "obsolete") national regulations, but also - and pheraps mainly - with the lack of real autonomy. The vast majority of vehicles on the market nowadays are infact autonomous only in the sense that they are able to follow a pre-determined list of latitude-longitude-altitude coordinates. The aim of this thesis is to demonstrate that complete autonomy for UAVs can be achieved only with a performing control, reliable and flexible planning platforms and strong perception capabilities; these topics are introduced and discussed by presenting the results of the main research activities performed by the candidate in the last three years which have resulted in 1) the design, integration and control of a test bed for validating and benchmarking visual-based algorithm for space applications; 2) the implementation of a cloud-based platform for multi-agent mission planning; 3) the on-board use of a multi-sensor fusion framework based on an Extended Kalman Filter architecture

Autonomous Navigation of Quadrotor Swarms

RÉSUMÉ La mise sur le marché de composants toujours plus performants et compétitifs en termes de coût, ainsi que le développement rapide des technologies de commande et de navigation en robotique, nous ont amenés à envisager le contrôle d’un large essaim de quadrirotors. Di-verses solutions impliquant des drones existent déjà pour différentes applications: inventaire forestier, gestion du littoral, suivi du trafic, etc. Parmi celles-ci, la recherche et le sauvetage en situation d’urgence représentent à nos yeux la possibilité la plus intéressante et constitue, de fait, la première motivation de notre travail. Par conséquent, une large revue de littérature sur la question est fournie. Ce travail se concentre sur le contrôle de l’essaim lui-même, et non sur l’application finale. Tout d’abord, un modèle mathématique de la dynamique du quadrirotor est présenté et plusieurs lois de commande numérique sont synthétisées. Ces dernières implémentent les modes de fonctionnement nécessaires aux algorithmes de navigation, à savoir : commande en vitesse, commande en position et commande en suivi. Ensuite, deux solutions originales et complémentaires de contrôle d’essaim sont proposées. D’une part, un algorithme d’essaimage pour la navigation extérieure est développé. Contrairement à la plupart des travaux trouvés dans la littérature, la solution proposée ici gère non seulement le maintien, mais aussi l’initialisation de la formation. Plus spécifiquement, un modèle de formation hexagonale est introduit. Ensuite, les places en formation sont attribuées de façon optimale à l’aide de l’algorithme hongrois. Enfin, les agents se déplacent jusqu’à la place qui leur est assignée tout en évitant les autres agents avec un algorithme de navigation inspiré du Artificial Potential Field. De plus, cette solution tient compte de contraintes de conception réalistes et a été intégrée avec succès dans un logiciel embarqué de quadrotor déjà existant et opérationnel. Les résultats de simulations Software-In-The-Loop sont fournis. D’autre part, une solution d’essaimage pour la navigation intérieure est étudiée. L’algorithme proposé implémente un certain nombre de comportements individuels simples, de sorte qu’un grand essaim peut suivre un meneur dans des environnements encombrés en se fiant uniquement aux informations locales. Des simulations préliminaires sont effectuées et les résultats montrent qu’il serait possible de faire fonctionner, conformément au besoin étudié, un essaim de cent quadrirotors avec l’algorithme proposé. En particulier, l’essaim est capable de suivre le meneur, de maintenir la connectivité, d’éviter les collisions entre agents, d’éviter les obstacles et même de se faufiler dans des espaces étroits.----------ABSTRACT The ever-growing hardware capabilities and the rapid development of robotic control and navigation technologies have led us to consider the control of an entire swarm of quadrotors. Drone-based solutions have been developed for different applications: forest inventory, coastal management, traÿc monitoring, etc... Among these, the Search And Rescue application represents for us a very promising field of application and constitutes the first motivation of our work. As a result, a wide literature review on the matter is provided. Nevertheless, this work focuses on the swarm control itself, and not on the end user application. First, a mathematical model of the quadrotor dynamics is presented and several digital control laws are designed. The latter provide operating modes useful for the navigation algorithms, namely: velocity control, position control and tracking control. Then, two original and complimentary swarming solutions are proposed. On the one hand, a swarming algorithm for outdoor navigation is developed. Unlike most of the works reviewed in the literature, our solution handles not only the maintenance but also the initialization of the formation. More specifically, an hexagonal formation pattern is intro-duced. Then, positions are optimally assigned using the Hungarian algorithm. Finally, the agents move to their assigned position while avoiding collisions with the other fleet members thanks to a navigation algorithm inspired from Artificial Potential Field. In addition, this solution accounts for realistic design constraints and was successfully integrated into already existing quadrotor onboard software. Software-In-The-Loop simulation results are provided. On the other hand, a swarming solution for indoor navigation is investigated. The proposed algorithm enforces a certain set of expected individual simple behaviors such that a large swarm can follow a leader through cluttered environments relying only on local information. Preliminary simulations are run and the results show that it is possible to operate a swarm of a hundred quadrotors with the proposed algorithm. In particular, the swarm is able to follow the leader, maintain connectivity, avoid collisions with the other agents, avoid obstacles, and even squeeze to pass through narrow spaces

The applications of autonomous systems to forestry management

Thesis (M.B.A.)--Massachusetts Institute of Technology, Sloan School of Management; and, (S.M.)--Massachusetts Institute of Technology, Engineering Systems Division; in conjunction with the Leaders for Global Operations Program at MIT, 2013.Cataloged from PDF version of thesis.Includes bibliographical references (p. 132-137).Public and private timberland owners continually search for new, cost effective methods to monitor and nurture their timber stand investments. Common management tasks include monitoring tree growth and tree health, estimating timber value and preventing wildfire. Many of these tasks are both manual and costly due to the vast areas and remote locations involved. Forestry experts predict that multi-vehicle autonomous systems may enable new, cost effective methods for performing various forest management tasks[1]. However, it remains unclear how these technologies may be applied, or where to focus development efforts. This research attempts to address this gap in literature, linking state-of-the-art research in forestry management science, robotics and autonomous systems, and product design and development. This thesis begins by reviewing existing forestry management practices and discussing a number of challenges identified through industry interviews and research. Modem product design methods are reviewed, and used to generate ideas for a number of new concept systems. Three design concepts are presented as detailed case studies. The data sets, methods and proposed systems discussed in this thesis may be used to guide future research in forestry management science, and drive further innovation in the emerging field of commercial and civilian autonomous systems. Key words: Forestry Management, Forestry Science, Robotics and Autonomous Systems, Unmanned Aerial Vehicles (UAV), Unmanned Aerial Systems (UAS), Product Design and Development, Light Detection and Ranging (LiDAR)by Joshua Przybylko.S.M.M.B.A

Impact of UAV Hardware Options on Bridge Inspection Mission Capabilities

Uncrewed Aerial Vehicles (UAV) constitute a rapidly evolving technology field that is becoming more accessible and capable of supplementing, expanding, and even replacing some traditionally manual bridge inspections. Given the classification of the bridge inspection types as initial, routine, in-depth, damage, special, and fracture critical members, specific UAV mission requirements can be developed, and their suitability for UAV application examined. Results of a review of 23 applications of UAVs in bridge inspections indicate that mission sensor and payload needs dictate the UAV configuration and size, resulting in quadcopter configurations being most suitable for visual camera inspections (43% of visual inspections use quadcopters), and hexa- and octocopter configurations being more suitable for higher payload hyperspectral, multispectral, and Light Detection and Ranging (LiDAR) inspections (13%). In addition, the number of motors and size of the aircraft are the primary drivers in the cost of the vehicle. 75% of vehicles rely on GPS for navigation, and none of them are capable of contact inspections. Factors that limit the use of UAVs in bridge inspections include the UAV endurance, the capability of navigation in GPS deprived environments, the stability in confined spaces in close proximity to structural elements, and the cost. Current research trends in UAV technologies address some of these limitations, such as obstacle detection and avoidance methods, autonomous flight path planning and optimization, and UAV hardware optimization for specific mission requirements

Assured Autonomy in Multiagent Systems with Safe Learning

Autonomous multiagent systems is an area that is currently receiving increasing attention in the communities of robotics, control systems, and machine learning (ML) and artificial intelligence (AI). It is evident today, how autonomous robots and vehicles can help us shape our future. Teams of robots are being used to help identify and rescue survivors in case of a natural disaster for instance. There we understand that we are talking minutes and seconds that can decide whether you can save a person's life or not. This example portrays not only the value of safety but also the significance of time, in planning complex missions with autonomous agents. This thesis aims to develop a generic, composable framework for a multiagent system (of robots or vehicles), which can safely carry out time-critical missions in a distributed and autonomous fashion. The goal is to provide formal guarantees on both safety and finite-time mission completion in real time, thus, to answer the question: “how trustworthy is the autonomy of a multi-robot system in a complex mission?” We refer to this notion of autonomy in multiagent systems as assured or trusted autonomy, which is currently a very sought-after area of research, thanks to its enormous applications in autonomous driving for instance. There are two interconnected components of this thesis. In the first part, using tools from control theory (optimal control), formal methods (temporal logic and hybrid automata), and optimization (mixed-integer programming), we propose multiple variants of (almost) realtime planning algorithms, which provide formal guarantees on safety and finite-time mission completion for a multiagent system in a complex mission. Our proposed framework is hybrid, distributed, and inherently composable, as it uses a divide-and-conquer approach for planning a complex mission, by breaking it down into several sub-tasks. This approach enables us to implement the resulting algorithms on robots with limited computational power, while still achieving close to realtime performance. We validate the efficacy of our methods on multiple use cases such as autonomous search and rescue with a team of unmanned aerial vehicles (UAVs) and ground robots, autonomous aerial grasping and navigation, UAV-based surveillance, and UAV-based inspection tasks in industrial environments. In the second part, our goal is to translate and adapt these developed algorithms to safely learn actions and policies for robots in dynamic environments, so that they can accomplish their mission even in the presence of uncertainty. To accomplish this goal, we introduce the ideas of self-monitoring and self-correction for agents using hybrid automata theory and model predictive control (MPC). Self-monitoring and self-correction refer to the problems in autonomy where the autonomous agents monitor their performance, detect deviations from normal or expected behavior, and learn to adjust both the description of their mission/task and their performance online, to maintain the expected behavior and performance. In this setting, we propose a formal and composable notion of safety and adaptation for autonomous multiagent systems, which we refer to as safe learning. We revisit one of the earlier use cases to demonstrate the capabilities of our approach for a team of autonomous UAVs in a surveillance and search and rescue mission scenario. Despite portraying results mainly for UAVs in this thesis, we argue that the proposed planning framework is transferable to any team of autonomous agents, under some realistic assumptions. We hope that this research will serve several modern applications of public interest, such as autopilots and flight controllers, autonomous driving systems (ADS), autonomous UAV missions such as aerial grasping and package delivery with drones etc., by improving upon the existing safety of their autonomous operation

Advances in Human Robot Interaction for Cloud Robotics applications

In this thesis are analyzed different and innovative techniques for Human Robot Interaction. The focus of this thesis is on the interaction with flying robots. The first part is a preliminary description of the state of the art interactions techniques. Then the first project is Fly4SmartCity, where it is analyzed the interaction between humans (the citizen and the operator) and drones mediated by a cloud robotics platform. Then there is an application of the sliding autonomy paradigm and the analysis of different degrees of autonomy supported by a cloud robotics platform. The last part is dedicated to the most innovative technique for human-drone interaction in the User’s Flying Organizer project (UFO project). This project wants to develop a flying robot able to project information into the environment exploiting concepts of Spatial Augmented Realit