Autonomous Unmanned Aerial Vehicle Navigation using Reinforcement Learning: A Systematic Review

There is an increasing demand for using Unmanned Aerial Vehicle (UAV), known as drones, in different applications such as packages delivery, traffic monitoring, search and rescue operations, and military combat engagements. In all of these applications, the UAV is used to navigate the environment autonomously --- without human interaction, perform specific tasks and avoid obstacles. Autonomous UAV navigation is commonly accomplished using Reinforcement Learning (RL), where agents act as experts in a domain to navigate the environment while avoiding obstacles. Understanding the navigation environment and algorithmic limitations plays an essential role in choosing the appropriate RL algorithm to solve the navigation problem effectively. Consequently, this study first identifies the main UAV navigation tasks and discusses navigation frameworks and simulation software. Next, RL algorithms are classified and discussed based on the environment, algorithm characteristics, abilities, and applications in different UAV navigation problems, which will help the practitioners and researchers select the appropriate RL algorithms for their UAV navigation use cases. Moreover, identified gaps and opportunities will drive UAV navigation research

Specification-Based Task Orchestration for Multi-Robot Aerial Teams

As humans begin working more frequently in environments with multi-agent systems, they are presented with challenges on how to control these systems in an intuitive manner. Current approaches tend to limit either the interaction ability of the user or limit the expressive capacity of instructions given to the robots. Applications that utilize temporal logics provide a human-readable syntax for systems that ensures formal guarantees for specification completion. By providing a modality for global task specification, we seek to reduce cognitive load and allow for high-level objectives to be communicated to a multi-agent system. In addition to this, we also seek to expand the capabilities of swarms to understand desired actions via interpretable commands retrieved from a human. In this thesis, we first present a method for specification-based control of a quadrotor. We utilize quadrotors as a highly agile and maneuverable application platform that has a wide variety of uses in complex problem domains. Leveraging specification-based control allows us to formulate a specification-based planning framework that will be utilized throughout the thesis. We then present methods for creating systems which allows us to provide task decomposition, allocation and planning for a team of quadrotors defined as task orchestration of multi-robot systems. Next, the task allocation portion of the task orchestration work is extended in the online case by considering cost agnostic sampling of trajectories from an online optimization problem. Then, we will introduce learning techniques where temporal logic specifications are learned and generated from a set of user given traces. Finally, we will conclude this thesis by presenting an extension to the Robotarium through hardware and software modifications that provides remote users access to control aerial swarms.Ph.D

Learning motion primitives for planning swift maneuvers of quadrotor

This work proposes a novel, learning-based method to leverage navigation time performance of unmanned aerial vehicles in dense environments by planning swift maneuvers using motion primitives. In the proposed planning framework, desirable motion primitives are explored by reinforcement learning. Two-stage training composed of learning in simulations and real flights is conducted to build up a swift motion primitive library. The library is then referred in real-time and the primitives are utilized by an intelligent control authority switch mechanism when swift maneuvers are needed for particular portions of a trajectory. Since the library is constructed upon realistic Gazebo simulations and real flights together, probable modeling uncertainties which can degrade planning performance are minimal. Moreover, since the library is in the form of motion primitives, it is computationally inexpensive to be retained and used for planning as compared to solving optimal motion planning problem algebraically. Overall, the proposed method allows for exceptional, swift maneuvers and enhances navigation time performance in dense environments up to 20% as being demonstrated by real flights with Diatone FPV250 Quadcopter equipped with PX4 FMU.Ministry of Education (MOE)Accepted versionThis work is financially supported by the Singapore Ministry of Education (RG185/17)

Social work with airports passengers

Social work at the airport is in to offer to passengers social services. The main methodological position is that people are under stress, which characterized by a particular set of characteristics in appearance and behavior. In such circumstances passenger attracts in his actions some attention. Only person whom he trusts can help him with the documents or psychologically

Generalized averaged Gaussian quadrature and applications

A simple numerical method for constructing the optimal generalized averaged Gaussian quadrature formulas will be presented. These formulas exist in many cases in which real positive GaussKronrod formulas do not exist, and can be used as an adequate alternative in order to estimate the error of a Gaussian rule. We also investigate the conditions under which the optimal averaged Gaussian quadrature formulas and their truncated variants are internal

MS FT-2-2 7 Orthogonal polynomials and quadrature: Theory, computation, and applications

Quadrature rules find many applications in science and engineering. Their analysis is a classical area of applied mathematics and continues to attract considerable attention. This seminar brings together speakers with expertise in a large variety of quadrature rules. It is the aim of the seminar to provide an overview of recent developments in the analysis of quadrature rules. The computation of error estimates and novel applications also are described