A Framework for Offline Risk-aware Planning of Low-altitude Aerial Flights during Urban Disaster Response

Disaster response missions are dynamic and dangerous events for first responders. Active situational awareness is critical for effective decision-making, and unmanned aerial assets have successfully extended the range and output of sensors. Aerial assets have demonstrated their capability in disaster response missions via decentralized operations. However, literature and industry lack a systematic investigation of the algorithms, datasets, and tools for aerial system trajectory planning in urban disasters that optimizes mission performance and guarantee mission success. This work seeks to develop a framework and software environment to investigate the requirements for offline planning algorithms and flight risk models when applied to aerial assets exploring urban disaster zones. This is addressed through the creation of rapid urban maps, efficient flight planning algorithms, and formal risk metrics that are demonstrated in scenario-driven experiments using Monte Carlo simulation. First, rapid urban mapping strategies are independently compared for efficient processing and storage through obstacle and terrain layers. Open-source data is used when available and is supplemented with an urban feature prediction model trained on satellite imagery using deep learning. Second, sampling-based planners are evaluated for efficient and effective trajectory planning of nonlinear aerial dynamic systems. The algorithm can find collision-free, kinodynamic feasible trajectories using random open-loop control targets. Alternative open-loop control commands are formed to improve the planning algorithm’s speed and convergence. Third, a risk-aware implementation of the planning algorithm is developed that considers the uncertainty of energy, collisions, and onboard viewpoint data and maps them to a single measure of the likelihood of mission failure. The three modules are combined in a framework where the rapid urban maps and risk-aware planner are evaluated against benchmarks for mission success, performance, and speed while creating a unique set of benchmarks from open-source data and software. One, the rapid urban map module generates a 3D structure and terrain map within 20 meters of data and in less than 5 minutes. The Gaussian Process terrain model performs better than B-spline and NURBS models in small-scale, mountainous environments at 10-meter squared resolution. Supplementary data for structures and other urban landcover features is predicted using the Pix2Pix Generative Adversarial Network with a 3-channel encoding for nine labels. Structures, greenspaces, water, and roads are predicted with high accuracy according to the F1, OIU, and pixel accuracy metrics. Two, the sampling-based planning algorithm is selected for forming collision-free, 3D offline flight paths with a black-box dynamics model of a quadcopter. Sampling-based planners prove successful for efficient and optimal flight paths through randomly generated and rapid urban maps, even under wind and noise uncertainty. The Stable-Sparse-RRT, SST, algorithm is shown to improve trajectories for minimum Euclidean distance more consistently and efficiently than the RRT algorithm, with a 50% improvement in finite-time path convergence for large-scale urban maps. The forward propagation dynamics of the black-box model are replaced with 5-15 times more computationally efficient motion primitives that are generated using an inverse lower-order dynamics model and the Differential Dynamic Programming, DDP, algorithm. Third, the risk-aware planning algorithm is developed that generates optimal paths based on three risk metrics of energy, collision, and viewpoint risk and quantifies the likelihood of worst-case events using the Conditional-Value-at-Risk, CVaR, metric. The sampling-based planning algorithm is improved with informative paths, and three versions of the algorithm are compared for the best performance in different scenarios. Energy risk in the planning algorithm results in 5-35% energy reduction and 20-30% more consistency in finite-time convergence for flight paths in large-scale urban maps. All three risk metrics in the planning algorithm generally result in more energy use than the planner with only energy risk, but reduce the mean flight path risk by 10-50% depending on the environment, energy available, and viewpoint landmarks. A final experiment in an Atlanta flooding scenario demonstrates the framework’s full capability with the rapid urban map displaying essential features and the trajectory planner reporting flight time, energy consumption, and total risk. Furthermore, the simulation environment provides insight into offline planning limitations through Monte Carlo simulations with environment wind and system dynamics noise. The framework and software environment are made available to use as benchmarks in the field to serve as a foundation for increasing the effectiveness of first responders’ safety in the challenging task of urban disaster response.Ph.D

ГЕОМЕТРИЧНЕ МОДЕЛЮВАННЯ ТРАС І ПОТОКІВ

Досліджено та розроблено математичні моделі для вирішення задач оптимізації з’єднання в неодносвязних областях за типових технологічних обмежень на геометричні та топологічні параметри трас, насамперед, на кривизну та кількість вигинів. Моделі пов'язані з існуючими та перспективними топогеодезичними моделями полігональних зображень територій. Розв'язання задач зв'язку передбачає пошук оптимальних траєкторій маршрутів і сіток у межах необмежених геометричних форм. Для цього потрібна розробка безлічі загальних моделей як полів, де здійснюються зв’язки. Сполучення можуть бути різних типів, таких як гнучкі, манхеттенські, рівні, тверді, а також маршрути інших типів. Смеляков та Алісейко (Плєхова Г. А.) зауважують, що глобальне та локальне регулювання геометричних зв’язків для розв’язання задач зв’язків можна представити як загальну оптимізаційну задачу зв’язку, яка визначається як задача вибору , де R – набір альтернатив, – принцип оптимальності. При цьому набір можна представити як сукупність фазового простору та обмежень Q, які застосовуються до параметрів фазового простору . У свою чергу, доцільно уявити, що фазовий простір є декартовим добутком = X*Y*Z*U вихідних даних X, збурень Y, параметрів керування U та результатів Z. Аналіз задачі свідчить про те, що насамперед ефективність моделювання фазового простору пов'язана з описом вихідних даних X про площу F і простір L можливих магістралей в F. Питання досліджується як розробка побудови структур моделей та методології їх використання, які б уможливили конструктивне та ефективне (в обчислювальній техніці) моделювання та дослідження різноманітних моделей та алгоритмів, які зберігають геометричність та інваріантність моделей, які необхідні для їх конкретного використання в умовах прийнятності використання різних вихідних структур даних. Дане дослідження присвячене розв’язанню задачі розробки моделі для задач зв’язку в рамках геометричного проектування

Sample-based motion planning in high-dimensional and differentially-constrained systems

Thesis (Ph. D.)--Massachusetts Institute of Technology, Dept. of Electrical Engineering and Computer Science, 2010.This electronic version was submitted by the student author. The certified thesis is available in the Institute Archives and Special Collections.Cataloged from student submitted PDF version of thesis.Includes bibliographical references (p. 115-124).State of the art sample-based path planning algorithms, such as the Rapidly-exploring Random Tree (RRT), have proven to be effective in path planning for systems subject to complex kinematic and geometric constraints. The performance of these algorithms, however, degrade as the dimension of the system increases. Furthermore, sample-based planners rely on distance metrics which do not work well when the system has differential constraints. Such constraints are particularly challenging in systems with non-holonomic and underactuated dynamics. This thesis develops two intelligent sampling strategies to help guide the search process. To reduce sensitivity to dimension, sampling can be done in a low-dimensional task space rather than in the high-dimensional state space. Altering the sampling strategy in this way creates a Voronoi Bias in task space, which helps to guide the search, while the RRT continues to verify trajectory feasibility in the full state space. Fast path planning is demonstrated using this approach on a 1500-link manipulator. To enable task-space biasing for underactuated systems, a hierarchical task space controller is developed by utilizing partial feedback linearization. Another sampling strategy is also presented, where the local reachability of the tree is approximated, and used to bias the search, for systems subject to differential constraints. Reachability guidance is shown to improve search performance of the RRT by an order of magnitude when planning on a pendulum and non-holonomic car. The ideas of task-space biasing and reachability guidance are then combined for demonstration of a motion planning algorithm implemented on LittleDog, a quadruped robot. The motion planning algorithm successfully planned bounding trajectories over extremely rough terrain.by Alexander C. Shkolnik.Ph.D

A COLLISION AVOIDANCE SYSTEM FOR AUTONOMOUS UNDERWATER VEHICLES

The work in this thesis is concerned with the development of a novel and practical collision avoidance system for autonomous underwater vehicles (AUVs). Synergistically, advanced stochastic motion planning methods, dynamics quantisation approaches, multivariable tracking controller designs, sonar data processing and workspace representation, are combined to enhance significantly the survivability of modern AUVs. The recent proliferation of autonomous AUV deployments for various missions such as seafloor surveying, scientific data gathering and mine hunting has demanded a substantial increase in vehicle autonomy. One matching requirement of such missions is to allow all the AUV to navigate safely in a dynamic and unstructured environment. Therefore, it is vital that a robust and effective collision avoidance system should be forthcoming in order to preserve the structural integrity of the vehicle whilst simultaneously increasing its autonomy. This thesis not only provides a holistic framework but also an arsenal of computational techniques in the design of a collision avoidance system for AUVs. The design of an obstacle avoidance system is first addressed. The core paradigm is the application of the Rapidly-exploring Random Tree (RRT) algorithm and the newly developed version for use as a motion planning tool. Later, this technique is merged with the Manoeuvre Automaton (MA) representation to address the inherent disadvantages of the RRT. A novel multi-node version which can also address time varying final state is suggested. Clearly, the reference trajectory generated by the aforementioned embedded planner must be tracked. Hence, the feasibility of employing the linear quadratic regulator (LQG) and the nonlinear kinematic based state-dependent Ricatti equation (SDRE) controller as trajectory trackers are explored. The obstacle detection module, which comprises of sonar processing and workspace representation submodules, is developed and tested on actual sonar data acquired in a sea-trial via a prototype forward looking sonar (AT500). The sonar processing techniques applied are fundamentally derived from the image processing perspective. Likewise, a novel occupancy grid using nonlinear function is proposed for the workspace representation of the AUV. Results are presented that demonstrate the ability of an AUV to navigate a complex environment. To the author's knowledge, it is the first time the above newly developed methodologies have been applied to an A UV collision avoidance system, and, therefore, it is considered that the work constitutes a contribution of knowledge in this area of work.J&S MARINE LT

Advances in Robot Navigation

Robot navigation includes different interrelated activities such as perception - obtaining and interpreting sensory information; exploration - the strategy that guides the robot to select the next direction to go; mapping - the construction of a spatial representation by using the sensory information perceived; localization - the strategy to estimate the robot position within the spatial map; path planning - the strategy to find a path towards a goal location being optimal or not; and path execution, where motor actions are determined and adapted to environmental changes. This book integrates results from the research work of authors all over the world, addressing the abovementioned activities and analyzing the critical implications of dealing with dynamic environments. Different solutions providing adaptive navigation are taken from nature inspiration, and diverse applications are described in the context of an important field of study: social robotics

Safe navigation and motion coordination control strategies for unmanned aerial vehicles

Unmanned aerial vehicles (UAVs) have become very popular for many military and civilian applications including in agriculture, construction, mining, environmental monitoring, etc. A desirable feature for UAVs is the ability to navigate and perform tasks autonomously with least human interaction. This is a very challenging problem due to several factors such as the high complexity of UAV applications, operation in harsh environments, limited payload and onboard computing power and highly nonlinear dynamics. Therefore, more research is still needed towards developing advanced reliable control strategies for UAVs to enable safe navigation in unknown and dynamic environments. This problem is even more challenging for multi-UAV systems where it is more efficient to utilize information shared among the networked vehicles. Therefore, the work presented in this thesis contributes towards the state-of-the-art in UAV control for safe autonomous navigation and motion coordination of multi-UAV systems. The first part of this thesis deals with single-UAV systems. Initially, a hybrid navigation framework is developed for autonomous mobile robots using a general 2D nonholonomic unicycle model that can be applied to different types of UAVs, ground vehicles and underwater vehicles considering only lateral motion. Then, the more complex problem of three-dimensional (3D) collision-free navigation in unknown/dynamic environments is addressed. To that end, advanced 3D reactive control strategies are developed adopting the sense-and-avoid paradigm to produce quick reactions around obstacles. A special case of navigation in 3D unknown confined environments (i.e. tunnel-like) is also addressed. General 3D kinematic models are considered in the design which makes these methods applicable to different UAV types in addition to underwater vehicles. Moreover, different implementation methods for these strategies with quadrotor-type UAVs are also investigated considering UAV dynamics in the control design. Practical experiments and simulations were carried out to analyze the performance of the developed methods. The second part of this thesis addresses safe navigation for multi-UAV systems. Distributed motion coordination methods of multi-UAV systems for flocking and 3D area coverage are developed. These methods offer good computational cost for large-scale systems. Simulations were performed to verify the performance of these methods considering systems with different sizes

Optimal steering for kinematic vehicles with applications to spatially distributed agents

The recent technological advances in the field of autonomous vehicles have resulted in a growing impetus for researchers to improve the current framework of mission planning and execution within both the military and civilian contexts. Many recent efforts towards this direction emphasize the importance of replacing the so-called monolithic paradigm, where a mission is planned, monitored, and controlled by a unique global decision maker, with a network centric paradigm, where the same mission related tasks are performed by networks of interacting decision makers (autonomous vehicles). The interest in applications involving teams of autonomous vehicles is expected to significantly grow in the near future as new paradigms for their use are constantly being proposed for a diverse spectrum of real world applications. One promising approach to extend available techniques for addressing problems involving a single autonomous vehicle to those involving teams of autonomous vehicles is to use the concept of Voronoi diagram as a means for reducing the complexity of the multi-vehicle problem. In particular, the Voronoi diagram provides a spatial partition of the environment the team of vehicles operate in, where each element of this partition is associated with a unique vehicle from the team. The partition induces, in turn, a graph abstraction of the operating space that is in a one-to-one correspondence with the network abstraction of the team of autonomous vehicles; a fact that can provide both conceptual and analytical advantages during mission planning and execution. In this dissertation, we propose the use of a new class of Voronoi-like partitioning schemes with respect to state-dependent proximity (pseudo-) metrics rather than the Euclidean distance or other generalized distance functions, which are typically used in the literature. An important nuance here is that, in contrast to the Euclidean distance, state-dependent metrics can succinctly capture system theoretic features of each vehicle from the team (e.g., vehicle kinematics), as well as the environment-vehicle interactions, which are induced, for example, by local winds/currents. We subsequently illustrate how the proposed concept of state-dependent Voronoi-like partition can induce local control schemes for problems involving networks of spatially distributed autonomous vehicles by examining different application scenarios.PhDCommittee Chair: Tsiotras Panagiotis; Committee Member: Egerstedt Magnus; Committee Member: Feron Eric; Committee Member: Haddad Wassim; Committee Member: Shamma Jef

Human Guidance Behavior Decomposition and Modeling

University of Minnesota Ph.D. dissertation. December 2017. Major: Aerospace Engineering. Advisor: Berenice Mettler. 1 computer file (PDF); x, 128 pages.Trained humans are capable of high performance, adaptable, and robust first-person dynamic motion guidance behavior. This behavior is exhibited in a wide variety of activities such as driving, piloting aircraft, skiing, biking, and many others. Human performance in such activities far exceeds the current capability of autonomous systems in terms of adaptability to new tasks, real-time motion planning, robustness, and trading safety for performance. The present work investigates the structure of human dynamic motion guidance that enables these performance qualities. This work uses a first-person experimental framework that presents a driving task to the subject, measuring control inputs, vehicle motion, and operator visual gaze movement. The resulting data is decomposed into subspace segment clusters that form primitive elements of action-perception interactive behavior. Subspace clusters are defined by both agent-environment system dynamic constraints and operator control strategies. A key contribution of this work is to define transitions between subspace cluster segments, or subgoals, as points where the set of active constraints, either system or operator defined, changes. This definition provides necessary conditions to determine transition points for a given task-environment scenario that allow a solution trajectory to be planned from known behavior elements. In addition, human gaze behavior during this task contains predictive behavior elements, indicating that the identified control modes are internally modeled. Based on these ideas, a generative, autonomous guidance framework is introduced that efficiently generates optimal dynamic motion behavior in new tasks. The new subgoal planning algorithm is shown to generate solutions to certain tasks more quickly than existing approaches currently used in robotics

NeBula: TEAM CoSTAR’s robotic autonomy solution that won phase II of DARPA subterranean challenge

This paper presents and discusses algorithms, hardware, and software architecture developed by the TEAM CoSTAR (Collaborative SubTerranean Autonomous Robots), competing in the DARPA Subterranean Challenge. Specifically, it presents the techniques utilized within the Tunnel (2019) and Urban (2020) competitions, where CoSTAR achieved second and first place, respectively. We also discuss CoSTAR’s demonstrations in Martian-analog surface and subsurface (lava tubes) exploration. The paper introduces our autonomy solution, referred to as NeBula (Networked Belief-aware Perceptual Autonomy). NeBula is an uncertainty-aware framework that aims at enabling resilient and modular autonomy solutions by performing reasoning and decision making in the belief space (space of probability distributions over the robot and world states). We discuss various components of the NeBula framework, including (i) geometric and semantic environment mapping, (ii) a multi-modal positioning system, (iii) traversability analysis and local planning, (iv) global motion planning and exploration behavior, (v) risk-aware mission planning, (vi) networking and decentralized reasoning, and (vii) learning-enabled adaptation. We discuss the performance of NeBula on several robot types (e.g., wheeled, legged, flying), in various environments. We discuss the specific results and lessons learned from fielding this solution in the challenging courses of the DARPA Subterranean Challenge competition.Peer ReviewedAgha, A., Otsu, K., Morrell, B., Fan, D. D., Thakker, R., Santamaria-Navarro, A., Kim, S.-K., Bouman, A., Lei, X., Edlund, J., Ginting, M. F., Ebadi, K., Anderson, M., Pailevanian, T., Terry, E., Wolf, M., Tagliabue, A., Vaquero, T. S., Palieri, M., Tepsuporn, S., Chang, Y., Kalantari, A., Chavez, F., Lopez, B., Funabiki, N., Miles, G., Touma, T., Buscicchio, A., Tordesillas, J., Alatur, N., Nash, J., Walsh, W., Jung, S., Lee, H., Kanellakis, C., Mayo, J., Harper, S., Kaufmann, M., Dixit, A., Correa, G. J., Lee, C., Gao, J., Merewether, G., Maldonado-Contreras, J., Salhotra, G., Da Silva, M. S., Ramtoula, B., Fakoorian, S., Hatteland, A., Kim, T., Bartlett, T., Stephens, A., Kim, L., Bergh, C., Heiden, E., Lew, T., Cauligi, A., Heywood, T., Kramer, A., Leopold, H. A., Melikyan, H., Choi, H. C., Daftry, S., Toupet, O., Wee, I., Thakur, A., Feras, M., Beltrame, G., Nikolakopoulos, G., Shim, D., Carlone, L., & Burdick, JPostprint (published version