Design and Implementation of Intelligent Guidance Algorithms for UAV Mission Protection

In recent years, the interest of investigating intelligent systems for Unmanned Aerial Vehicles (UAVs) have increased in popularity due to their large range of capabilities such as on-line obstacle avoidance, autonomy, search and rescue, fast prototyping and integration in the National Air Space (NAS). Many research efforts currently focus on system robustness against uncertainties but do not consider the probability of readjusting tasks based on the remaining resources to successfully complete the mission. In this thesis, an intelligent algorithm approach is proposed along with decision-making capabilities to enhance UAVs post-failure performance. This intelligent algorithm integrates a set of path planning algorithms, a health monitoring system and a power estimation approach. Post-fault conditions are considered as unknown uncertainties that unmanned vehicles could encounter during regular operation missions. In this thesis, three main threats are studied: the presence of unknown obstacles in the environment, sub-system failures, and low power resources. A solution for adapting to new circumstances is addressed by enabling autonomous decision-making and re-planning capabilities in real time

Multi-Robot Systems: Challenges, Trends and Applications

This book is a printed edition of the Special Issue entitled “Multi-Robot Systems: Challenges, Trends, and Applications” that was published in Applied Sciences. This Special Issue collected seventeen high-quality papers that discuss the main challenges of multi-robot systems, present the trends to address these issues, and report various relevant applications. Some of the topics addressed by these papers are robot swarms, mission planning, robot teaming, machine learning, immersive technologies, search and rescue, and social robotics

Autonomous system control in unknown operating conditions

Autonomous systems have become an interconnected part of everyday life with the recent increases in computational power available for both onboard computers and offline data processing. The race by car manufacturers for level 5 (full) autonomy in self-driving cars is well underway and new flying taxi service startups are emerging every week, attracting billions in investments. Two main research communities, Optimal Control and Reinforcement Learning stand out in the field of autonomous systems, each with a vastly different perspective on the control problem. Controllers from the optimal control community are based on models and can be rigorously analyzed to ensure the stability of the system is maintained under certain operating conditions. Learning-based control strategies are often referred to as model-free and typically involve training a neural network to generate the required control actions through direct interactions with the system. This greatly reduces the design effort required to control complex systems. One common problem both learning- and model- based control solutions face is the dependency on a priori knowledge about the system and operating conditions such as possible internal component failures and external environmental disturbances. It is not possible to consider every possible operating scenario an autonomous system can encounter in the real world at design time. Models and simulators are approximations of reality and can only be created for known operating conditions. Autonomous system control in unknown operating conditions, where no a priori knowledge exists, is still an open problem for both communities and no control methods currently exist for such situations. Multiple model adaptive control is a modular control framework that divides the control problem into supervisory and low-level control, which allows for the combination of existing learning- and model-based control methods to overcome the disadvantages of using only one of these. The contributions of this thesis consist of five novel supervisory control architectures, which have been empirically shown to improve a system’s robustness to unknown operating conditions, and a novel low- level controller tuning algorithm that can reduce the number of required controllers compared to traditional tuning approaches. The presented methods apply to any autonomous system that can be controlled using model-based controllers and can be integrated alongside existing fault-tolerant control systems to improve robustness to unknown operating conditions. This impacts autonomous system designers by providing novel control mechanisms to improve a system’s robustness to unknown operating conditions

Feasibility study of Unmanned Aerial Vehicles (UAV) application for ultrasonic Non-Destructive Testing (NDT) of Wind Turbine Rotor Blades. Preliminary experiments of handheld and UAV utrasonic testing on glass fibre laminate

In this thesis, we have conducted a feasibility study on UAV application for ultrasonic pulsed non-destructive testing of wind turbine rotor blades. Due to the high initial cost of wind turbines, and their decreasing availability due to increasing size and offshore locations, it is imperative to properly maintain these structures over their 10-30-year lifetime. Operation and maintenance costs can account for 25-30% of the overall energy generation costs (MartinezLuengo, et al., 2016), where the wind turbine rotor blade can be considered the most critical component, accounting for 15-20% of the manufacturing costs. Thus, an increase in O&M efficiency of wind turbine rotor blades through condition monitoring can yield substantial financial benefits. Currently, Unmanned Aerial Vehicles (UAV) are in use for visual and thermography inspection of wind turbines. These techniques for structural condition monitoring does have serious limitations, as the condition of internal components in blades, built from glass fibre laminates, cannot be visually inspected. However, pulsed ultrasonic echo technique have proven highly efficient for wind turbine rotor blade inspection. The ultrasonic transducer requires surface contact with the examined material, and we investigated the potential of UAV implementation for fast, safe and reliable measurements of wind turbine rotor blades. This feasibility study investigates the applicability of ultrasonic testing of glass fibre laminates, specifically glass fibre produced by Lyngen Plast A/S. Firstly, we conducted handheld ultrasonic tests on simulated delamination defects, looking for damage indications on a voltage-time graph. Secondly, we induced damage on a 27mm thick sample through a 3-point bending test and measured the echo response from the ultrasonic pulse. The second experiment was repeated using a Storm AntiGravity UAV, producing promising results with preliminary instrumentation. A significant challenge to the feasibility of this study was the operational risks. We carried out a preliminary and qualitative risk assessment of the intended UAV operation by using the SWIFTanalysis and Bow-Tie method. The results were two important risk-mitigating measures. Risk reductive: “Design UAV for impact with wind turbine rotor blades,” and risk preventive: “Develop statistical data on wind conditions at wind turbine site, calculate low-risk dates for flight.” The implementation of the said measures, quality of our results, experiences from the UAV flight and concept considerations are presented throughout this paper. In the end, a conclusion is drawn and topics for future studies is presented

Data-Driven Architecture to Increase Resilience In Multi-Agent Coordinated Missions

The rise in the use of Multi-Agent Systems (MASs) in unpredictable and changing environments has created the need for intelligent algorithms to increase their autonomy, safety and performance in the event of disturbances and threats. MASs are attractive for their flexibility, which also makes them prone to threats that may result from hardware failures (actuators, sensors, onboard computer, power source) and operational abnormal conditions (weather, GPS denied location, cyber-attacks). This dissertation presents research on a bio-inspired approach for resilience augmentation in MASs in the presence of disturbances and threats such as communication link and stealthy zero-dynamics attacks. An adaptive bio-inspired architecture is developed for distributed consensus algorithms to increase fault-tolerance in a network of multiple high-order nonlinear systems under directed fixed topologies. In similarity with the natural organisms’ ability to recognize and remember specific pathogens to generate its immunity, the immunity-based architecture consists of a Distributed Model-Reference Adaptive Control (DMRAC) with an Artificial Immune System (AIS) adaptation law integrated within a consensus protocol. Feedback linearization is used to modify the high-order nonlinear model into four decoupled linear subsystems. A stability proof of the adaptation law is conducted using Lyapunov methods and Jordan decomposition. The DMRAC is proven to be stable in the presence of external time-varying bounded disturbances and the tracking error trajectories are shown to be bounded. The effectiveness of the proposed architecture is examined through numerical simulations. The proposed controller successfully ensures that consensus is achieved among all agents while the adaptive law v simultaneously rejects the disturbances in the agent and its neighbors. The architecture also includes a health management system to detect faulty agents within the global network. Further numerical simulations successfully test and show that the Global Health Monitoring (GHM) does effectively detect faults within the network

Modular and Safe Event-Driven Programming

Asynchronous event-driven systems are ubiquitous across domains such as device drivers, distributed systems, and robotics. These systems are notoriously hard to get right as the programmer needs to reason about numerous control paths resulting from the complex interleaving of events (or messages) and failures. Unsurprisingly, it is easy to introduce subtle errors while attempting to fill in gaps between high-level system specifications and their concrete implementations.This dissertation proposes new methods for programming safe event-driven asynchronous systems.In the first part of the thesis, we present ModP, a modular programming framework for compositional programming and testing of event-driven asynchronous systems.The ModP module system supports a novel theory of compositional refinement for assume-guarantee reasoning of dynamic event-driven asynchronous systems. We build a complex distributed systems software stack using ModP.Our results demonstrate that compositional reasoning can help scale model-checking (both explicit and symbolic) to large distributed systems.ModP is transforming the way asynchronous software is built at Microsoft and Amazon Web Services (AWS). Microsoft uses ModP for implementing safe device drivers and other software in the Windows kernel.AWS uses ModP for compositional model checking of complex distributed systems. While ModP simplifies analysis of such systems, the state space of industrial-scale systems remains extremely large.In the second part of this thesis, we present scalable verification and systematic testing approaches to further mitigate this state-space explosion problem.First, we introduce the concept of a delaying explorer to perform prioritized exploration of the behaviors of an asynchronous reactive program. A delaying explorer stratifies the search space using a custom strategy (tailored towards finding bugs faster), and a delay operation that allows deviation from that strategy. We show that prioritized search with a delaying explorer performs significantly better than existing approaches for finding bugs in asynchronous programs.Next, we consider the challenge of verifying time-synchronized systems; these are almost-synchronous systems as they are neither completely asynchronous nor synchronous.We introduce approximate synchrony, a sound and tunable abstraction for verification of almost-synchronous systems. We show how approximate synchrony can be used for verification of both time-synchronization protocols and applications running on top of them.Moreover, we show how approximate synchrony also provides a useful strategy to guide state-space exploration during model-checking.Using approximate synchrony and implementing it as a delaying explorer, we were able to verify the correctness of the IEEE 1588 distributed time-synchronization protocol and, in the process, uncovered a bug in the protocol that was well appreciated by the standards committee.In the final part of this thesis, we consider the challenge of programming a special class of event-driven asynchronous systems -- safe autonomous robotics systems.Our approach towards achieving assured autonomy for robotics systems consists of two parts: (1) a high-level programming language for implementing and validating the reactive robotics software stack; and (2) an integrated runtime assurance system to ensure that the assumptions used during design-time validation of the high-level software hold at runtime.Combining high-level programming language and model-checking with runtime assurance helps us bridge the gap between design-time software validation that makes assumptions about the untrusted components (e.g., low-level controllers), and the physical world, and the actual execution of the software on a real robotic platform in the physical world. We implemented our approach as DRONA, a programming framework for building safe robotics systems.We used DRONA for building a distributed mobile robotics system and deployed it on real drone platforms. Our results demonstrate that DRONA (with the runtime-assurance capabilities) enables programmers to build an autonomous robotics software stack with formal safety guarantees.To summarize, this thesis contributes new theory and tools to the areas of programming languages, verification, systematic testing, and runtime assurance for programming safe asynchronous event-driven across the domains of fault-tolerant distributed systems and safe autonomous robotics systems

George C. Marshall Space Flight Center Research and Technology Report 2014

Many of NASA's missions would not be possible if it were not for the investments made in research advancements and technology development efforts. The technologies developed at Marshall Space Flight Center contribute to NASA's strategic array of missions through technology development and accomplishments. The scientists, researchers, and technologists of Marshall Space Flight Center who are working these enabling technology efforts are facilitating NASA's ability to fulfill the ambitious goals of innovation, exploration, and discovery

Proceedings of the International Micro Air Vehicles Conference and Flight Competition 2017 (IMAV 2017)

The IMAV 2017 conference has been held at ISAE-SUPAERO, Toulouse, France from Sept. 18 to Sept. 21, 2017. More than 250 participants coming from 30 different countries worldwide have presented their latest research activities in the field of drones. 38 papers have been presented during the conference including various topics such as Aerodynamics, Aeroacoustics, Propulsion, Autopilots, Sensors, Communication systems, Mission planning techniques, Artificial Intelligence, Human-machine cooperation as applied to drones