Fault-tolerant formation driving mechanism designed for heterogeneous MAVs-UGVs groups

A fault-tolerant method for stabilization and navigation of 3D heterogeneous formations is proposed in this paper. The presented Model Predictive Control (MPC) based approach enables to deploy compact formations of closely cooperating autonomous aerial and ground robots in surveillance scenarios without the necessity of a precise external localization. Instead, the proposed method relies on a top-view visual relative localization provided by the micro aerial vehicles flying above the ground robots and on a simple yet stable visual based navigation using images from an onboard monocular camera. The MPC based schema together with a fault detection and recovery mechanism provide a robust solution applicable in complex environments with static and dynamic obstacles. The core of the proposed leader-follower based formation driving method consists in a representation of the entire 3D formation as a convex hull projected along a desired path that has to be followed by the group. Such an approach provides non-collision solution and respects requirements of the direct visibility between the team members. The uninterrupted visibility is crucial for the employed top-view localization and therefore for the stabilization of the group. The proposed formation driving method and the fault recovery mechanisms are verified by simulations and hardware experiments presented in the paper

Resilient Perception for Outdoor Unmanned Ground Vehicles

This thesis promotes the development of resilience for perception systems with a focus on Unmanned Ground Vehicles (UGVs) in adverse environmental conditions. Perception is the interpretation of sensor data to produce a representation of the environment that is necessary for subsequent decision making. Long-term autonomy requires perception systems that correctly function in unusual but realistic conditions that will eventually occur during extended missions. State-of-the-art UGV systems can fail when the sensor data are beyond the operational capacity of the perception models. The key to resilient perception system lies in the use of multiple sensor modalities and the pre-selection of appropriate sensor data to minimise the chance of failure. This thesis proposes a framework based on diagnostic principles to evaluate and preselect sensor data prior to interpretation by the perception system. Image-based quality metrics are explored and evaluated experimentally using infrared (IR) and visual cameras onboard a UGV in the presence of smoke and airborne dust. A novel quality metric, Spatial Entropy (SE), is introduced and evaluated. The proposed framework is applied to a state-of-the-art Visual-SLAM algorithm combining visual and IR imaging as a real-world example. An extensive experimental evaluation demonstrates that the framework allows for camera-based localisation that is resilient to a range of low-visibility conditions when compared to other methods that use a single sensor or combine sensor data without selection. The proposed framework allows for a resilient localisation in adverse conditions using image data but also has significant potential to benefit many perception applications. Employing multiple sensing modalities along with pre-selection of appropriate data is a powerful method to create resilient perception systems by anticipating and mitigating errors. The development of such resilient perception systems is a requirement for next-generation outdoor UGVs

Cooperative Virtual Sensor for Fault Detection and Identification in Multi-UAV Applications

This paper considers the problem of fault detection and identification (FDI) in applications carried out by a group of unmanned aerial vehicles (UAVs) with visual cameras. In many cases, the UAVs have cameras mounted onboard for other applications, and these cameras can be used as bearing-only sensors to estimate the relative orientation of another UAV. The idea is to exploit the redundant information provided by these sensors onboard each of the UAVs to increase safety and reliability, detecting faults on UAV internal sensors that cannot be detected by the UAVs themselves. Fault detection is based on the generation of residuals which compare the expected position of a UAV, considered as target, with the measurements taken by one or more UAVs acting as observers that are tracking the target UAV with their cameras. Depending on the available number of observers and the way they are used, a set of strategies and policies for fault detection are defined. When the target UAV is being visually tracked by two or more observers, it is possible to obtain an estimation of its 3D position that could replace damaged sensors. Accuracy and reliability of this vision-based cooperative virtual sensor (CVS) have been evaluated experimentally in a multivehicle indoor testbed with quadrotors, injecting faults on data to validate the proposed fault detection methods.Comisión Europea H2020 644271Comisión Europea FP7 288082Ministerio de Economia, Industria y Competitividad DPI2015-71524-RMinisterio de Economia, Industria y Competitividad DPI2014-5983-C2-1-RMinisterio de Educación, Cultura y Deporte FP

The Underpinnings of Workload in Unmanned Vehicle Systems

This paper identifies and characterizes factors that contribute to operator workload in unmanned vehicle systems. Our objective is to provide a basis for developing models of workload for use in design and operation of complex human-machine systems. In 1986, Hart developed a foundational conceptual model of workload, which formed the basis for arguably the most widely used workload measurement techniquethe NASA Task Load Index. Since that time, however, there have been many advances in models and factor identification as well as workload control measures. Additionally, there is a need to further inventory and describe factors that contribute to human workload in light of technological advances, including automation and autonomy. Thus, we propose a conceptual framework for the workload construct and present a taxonomy of factors that can contribute to operator workload. These factors, referred to as workload drivers, are associated with a variety of system elements including the environment, task, equipment and operator. In addition, we discuss how workload moderators, such as automation and interface design, can be manipulated in order to influence operator workload. We contend that workload drivers, workload moderators, and the interactions among drivers and moderators all need to be accounted for when building complex, human-machine systems

The use of a Multi-label Classification Framework for the Detection of Broken Bars and Mixed Eccentricity Faults based on the Start-up Transient

[EN] In this article a data driven approach for the classification of simultaneously occurring faults in an induction motor is presented. The problem is treated as a multi-label classification problem with each label corresponding to one specific fault. The faulty conditions examined, include the existence of a broken bar fault and the presence of mixed eccentricity with various degrees of static and dynamic eccentricity, while three "problem transformation" methods are tested and compared. For the feature extraction stage, the startup current is exploited using two well-known time-frequency (scale) transformations. This is the first time that a multi-label framework is used for the diagnosis of co-occurring fault conditions using information coming from the start-up current of induction motors. The efficiency of the proposed approach is validated using simulation data with promising results irrespective of the selected time-frequency transformation.This work was supported in part by the Spanish MINECO and FEDER program in the framework of the "Proyectos I + D del Subprograma de Generacion de Conocimiento, Programa Estatal de Fomento de la Investigacion Cientifica y Tecnica de Excelencia" under Grant DPI2014-52842-P and in part by the Horizon 2020 Framework program DISIRE under the Grant Agreement 636834.Georgoulas, G.; Climente Alarcón, V.; Antonino-Daviu, J.; Tsoumas, IP.; Stylios, CD.; Arkkio, A.; Nikolakopoulos, G. (2016). The use of a Multi-label Classification Framework for the Detection of Broken Bars and Mixed Eccentricity Faults based on the Start-up Transient. IEEE Transactions on Industrial Informatics. 13(2):625-634. https://doi.org/10.1109/TII.2016.2637169S62563413

Autonomous Systems, Robotics, and Computing Systems Capability Roadmap: NRC Dialogue

Contents include the following: Introduction. Process, Mission Drivers, Deliverables, and Interfaces. Autonomy. Crew-Centered and Remote Operations. Integrated Systems Health Management. Autonomous Vehicle Control. Autonomous Process Control. Robotics. Robotics for Solar System Exploration. Robotics for Lunar and Planetary Habitation. Robotics for In-Space Operations. Computing Systems. Conclusion

Reference Model for Interoperability of Autonomous Systems

This thesis proposes a reference model to describe the components of an Un-manned Air, Ground, Surface, or Underwater System (UxS), and the use of a single Interoperability Building Block to command, control, and get feedback from such vehicles. The importance and advantages of such a reference model, with a standard nomenclature and taxonomy, is shown. We overview the concepts of interoperability and some efforts to achieve common refer-ence models in other areas. We then present an overview of existing un-manned systems, their history, characteristics, classification, and missions. The concept of Interoperability Building Blocks (IBB) is introduced to describe standards, protocols, data models, and frameworks, and a large set of these are analyzed. A new and powerful reference model for UxS, named RAMP, is proposed, that describes the various components that a UxS may have. It is a hierarchical model with four levels, that describes the vehicle components, the datalink, and the ground segment. The reference model is validated by showing how it can be applied in various projects the author worked on. An example is given on how a single standard was capable of controlling a set of heterogeneous UAVs, USVs, and UGVs

Agronomy

Climate change is a serious threat to field crop production and food security. It has negative effects on food, water, and energy security due to change in weather patterns and extreme events such as floods, droughts, and heat waves, all of which reduce crop productivity. Over six chapters, this book presents a comprehensive picture of the importance of agronomy as it relates to the United Nations’ Sustainable Development Goals. With an emphasis on the goals of Zero Hunger and Climate Change, this volume examines sustainable agronomic practices to increase crop productivity and improve environmental health

Real-time implementation of a sensor validation scheme for a heavy-duty diesel engine

With ultra-low exhaust emissions standards, heavy-duty diesel engines (HDDEs) are dependent upon a myriad of sensors to optimize power output and exhaust emissions. Apart from acquiring and processing sensor signals, engine control modules should also have capabilities to report and compensate for sensors that have failed. The global objective of this research was to develop strategies to enable HDDEs to maintain nominal in-use performance during periods of sensor failures. Specifically, the work explored the creation of a sensor validation scheme to detect, isolate, and accommodate sensor failures in HDDEs. The scheme not only offers onboard diagnostic (OBD) capabilities, but also control of engine performance in the event of sensor failures. The scheme, known as Sensor Failure Detection Isolation and Accommodation (SFDIA), depends on mathematical models for its functionality. Neural approximators served as the modeling tool featuring online adaptive capabilities. The significance of the SFDIA is that it can enhance an engine management system (EMS) capability to control performance under any operating conditions when sensors fail. The SFDIA scheme updates models during the lifetime of an engine under real world, in-use conditions. The central hypothesis for the work was that the SFDIA scheme would allow continuous normal operation of HDDEs under conditions of sensor failures. The SFDIA was tested using the boost pressure, coolant temperature, and fuel pressure sensors to evaluate its performance. The test engine was a 2004 MackRTM MP7-355E (11 L, 355 hp). Experimental work was conducted at the Engine and Emissions Research Laboratory (EERL) at West Virginia University (WVU). Failure modes modeled were abrupt, long-term drift and intermittent failures. During the accommodation phase, the SFDIA restored engine power up to 0.64% to nominal. In addition, oxides of nitrogen (NOx) emissions were maintained at up to 1.41% to nominal

Multimodal Information Fusion for High-Robustness and Low-Drift State Estimation of UGVs in Diverse Scenes

Currently, the autonomous positioning of unmanned ground vehicles (UGVs) still faces the problems of insufficient persistence and poor reliability, especially in the challenging scenarios where satellites are denied, or the sensing modalities such as vision or laser are degraded. Based on multimodal information fusion and failure detection (FD), this article proposes a high-robustness and low-drift state estimation system suitable for multiple scenes, which integrates light detection and ranging (LiDAR), inertial measurement units (IMUs), stereo camera, encoders, attitude and heading reference system (AHRS) in a loose coupling way. Firstly, a state estimator with variable fusion mode is designed based on the error-state extended Kalman filtering (ES-EKF), which can fuse encoder-AHRS subsystem (EAS), visual-inertial subsystem (VIS), and LiDAR subsystem (LS) and change its integration structure online by selecting a fusion mode. Secondly, in order to improve the robustness of the whole system in challenging environments, an information manager is created, which judges the health status of subsystems by degeneration metrics, and then online selects appropriate information sources and variables to enter the estimator according to their health status. Finally, the proposed system is extensively evaluated using the datasets collected from six typical scenes: street, field, forest, forest-at-night, street-at-night and tunnel-at-night. The experimental results show our framework is better or comparable accuracy and robustness than existing publicly available systems