Modeling and control of UAV bearing formations with bilateral high-level steering

In this paper we address the problem of controlling the motion of a group of unmanned aerial vehicles (UAVs) bound to keep a formation defined in terms of only relative angles (i.e. a bearing formation). This problem can naturally arise within the context of several multi-robot applications such as, e.g. exploration, coverage, and surveillance. First, we introduce and thoroughly analyze the concept and properties of bearing formations, and provide a class of minimally linear sets of bearings sufficient to uniquely define such formations. We then propose a bearing-only formation controller requiring only bearing measurements, converging almost globally, and maintaining bounded inter-agent distances despite the lack of direct metric information.The controller still leaves the possibility of imposing group motions tangent to the current bearing formation. These can be either autonomously chosen by the robots because of any additional task (e.g. exploration), or exploited by an assisting human co-operator. For this latter 'human-in-the-loop' case, we propose a multi-master/multi-slave bilateral shared control system providing the co-operator with some suitable force cues informative of the UAV performance. The proposed theoretical framework is extensively validated by means of simulations and experiments with quadrotor UAVs equipped with onboard cameras. Practical limitations, e.g. limited field-of-view, are also considered. © The Author(s) 2012

Using haptic feedback in human swarm interaction

A swarm of robots is a large group of individual agents that autonomously coordinate via local control laws. Their emergent behavior allows simple robots to accomplish complex tasks. Since missions may have complex objectives that change dynamically due to environmental and mission changes, human control and influence over the swarm is needed. The field of Human Swarm Interaction (HSI) is young, with few user studies, and even fewer papers focusing on giving non-visual feedback to the operator. The authors will herein present a background of haptics in robotics and swarms and two studies that explore various conditions under which haptic feedback may be useful in HSI. The overall goal of the studies is to explore the effectiveness of haptic feedback in the presence of other visual stimuli about the swarm system. The findings show that giving feedback about nearby obstacles using a haptic device can improve performance, and that a combination of feedback from obstacle forces via the visual and haptic channels provide the best performance

Human-Robot Team Interaction Through Wearable Haptics for Cooperative Manipulation

The interaction of robot teams and single human in teleoperation scenarios is beneficial in cooperative tasks, for example the manipulation of heavy and large objects in remote or dangerous environments. The main control challenge of the interaction is its asymmetry, arising because robot teams have a relatively high number of controllable degrees of freedom compared to the human operator. Therefore, we propose a control scheme that establishes the interaction on spaces of reduced dimensionality taking into account the low number of human command and feedback signals imposed by haptic devices. We evaluate the suitability of wearable haptic fingertip devices for multi-contact teleoperation in a user study. The results show that the proposed control approach is appropriate for human-robot team interaction and that the wearable haptic fingertip devices provide suitable assistance in cooperative manipulation tasks

Contributions to shared control and coordination of single and multiple robots

L’ensemble des travaux présentés dans cette habilitation traite de l'interface entre un d'un opérateur humain avec un ou plusieurs robots semi-autonomes aussi connu comme le problème du « contrôle partagé ».Le premier chapitre traite de la possibilité de fournir des repères visuels / vestibulaires à un opérateur humain pour la commande à distance de robots mobiles.Le second chapitre aborde le problème, plus classique, de la mise à disposition à l’opérateur d’indices visuels ou de retour haptique pour la commande d’un ou plusieurs robots mobiles (en particulier pour les drones quadri-rotors).Le troisième chapitre se concentre sur certains des défis algorithmiques rencontrés lors de l'élaboration de techniques de coordination multi-robots.Le quatrième chapitre introduit une nouvelle conception mécanique pour un drone quadrirotor sur-actionné avec pour objectif de pouvoir, à terme, avoir 6 degrés de liberté sur une plateforme quadrirotor classique (mais sous-actionné).Enfin, le cinquième chapitre présente une cadre général pour la vision active permettant, en optimisant les mouvements de la caméra, l’optimisation en ligne des performances (en terme de vitesse de convergence et de précision finale) de processus d’estimation « basés vision »

Trust-Based Control of (Semi)Autonomous Mobile Robotic Systems

Despite great achievements made in (semi)autonomous robotic systems, human participa-tion is still an essential part, especially for decision-making about the autonomy allocation of robots in complex and uncertain environments. However, human decisions may not be optimal due to limited cognitive capacities and subjective human factors. In human-robot interaction (HRI), trust is a major factor that determines humans use of autonomy. Over/under trust may lead to dispro-portionate autonomy allocation, resulting in decreased task performance and/or increased human workload. In this work, we develop automated decision-making aids utilizing computational trust models to help human operators achieve a more effective and unbiased allocation. Our proposed decision aids resemble the way that humans make an autonomy allocation decision, however, are unbiased and aim to reduce human workload, improve the overall performance, and result in higher acceptance by a human. We consider two types of autonomy control schemes for (semi)autonomous mobile robotic systems. The first type is a two-level control scheme which includes switches between either manual or autonomous control modes. For this type, we propose automated decision aids via a computational trust and self-confidence model. We provide analytical tools to investigate the steady-state effects of the proposed autonomy allocation scheme on robot performance and human workload. We also develop an autonomous decision pattern correction algorithm using a nonlinear model predictive control to help the human gradually adapt to a better allocation pattern. The second type is a mixed-initiative bilateral teleoperation control scheme which requires mixing of autonomous and manual control. For this type, we utilize computational two-way trust models. Here, mixed-initiative is enabled by scaling the manual and autonomous control inputs with a function of computational human-to-robot trust. The haptic force feedback cue sent by the robot is dynamically scaled with a function of computational robot-to-human trust to reduce humans physical workload. Using the proposed control schemes, our human-in-the-loop tests show that the trust-based automated decision aids generally improve the overall robot performance and reduce the operator workload compared to a manual allocation scheme. The proposed decision aids are also generally preferred and trusted by the participants. Finally, the trust-based control schemes are extended to the single-operator-multi-robot applications. A theoretical control framework is developed for these applications and the stability and convergence issues under the switching scheme between different robots are addressed via passivity based measures

Autonomous landing of fixed-wing aircraft on mobile platforms

E n esta tesis se propone un nuevo sistema que permite la operación de aeronaves autónomas sin tren de aterrizaje. El trabajo está motivado por el interés industrial en aeronaves con la capacidad de volar a gran altitud, con más capacidad de carga útil y capaces de aterrizar con viento cruzado. El enfoque seguido en este trabajo consiste en eliminar el sistema de aterrizaje de una aeronave de ala fija empleando una plataforma móvil de aterrizaje en tierra. La aeronave y la plataforma deben sincronizar su movimiento antes del aterrizaje, lo que se logra mediante la estimación del estado relativo entre ambas y el control cooperativo del movimiento. El objetivo principal de esta Tesis es el desarrollo de una solución práctica para el aterrizaje autónomo de una aeronave de ala fija en una plataforma móvil. En la tesis se combinan nuevos métodos con experimentos prácticos para los cuales se ha desarrollado un sistema de pruebas específico. Se desarrollan dos variantes diferentes del sistema de aterrizaje. El primero presta atención especial a la seguridad, es robusto ante retrasos en la comunicación entre vehículos y cumple procedimientos habituales de aterrizaje, al tiempo que reduce la complejidad del sistema. En el segundo se utilizan trayectorias optimizadas del vehículo y sincronización bilateral de posición para maximizar el rendimiento del aterrizaje en términos de requerimientos de longitud necesaria de pista, pero la estabilidad es dependiente del retraso de tiempo, con lo cual es necesario desarrollar un controlador estabilizador ampliado, basado en pasividad, que permite resolver este problema. Ambas estrategias imponen requisitos funcionales a los controladores de cada uno de los vehículos, lo que implica la capacidad de controlar el movimiento longitudinal sin afectar el control lateral o vertical, y viceversa. El control de vuelo basado en energía se utiliza para proporcionar dicha funcionalidad a la aeronave. Los sistemas de aterrizaje desarrollados se han analizado en simulación estableciéndose los límites de rendimiento mediante múltiples repeticiones aleatorias. Se llegó a la conclusión de que el controlador basado en seguridad proporciona un rendimiento de aterrizaje satisfactorio al tiempo que suministra una mayor seguridad operativa y un menor esfuerzo de implementación y certificación. El controlador basado en el rendimiento es prometedor para aplicaciones con una longitud de pista limitada. Se descubrió que los beneficios del controlador basado en el rendimiento son menos pronunciados para una dinámica de vehículos terrestres más lenta. Teniendo en cuenta la dinámica lenta de la configuración del demostrador, se eligió el enfoque basado en la seguridad para los primeros experimentos de aterrizaje. El sistema de aterrizaje se validó en diversas pruebas de aterrizaje exitosas, que, a juicio del autor, son las primeras en el mundo realizadas con aeronaves reales. En última instancia, el concepto propuesto ofrece importantes beneficios y constituye una estrategia prometedora para futuras soluciones de aterrizaje de aeronaves.In this thesis a new landing system is proposed, which allows for the operation of autonomous aircraft without landing gear. The work was motivated by the industrial need for more capable high altitude aircraft systems, which typically suffer from low payload capacity and high crosswind landing sensitivity. The approach followed in this work consists in removing the landing gear system from the aircraft and introducing a mobile ground-based landing platform. The vehicles must synchronize their motion prior to landing, which is achieved through relative state estimation and cooperative motion control. The development of a practical solution for the autonomous landing of an aircraft on a moving platform thus constitutes the main goal of this thesis. Therefore, theoretical investigations are combined with real experiments for which a special setup is developed and implemented. Two different landing system variants are developed — the safety-based landing system is robust to inter-vehicle communication delays and adheres to established landing procedures, while reducing system complexity. The performance-based landing system uses optimized vehicle trajectories and bilateral position synchronization to maximize landing performance in terms of used runway, but suffers from time delay-dependent stability. An extended passivity-based stabilizing controller was implemented to cope with this issue. Both strategies impose functional requirements on the individual vehicle controllers, which imply independent controllability of the translational degrees of freedom. Energy-based flight control is utilized to provide such functionality for the aircraft. The developed landing systems are analyzed in simulation and performance bounds are determined by means of repeated random sampling. The safety-based controller was found to provide satisfactory landing performance while providing higher operational safety, and lower implementation and certification effort. The performance-based controller is promising for applications with limited runway length. The performance benefits were found to be less pronounced for slower ground vehicle dynamics. Given the slow dynamics of the demonstrator setup, the safety-based approach was chosen for first landing experiments. The landing system was validated in a number of successful landing trials, which to the author’s best knowledge was the first time such technology was demonstrated on the given scale, worldwide. Ultimately, the proposed concept offers decisive benefits and constitutes a promising strategy for future aircraft landing solutions

Towards Tactile Internet in Beyond 5G Era: Recent Advances, Current Issues and Future Directions

Tactile Internet (TI) is envisioned to create a paradigm shift from the content-oriented communications to steer/control-based communications by enabling real-time transmission of haptic information (i.e., touch, actuation, motion, vibration, surface texture) over Internet in addition to the conventional audiovisual and data traffics. This emerging TI technology, also considered as the next evolution phase of Internet of Things (IoT), is expected to create numerous opportunities for technology markets in a wide variety of applications ranging from teleoperation systems and Augmented/Virtual Reality (AR/VR) to automotive safety and eHealthcare towards addressing the complex problems of human society. However, the realization of TI over wireless media in the upcoming Fifth Generation (5G) and beyond networks creates various non-conventional communication challenges and stringent requirements in terms of ultra-low latency, ultra-high reliability, high data-rate connectivity, resource allocation, multiple access and quality-latency-rate tradeoff. To this end, this paper aims to provide a holistic view on wireless TI along with a thorough review of the existing state-of-the-art, to identify and analyze the involved technical issues, to highlight potential solutions and to propose future research directions. First, starting with the vision of TI and recent advances and a review of related survey/overview articles, we present a generalized framework for wireless TI in the Beyond 5G Era including a TI architecture, the main technical requirements, the key application areas and potential enabling technologies. Subsequently, we provide a comprehensive review of the existing TI works by broadly categorizing them into three main paradigms; namely, haptic communications, wireless AR/VR, and autonomous, intelligent and cooperative mobility systems. Next, potential enabling technologies across physical/Medium Access Control (MAC) and network layers are identified and discussed in detail. Also, security and privacy issues of TI applications are discussed along with some promising enablers. Finally, we present some open research challenges and recommend promising future research directions

Unmanned Aerial Systems for Wildland and Forest Fires

Wildfires represent an important natural risk causing economic losses, human death and important environmental damage. In recent years, we witness an increase in fire intensity and frequency. Research has been conducted towards the development of dedicated solutions for wildland and forest fire assistance and fighting. Systems were proposed for the remote detection and tracking of fires. These systems have shown improvements in the area of efficient data collection and fire characterization within small scale environments. However, wildfires cover large areas making some of the proposed ground-based systems unsuitable for optimal coverage. To tackle this limitation, Unmanned Aerial Systems (UAS) were proposed. UAS have proven to be useful due to their maneuverability, allowing for the implementation of remote sensing, allocation strategies and task planning. They can provide a low-cost alternative for the prevention, detection and real-time support of firefighting. In this paper we review previous work related to the use of UAS in wildfires. Onboard sensor instruments, fire perception algorithms and coordination strategies are considered. In addition, we present some of the recent frameworks proposing the use of both aerial vehicles and Unmanned Ground Vehicles (UV) for a more efficient wildland firefighting strategy at a larger scale.Comment: A recent published version of this paper is available at: https://doi.org/10.3390/drones501001