Modeling and performance estimation of robotic systems using ROS: application to drone-based services

Smart Robots are an integral part of the 4th Industrial Revolution. Its integration as essential components in robot-based services is not straightforward. Each robot is a cyber-physical system (CPS) where a mechanical part operates under the control of a digital board(s). Modeling and simulation of such devices has specificities to be taken into account. Model-Driven Design (MDD) has proven to be a powerful System Engineering methodology able to cope with the complexity of services built as a system of CPSs (CPSoS). In this paper, a methodology is proposed to seamlessly integrate robots into a MDD framework so that the whole service can be simulated and its performance, analyzed. Although the methodology is valid for robots in general, it has been assessed on a drone-based service.This work has been partially funded by the EU and the Spanish MICINN through the ECSEL Comp4Drones project and the TEC2017-86722-C4-3-R PLATINO project respectively

The MRS UAV System: Pushing the Frontiers of Reproducible Research, Real-world Deployment, and Education with Autonomous Unmanned Aerial Vehicles

We present a multirotor Unmanned Aerial Vehicle control (UAV) and estimation system for supporting replicable research through realistic simulations and real-world experiments. We propose a unique multi-frame localization paradigm for estimating the states of a UAV in various frames of reference using multiple sensors simultaneously. The system enables complex missions in GNSS and GNSS-denied environments, including outdoor-indoor transitions and the execution of redundant estimators for backing up unreliable localization sources. Two feedback control designs are presented: one for precise and aggressive maneuvers, and the other for stable and smooth flight with a noisy state estimate. The proposed control and estimation pipeline are constructed without using the Euler/Tait-Bryan angle representation of orientation in 3D. Instead, we rely on rotation matrices and a novel heading-based convention to represent the one free rotational degree-of-freedom in 3D of a standard multirotor helicopter. We provide an actively maintained and well-documented open-source implementation, including realistic simulation of UAV, sensors, and localization systems. The proposed system is the product of years of applied research on multi-robot systems, aerial swarms, aerial manipulation, motion planning, and remote sensing. All our results have been supported by real-world system deployment that shaped the system into the form presented here. In addition, the system was utilized during the participation of our team from the CTU in Prague in the prestigious MBZIRC 2017 and 2020 robotics competitions, and also in the DARPA SubT challenge. Each time, our team was able to secure top places among the best competitors from all over the world. On each occasion, the challenges has motivated the team to improve the system and to gain a great amount of high-quality experience within tight deadlines.Comment: 28 pages, 20 figures, submitted to Journal of Intelligent & Robotic Systems (JINT), for the provided open-source software see http://github.com/ctu-mr

Autonomous High-Precision Landing on a Unmanned Surface Vehicle

THE MAIN GOAL OF THIS THESIS IS THE DEVELOPMENT OF AN AUTONOMOUS HIGH-PRECISION LANDING SYSTEM OF AN UAV IN AN AUTONOMOUS BOATIn this dissertation, a collaborative method for Multi Rotor Vertical Takeoff and Landing (MR-VTOL) Unmanned Aerial Vehicle (UAV)s’ autonomous landing is presented. The majority of common UAV autonomous landing systems adopt an approach in which the UAV scans the landing zone for a predetermined pattern, establishes relative positions, and uses those positions to execute the landing. These techniques have some shortcomings, such as extensive processing being carried out by the UAV itself and requires a lot of computational power. The fact that most of these techniques only work while the UAV is already flying at a low altitude, since the pattern’s elements must be plainly visible to the UAV’s camera, creates an additional issue. An RGB camera that is positioned in the landing zone and pointed up at the sky is the foundation of the methodology described throughout this dissertation. Convolutional Neural Networks and Inverse Kinematics approaches can be used to isolate and analyse the distinctive motion patterns the UAV presents because the sky is a very static and homogeneous environment. Following realtime visual analysis, a terrestrial or maritime robotic system can transmit orders to the UAV. The ultimate result is a model-free technique, or one that is not based on established patterns, that can help the UAV perform its landing manoeuvre. The method is trustworthy enough to be used independently or in conjunction with more established techniques to create a system that is more robust. The object detection neural network approach was able to detect the UAV in 91,57% of the assessed frames with a tracking error under 8%, according to experimental simulation findings derived from a dataset comprising three different films. Also created was a high-level position relative control system that makes use of the idea of an approach zone to the helipad. Every potential three-dimensional point within the zone corresponds to a UAV velocity command with a certain orientation and magnitude. The control system worked flawlessly to conduct the UAV’s landing within 6 cm of the target during testing in a simulated setting.Nesta dissertação, é apresentado um método de colaboração para a aterragem autónoma de Unmanned Aerial Vehicle (UAV)Multi Rotor Vertical Takeoff and Landing (MR-VTOL). A maioria dos sistemas de aterragem autónoma de UAV comuns adopta uma abordagem em que o UAV varre a zona de aterragem em busca de um padrão pré-determinado, estabelece posições relativas, e utiliza essas posições para executar a aterragem. Estas técnicas têm algumas deficiências, tais como o processamento extensivo a ser efectuado pelo próprio UAV e requer muita potência computacional. O facto de a maioria destas técnicas só funcionar enquanto o UAV já está a voar a baixa altitude, uma vez que os elementos do padrão devem ser claramente visíveis para a câmara do UAV, cria um problema adicional. Uma câmara RGB posicionada na zona de aterragem e apontada para o céu é a base da metodologia descrita ao longo desta dissertação. As Redes Neurais Convolucionais e as abordagens da Cinemática Inversa podem ser utilizadas para isolar e analisar os padrões de movimento distintos que o UAV apresenta, porque o céu é um ambiente muito estático e homogéneo. Após análise visual em tempo real, um sistema robótico terrestre ou marítimo pode transmitir ordens para o UAV. O resultado final é uma técnica sem modelo, ou que não se baseia em padrões estabelecidos, que pode ajudar o UAV a realizar a sua manobra de aterragem. O método é suficientemente fiável para ser utilizado independentemente ou em conjunto com técnicas mais estabelecidas para criar um sistema que seja mais robusto. A abordagem da rede neural de detecção de objectos foi capaz de detectar o UAV em 91,57% dos fotogramas avaliados com um erro de rastreio inferior a 8%, de acordo com resultados de simulação experimental derivados de um conjunto de dados composto por três filmes diferentes. Também foi criado um sistema de controlo relativo de posição de alto nível que faz uso da ideia de uma zona de aproximação ao heliporto. Cada ponto tridimensional potencial dentro da zona corresponde a um comando de velocidade do UAV com uma certa orientação e magnitude. O sistema de controlo funcionou sem falhas para conduzir a aterragem do UAV dentro de 6 cm do alvo durante os testes num cenário simulado. Traduzido com a versão gratuita do tradutor - www.DeepL.com/Translato

Distributed Control for Collective Behaviour in Micro-unmanned Aerial Vehicles

Full version unavailable due to 3rd party copyright restrictions.The work presented herein focuses on the design of distributed autonomous controllers for collective behaviour of Micro-unmanned Aerial Vehicles (MAVs). Two alternative approaches to this topic are introduced: one based upon the Evolutionary Robotics (ER) paradigm, the other one upon flocking principles. Three computer simulators have been developed in order to carry out the required experiments, all of them having their focus on the modelling of fixed-wing aircraft flight dynamics. The employment of fixed-wing aircraft rather than the omni-directional robots typically employed in collective robotics significantly increases the complexity of the challenges that an autonomous controller has to face. This is mostly due to the strict motion constraints associated with fixed-wing platforms, that require a high degree of accuracy by the controller. Concerning the ER approach, the experimental setups elaborated have resulted in controllers that have been evolved in simulation with the following capabilities: (1) navigation across unknown environments, (2) obstacle avoidance, (3) tracking of a moving target, and (4) execution of cooperative and coordinated behaviours based on implicit communication strategies. The design methodology based upon flocking principles has involved tests on computer simulations and subsequent experimentation on real-world robotic platforms. A customised implementation of Reynolds’ flocking algorithm has been developed and successfully validated through flight tests performed with the swinglet MAV. It has been notably demonstrated how the Evolutionary Robotics approach could be successfully extended to the domain of fixed-wing aerial robotics, which has never received a great deal of attention in the past. The investigations performed have also shown that complex and real physics-based computer simulators are not a compulsory requirement when approaching the domain of aerial robotics, as long as proper autopilot systems (taking care of the ”reality gap” issue) are used on the real robots.EOARD (European Office of Aerospace Research & Development), euCognitio

Identification of a quadcopter autopilot system via Box–Jenkins structure

This paper presents a method to precisely model a four rotor unmanned aerial vehicle, widely known as quadcopter autopilot system. Common system identification methods limit quadcopter models into first or second order systems, and do not count for noise characteristics. This leads to poor prediction accuracy of its longitudinal and lateral motion dynamics that ultimately affects the aircraft stabilization during flight and landing. To improve the quality of the estimated models, we utilized a statistically suitable discrete-time linear Box–Jenkins structure to model the plant and noise characteristics of the horizontal subsystems of a quadcopter autopilot system. The models were estimated using flight data acquired when the system were provided with pseudo-random binary sequence input. In this proposed method, by employing the prediction error method and least squares approach, the aircraft dynamics could be modeled up until the fifth order. The normalized root mean square fitness value showed that the predicted model output matches the experimental flight data by 94.72% in the one-step-ahead prediction test, and 84.52% in the infinite-step-ahead prediction test. These prediction results demonstrated an improvement of 52.8% when compared with a first and second order model structures proposed in previous works for the same quadcopter model. The output from this research works confirmed the effectiveness of the proposed method to adequately capture the autopilot dynamics and accurately predict the quadcopter outputs. These would greatly assist in designing robust flight controllers for the autopilot system

Flight coordination solutions for multirotor unmanned aerial vehicles

[EN] As the popularity and the number of Unmanned Aerial Vehicles (UAVs) increases, new protocols are needed to coordinate them when flying without direct human control, and to avoid that these UAVs collide with each other. Testing such novel protocols on real UAVs is a complex procedure that requires investing much time, money and research efforts. Hence, it becomes necessary to first test the developed solutions using simulation. Unfortunately, existing tools present significant limitations: some of them only simulate accurately the flight behavior of a single UAV, while some other simulators can manage several UAVs simultaneously, but not in real time, thus losing accuracy regarding the mobility pattern of the UAV. In this work we address such problem by introducing Arducopter Simulator (ArduSim), a novel simulation platform that allows controlling in soft real-time the flight and communications of multiple UAVs, being the developed protocols directly portable to real devices. Moreover, ArduSim includes a realistic model for the WiFi communications link between UAVs, which was proposed based on real experiments. The chances that two UAVs get close to each other during their flights is increasing as more and more of them populate our skies, causing concerns regarding potential collisions. Therefore, this thesis also proposes the Mission Based Collision Avoidance Protocol (MBCAP), a novel UAV collision avoidance protocol applicable to all types of multicopters flying autonomously. It relies on wireless communications in order to detect nearby UAVs, and to negotiate the procedure to avoid any potential collision. Experimental and simulation results demonstrate the validity and effectiveness of the proposed solution, which typically introduces a small overhead in the range of 15 to 42 seconds for each risky situation successfully handled. The previous solution aims at UAVs performing independent flights, but they can also form a swarm, where more constraints have to be met to avoid collisions among them, and to allow them to complete their task efficiently. Deploying an UAV swarm instead of a single UAV can provide additional benefits when, for example, cargo carrying requirements exceed the lifting power of a single UAV, or when the deployment of several UAVs simultaneously can accelerate the accomplishment of the mission, and broaden the covered area. To this aim, in this work we present the Mission-based UAV Swarm Coordination Protocol (MUSCOP), a solution that allows multiple UAVs to perfectly coordinate their flight when performing planned missions. Experimental results show that the proposed protocol is able to achieve a high degree of swarm cohesion independently of the flight formation adopted, and even in the presence of very lossy channels, achieving minimal synchronization delays and very low position offsets with regard to the ideal case. Currently, there are some other scenarios, such as search and rescue operations, where the deployment of manually guided swarms of UAVs can be necessary. In such cases, the pilot's commands are unknown a priori (unpredictable), meaning that the UAVs must respond in near real-time to the movements of the leader UAV in order to maintain swarm consistency. Hence, in this thesis we also propose the FollowMe protocol for the coordination of UAVs in a swarm where the swarm leader is controlled by a real pilot, and the other UAVs must follow it in real-time to maintain swarm cohesion. Simulation results show the validity of the proposed swarm coordination protocol, detailing the responsiveness limits of our solution, and finding the minimum distances between UAVs to avoid collisions.[ES] A medida que la popularidad de los Vehículos Aéreos No Tripulados (VANTs) se incrementa, también se hacen necesarios nuevos protocolos para coordinarlos en vuelos sin control humano directo, y para evitar que colisionen entre sí. Probar estos nuevos protocolos en VANTs reales es un proceso complejo que requiere invertir mucho tiempo, dinero y esfuerzo investigador. Por lo tanto, es necesario probar en simulación las soluciones previamente implementadas. Lamentablemente, las herramientas actuales tienen importantes limitaciones: algunas simulan con precisión el vuelo de un único VANT, mientras que otros simuladores pueden gestionar varios VANTs simultáneamente aunque no en tiempo real, perdiendo por lo tanto precisión en el patrón de movilidad del VANT. En este trabajo abordamos este problema introduciendo Arducopter Simulator (ArduSim), una nueva plataforma de simulación que permite controlar en tiempo real el vuelo y la comunicación entre múltiples VANTs, permitiendo llevar los protocolos desarrollados a dispositivos reales con facilidad. Además, ArduSim incluye un modelo realista de un enlace de comunicaciones WiFi entre VANTs, el cual está basado en el resultado obtenido de experimentos con VANTs reales. La posibilidad de que dos VANTs se aproximen entre sí durante el vuelo se incrementa a medida que hay más aeronaves de este tipo surcando los cielos, introduciendo peligro por posibles colisiones. Por ello, esta tesis propone Mission Based Collision Avoidance Protocol (MBCAP), un nuevo protocolo de evitación de colisiones para VANTs aplicable a todo tipo de multicópteros mientras vuelan autónomamente. MBCAP utiliza comunicaciones inalámbricas para detectar VANTs cercanos y para negociar el proceso de evitación de la colisión. Los resultados de simulaciones y experimentos reales demuestran la validez y efectividad de la solución propuesta, que introduce un pequeño aumento del tiempo de vuelo de entre 15 y 42 segundos por cada situación de riesgo correctamente resuelta. La solución anterior está orientada a VANTs que realizan vuelos independientes, pero también pueden formar un enjambre, donde hay que cumplir más restricciones para evitar que colisionen entre sí, y para que completen la tarea de forma eficiente. Desplegar un enjambre de VANTs en vez de uno solo proporciona beneficios adicionales cuando, por ejemplo, la necesidad de carga excede la capacidad de elevación de un único VANT, o cuando al desplegar varios VANTs simultáneamente se acelera la misión y se cubre un área mayor. Con esta finalidad, en este trabajo presentamos el protocolo Mission-based UAV Swarm Coordination Protocol (MUSCOP), una solución que permite a varios VANTs coordinar perfectamente el vuelo mientras realizan misiones planificadas. Los resultados experimentales muestran que el protocolo propuesto permite al enjambre alcanzar un grado de cohesión elevado independientemente de la formación de vuelo adoptada, e incluso en presencia de un canal de comunicación con muchas pérdidas, consiguiendo retardos en la sincronización insignificantes y desfases mínimos en la posición con respecto al caso ideal. Actualmente hay otros escenarios, como las operaciones de búsqueda y rescate, donde el despliegue de enjambres de VANTs guiados manualmente puede ser necesario. En estos casos, las órdenes del piloto son desconocidas a priori (impredecibles), lo que significa que los VANTs deben responder prácticamente en tiempo real a los movimientos del VANT líder para mantener la consistencia del enjambre. Por ello, en esta tesis proponemos el protocolo FollowMe para la coordinación de VANTs en un enjambre donde el líder es controlado por un piloto, y el resto de VANTs lo siguen en tiempo real para mantener la cohesión del enjambre. Las simulaciones muestran la validez del protocolo de coordinación de enjambres propuesto, detallando los límites de la solución, y definiendo la distancia mínima entre VANTs para evita[CA] A mesura que la popularitat dels Vehicles Aeris No Tripulats (VANTs) s'incrementa, també es fan necessaris nous protocols per a coordinar-los en vols sense control humà directe, i per a evitar que col·lisionen entre si. Provar aquests nous protocols en VANTs reals és un procés complex que requereix invertir molt de temps, diners i esforç investigador. Per tant, és necessari provar en simulació les solucions prèviament implementades. Lamentablement, les eines actuals tenen importants limitacions: algunes simulen amb precisió el vol d'un únic VANT, mentre que altres simuladors poden gestionar diversos VANTs simultàniament encara que no en temps real, perdent per tant precisió en el patró de mobilitat del VANT. En aquest treball abordem aquest problema introduint Arducopter Simulator (ArduSim), una nova plataforma de simulació que permet controlar en temps real el vol i la comunicació entre múltiples VANTs, permetent portar els protocols desenvolupats a dispositius reals amb facilitat. A més, ArduSim inclou un model realista d'un enllaç de comunicacions WiFi entre VANTs, que està basat en el resultat obtingut d'experiments amb VANTs reals. La possibilitat que dues VANTs s'aproximen entre si durant el vol s'incrementa a mesura que hi ha més aeronaus d'aquest tipus solcant els cels, introduint perill per possibles col·lisions. Per això, aquesta tesi proposa Mission Based Collision Avoidance Protocol (MBCAP), un nou protocol d'evitació de col·lisions per a VANTs aplicable a tota mena de multicòpters mentre volen autònomament. MBCAP utilitza comunicacions sense fils per a detectar VANTs pròxims i per a negociar el procés d'evitació de la col·lisió. Els resultats de simulacions i experiments reals demostren la validesa i efectivitat de la solució proposada, que introdueix un xicotet augment del temps de vol de entre 15 i 42 segons per cada situació de risc correctament resolta. La solució anterior està orientada a VANTs que realitzen vols independents, però també poden formar un eixam, on cal complir més restriccions per a evitar que col·lisionen entre si, i perquè completen la tasca de forma eficient. Desplegar un eixam de VANTs en comptes d'un només proporciona beneficis addicionals quan, per exemple, la necessitat de càrrega excedeix la capacitat d'elevació d'un únic VANT, o quan en desplegar diversos VANTs simultàniament s'accelera la missió i es cobreix una àrea major. Amb aquesta finalitat, en aquest treball presentem el protocol Mission-based UAV Swarm Coordination Protocol (MUSCOP), una solució que permet a diversos VANTs coordinar perfectament el vol mentre realitzen missions planificades. Els resultats experimentals mostren que el protocol proposat permet a l'eixam aconseguir un grau de cohesió elevat independentment de la formació de vol adoptada, i fins i tot en presència d'un canal de comunicació amb moltes pèrdues, aconseguint retards en la sincronització insignificants i desfasaments mínims en la posició respecte al cas ideal. Actualment hi ha altres escenaris, com les operacions de cerca i rescat, on el desplegament d'eixams de VANTs guiats manualment pot ser necessari. En aquests casos, les ordres del pilot són desconegudes a priori (impredictibles), el que significa que els VANTs han de respondre pràcticament en temps real als moviments del VANT líder per a mantindre la consistència de l'eixam. Per això, en aquesta tesi proposem el protocol FollowMe per a la coordinació de VANTs en un eixam on el líder és controlat per un pilot, i la resta de VANTs ho segueixen en temps real per a mantindre la cohesió de l'eixam. Les simulacions mostren la validesa del protocol de coordinació d'eixams proposat, detallant els límits de la solució, i definint la distància mínima entre VANTs per a evitar col·lisions.Fabra Collado, FJ. (2020). Flight coordination solutions for multirotor unmanned aerial vehicles [Tesis doctoral no publicada]. Universitat Politècnica de València. https://doi.org/10.4995/Thesis/10251/147857TESI