Extended Kalman Filter Based Modelled Predictor for Fusion of Accelerometer and Camera Signal to Estimate the Vibration of a Mobile Flexible Link Manipulator

This paper presents the fusion of accelerometer and camera for active vibration prediction for a mobile flexible link manipulator based on Extended Kalman filter-based modelled predictor. The tip position of the manipulator is unpredictable due to the singularity of the mobile flexible manipulator, as well as the phase lag in the control system due to the time delay between the sensor feedback and the control input. The purpose is thus to improve the prediction accuracy of the tip position. The time delayed in camera data estimates is used to correct the drifting accelerometer’s signal. The dynamic model of the mobile flexible link manipulator is derived and is used to feed to the prediction stage of the Extended Kalman filter, which is used for vibration prediction. In order to investigate the efficiency of the proposed method, simulation and experimental studies are performed considering a single link flexible manipulator on a wheeled base. Experimental verifications showed that the proposed method produced good vibration prediction of the mobile manipulator compared to other model based predictor

Slide-Down Prevention for Wheeled Mobile Robots on Slopes

Wheeled mobile robots on inclined terrain can slide down due to loss of traction and gravity. This type of instability, which is different from tip-over, can provoke uncontrolled motion or get the vehicle stuck. This paper proposes slide-down prevention by real-time computation of a straightforward stability margin for a given ground-wheel friction coefficient. This margin is applied to the case study of Lazaro, a hybrid skid-steer mobile robot with caster-leg mechanism that allows tests with four or five wheel contact points. Experimental results for both ADAMS simulations and the actual vehicle demonstrate the effectiveness of the proposed approach.Universidad de Málaga. Campus de Excelencia Internacional Andalucía Tech

Optimization-based methods for real-time generation of safe motions in mobile robots

Having robots operating in unstructured and dynamically changing environments is a challenging task that requires advanced motion generation approaches that are able to perform in real-time while maintaining the robot and environment safety. The progress in the field of numerical optimization, as well as the development of tailored algorithms, made Nonlinear Model Predictive Control (NMPC) an appealing candidate for real-time motion generation. By considering the robot model as prediction model and through appropriate constraints on the robot states and control inputs, NMPC can enforce safety to the resulting motion in a straightforward way. This thesis addresses the problem of real-time generation of safe motions for mobile robots and mobile manipulators. The different structure of the considered robots introduces different safety risks during the robot motion and so the motion generation problem for each robot is addressed in separate parts of this thesis. In the first part, the problem of motion generation for mobile robots navigating in environments populated by static and/or moving obstacles is considered. For the generation of the desired motion, real-time NMPC is used. We argue that, in order to tackle the risk of collision with the environment, traditional distance-based approaches are incapable of maintaining the robot safety when the NMPC uses relatively short prediction horizons. Instead, we propose two NMPC approaches that employ two alternative collision avoidance constraints. The first proposed NMPC approach is applied to a scenario of safe robot navigation in a human crowd. The NMPC serves as a motion generation module in a safe motion generation framework, complete with a crowd prediction module. The considered collision avoidance constraint is built upon an appropriate Control Barrier Function (CBF). The second NMPC approach is applied to a scenario of robot navigation among moving obstacles, where the dynamics of the considered robot are significant. The proposed collision avoidance constraint is built upon the notion of avoidable collision state, which considers not only the robot-obstacle distance but also their velocity as well as the robot actuation capabilities. The simulation results indicate that both methods are effective and able to maintain the robot safety even in cases where their purely distance-based counterparts fail. The second part of the thesis addresses the problem of safe motion generation for mobile manipulators, called to execute tasks that may require aggressive motions. Here, in addition to the risk of collision with its environment, the robot, consisting of multiple articulated bodies, is also susceptible to self-collisions. Moreover, fast motions can always result to loss of balance. To solve the problem, we propose a real-time NMPC scheme that uses the robot full dynamics, in order to enforce kinodynamic feasibility, while it also considers appropriate collision and self-collision avoidance constraints. To maintain the robot balance we enforce a constraint that restricts the feasible set of robot motions to those generating non-negative moments around the edges of the support polygon. This balance constraint, inherently nonlinear, is linearized using the NMPC solution of the previous iteration. In this way, we facilitate the solution of the NMPC in real-time, without compromising the robot safety. Although the proposed NMPC is effective when applied to MM with low degrees of freedom, when the robot becomes more complex the use of its full dynamic model as a prediction model in an NMPC can lead to unacceptably large computational times that are not compatible with the real-time requirement. However, the use of a simplified model of the robot in an NMPC can compromise the robot safety. For this reason, we propose an optimization-based controller equipped with balance constraints as well as CBF-based collision avoidance constraints. The proposed controller can serve as an intermediate between a motion generation module that does not consider the robot full dynamics and the robot itself in order to ensure that the resulting motion will be at least safe. Simulation results indicate the effectiveness of the proposed method

Reset-free Trial-and-Error Learning for Robot Damage Recovery

The high probability of hardware failures prevents many advanced robots (e.g., legged robots) from being confidently deployed in real-world situations (e.g., post-disaster rescue). Instead of attempting to diagnose the failures, robots could adapt by trial-and-error in order to be able to complete their tasks. In this situation, damage recovery can be seen as a Reinforcement Learning (RL) problem. However, the best RL algorithms for robotics require the robot and the environment to be reset to an initial state after each episode, that is, the robot is not learning autonomously. In addition, most of the RL methods for robotics do not scale well with complex robots (e.g., walking robots) and either cannot be used at all or take too long to converge to a solution (e.g., hours of learning). In this paper, we introduce a novel learning algorithm called "Reset-free Trial-and-Error" (RTE) that (1) breaks the complexity by pre-generating hundreds of possible behaviors with a dynamics simulator of the intact robot, and (2) allows complex robots to quickly recover from damage while completing their tasks and taking the environment into account. We evaluate our algorithm on a simulated wheeled robot, a simulated six-legged robot, and a real six-legged walking robot that are damaged in several ways (e.g., a missing leg, a shortened leg, faulty motor, etc.) and whose objective is to reach a sequence of targets in an arena. Our experiments show that the robots can recover most of their locomotion abilities in an environment with obstacles, and without any human intervention.Comment: 18 pages, 16 figures, 3 tables, 6 pseudocodes/algorithms, video at https://youtu.be/IqtyHFrb3BU, code at https://github.com/resibots/chatzilygeroudis_2018_rt

A novel control architecture based on behavior trees for an omni-directional mobile robot

Robotic systems are increasingly present in dynamic environments. This paper proposes a hierarchical control structure wherein a behavior tree (BT) is used to improve the flexibility and adaptability of an omni-directional mobile robot for point stabilization. Flexibility and adaptability are crucial at each level of the sense–plan–act loop to implement robust and effective robotic solutions in dynamic environments. The proposed BT combines high-level decision making and continuous execution monitoring while applying non-linear model predictive control (NMPC) for the point stabilization of an omni-directional mobile robot. The proposed control architecture can guide the mobile robot to any configuration within the workspace while satisfying state constraints (e.g., obstacle avoidance) and input constraints (e.g., motor limits). The effectiveness of the controller was validated through a set of realistic simulation scenarios and experiments in a real environment, where an industrial omni-directional mobile robot performed a point stabilization task with obstacle avoidance in a workspace.This work was financed by national funds from the FCT (Foundation for Science and Technology), I.P., through IDMEC under LAETA, project UIDB\50022\2020. The work of Rodrigo Bernardo was supported by the PhD Scholarship BD\6841\2020 from the FCT. This work indirectly received funding from the European Union’s Horizon 2020 programme under StandICT.eu 2026 (Grant Agreement No. 101091933).info:eu-repo/semantics/publishedVersio

MULTI-RATE VISUAL FEEDBACK ROBOT CONTROL

[EN] This thesis deals with two characteristic problems in visual feedback robot control: 1) sensor latency; 2) providing suitable trajectories for the robot and for the measurement in the image. All the approaches presented in this work are analyzed and implemented on a 6 DOF industrial robot manipulator or/and a wheeled robot. Focusing on the sensor latency problem, this thesis proposes the use of dual-rate high order holds within the control loop of robots. In this sense, the main contributions are: - Dual-rate high order holds based on primitive functions for robot control (Chapter 3): analysis of the system performance with and without the use of this multi-rate technique from non-conventional control. In addition, as consequence of the use of dual-rate holds, this work obtains and validates multi-rate controllers, especially dual-rate PIDs. - Asynchronous dual-rate high order holds based on primitive functions with time delay compensation (Chapter 3): generalization of asynchronous dual-rate high order holds incorporating an input signal time delay compensation component, improving thus the inter-sampling estimations computed by the hold. It is provided an analysis of the properties of such dual-rate holds with time delay compensation, comparing them with estimations obtained by the equivalent dual-rate holds without this compensation, as well as their implementation and validation within the control loop of a 6 DOF industrial robot manipulator. - Multi-rate nonlinear high order holds (Chapter 4): generalization of the concept of dual-rate high order holds with nonlinear estimation models, which include information about the plant to be controlled, the controller(s) and sensor(s) used, obtained from machine learning techniques. Thus, in order to obtain such a nonlinear hold, it is described a methodology non dependent of the machine technique used, although validated using artificial neural networks. Finally, an analysis of the properties of these new holds is carried out, comparing them with their equivalents based on primitive functions, as well as their implementation and validation within the control loop of an industrial robot manipulator and a wheeled robot. With respect to the problem of providing suitable trajectories for the robot and for the measurement in the image, this thesis presents the novel reference features filtering control strategy and its generalization from a multi-rate point of view. The main contributions in this regard are: - Reference features filtering control strategy (Chapter 5): a new control strategy is proposed to enlarge significantly the solution task reachability of robot visual feedback control. The main idea is to use optimal trajectories proposed by a non-linear EKF predictor-smoother (ERTS), based on Rauch-Tung-Striebel (RTS) algorithm, as new feature references for an underlying visual feedback controller. In this work it is provided both the description of the implementation algorithm and its implementation and validation utilizing an industrial robot manipulator. - Dual-rate Reference features filtering control strategy (Chapter 5): a generalization of the reference features filtering approach from a multi-rate point of view, and a dual Kalman-smoother step based on the relation of the sensor and controller frequencies of the reference filtering control strategy is provided, reducing the computational cost of the former algorithm, as well as addressing the problem of the sensor latency. The implementation algorithms, as well as its analysis, are described.[ES] La presente tesis propone soluciones para dos problemas característicos de los sistemas robóticos cuyo bucle de control se cierra únicamente empleando sensores de visión artificial: 1) la latencia del sensor; 2) la obtención de trayectorias factibles tanto para el robot así como para las medidas obtenidas en la imagen. Todos los métodos propuestos en este trabajo son analizados, validados e implementados utilizando brazo robot industrial de 6 grados de libertad y/o en un robot con ruedas. Atendiendo al problema de la latencia del sensor, esta tesis propone el uso de retenedores bi-frequencia de orden alto dentro de los lazos de control de robots. En este aspecto las principales contribuciones son: -Retenedores bi-frecuencia de orden alto basados en funciones primitivas dentro de lazos de control de robots (Capítulo 3): análisis del comportamiento del sistema con y sin el uso de esta técnica de control no convencional. Además, como consecuencia del empleo de los retenedores, obtención y validación de controladores multi-frequencia, concretamente de PIDs bi-frecuencia. -Retenedores bi-frecuencia asíncronos de orden alto basados en funciones primitivas con compensación de retardos (Capítulo 3): generalización de los retenedores bi-frecuencia asíncronos de orden alto incluyendo una componente de compensación del retardo en la señal de entrada, mejorando así las estimaciones inter-muestreo calculadas por el retenedor. Se proporciona un análisis de las propiedades de los retenedores con compensación del retardo, comparándolas con las obtenidas por sus predecesores sin compensación, así como su implementación y validación en un brazo robot de 6 grados de libertad. -Retenedores multi-frecuencia no lineales de orden alto (Capítulo 4): generalización del concepto de retenedor bi-frecuencia de orden alto con modelos de estimación no lineales, los cuales incluyen información tanto de la planta a controlar, como del controlador(es) y sensor(es) empleado(s), obtenida a partir de técnicas de aprendizaje. Así pues, para obtener dicho retenedor no lineal, se describe una metodología independiente de la herramienta de aprendizaje utilizada, aunque validada con el uso de redes neuronales artificiales. Finalmente se realiza un análisis de las propiedades de estos nuevos retenedores, comparándolos con sus predecesores basados en funciones primitivas, así como su implementación y validación en un brazo robot de 6 grados de libertad y en un robot móvil con ruedas. Por lo que respecta al problema de generación de trayectorias factibles para el robot y para la medida en la imagen, esta tesis propone la nueva estrategia de control basada en el filtrado de la referencia y su generalización desde el punto de vista multi-frecuencial. -Estrategia de control basada en el filtrado de la referencia (Capítulo 5): una nueva estrategia de control se propone para ampliar significativamente el espacio de soluciones de los sistemas robóticos realimentados con sensores de visión artificial. La principal idea es utilizar las trayectorias óptimas obtenidas por una trayectoria predicha por un filtro de Kalman seguido de un suavizado basado en el algoritmo Rauch-Tung-Striebel (RTS) como nuevas referencias para un controlador dado. En este trabajo se proporciona tanto la descripción del algoritmo como su implementación y validación empleando un brazo robótico industrial. -Estrategia de control bi-frecuencia basada en el filtrado de la referencia (Capítulo 5): generalización de la estrategia de control basada en filtrado de la referencia desde un punto de vista multi-frecuencial, con un filtro de Kalman multi-frecuencia y un Kalman-smoother dual basado en la relación existente entre las frecuencias del sensor y del controlador, reduciendo así el coste computacional del algoritmo y, al mismo tiempo, dando solución al problema de la latencia del sensor. La validación se realiza utilizando un barzo robot industria asi[CA] La present tesis proposa solucions per a dos problemes característics dels sistemes robòtics el els que el bucle de control es tanca únicament utilitzant sensors de visió artificial: 1) la latència del sensor; 2) l'obtenció de trajectòries factibles tant per al robot com per les mesures en la imatge. Tots els mètodes proposats en aquest treball son analitzats, validats e implementats utilitzant un braç robot industrial de 6 graus de llibertat i/o un robot amb rodes. Atenent al problema de la latència del sensor, esta tesis proposa l'ús de retenidors bi-freqüència d'ordre alt a dins del llaços de control de robots. Al respecte, les principals contribucions son: - Retenidors bi-freqüència d'ordre alt basats en funcions primitives a dintre dels llaços de control de robots (Capítol 3): anàlisis del comportament del sistema amb i sense l'ús d'aquesta tècnica de control no convencional. A més a més, com a conseqüència de l'ús dels retenidors, obtenció i validació de controladors multi-freqüència, concretament de PIDs bi-freqüència. - Retenidors bi-freqüència asíncrons d'ordre alt basats en funcions primitives amb compensació de retards (Capítol 3): generalització dels retenidors bi-freqüència asíncrons d'ordre alt inclouen una component de compensació del retràs en la senyal d'entrada al retenidor, millorant així les estimacions inter-mostreig calculades per el retenidor. Es proporciona un anàlisis de les propietats dels retenidors amb compensació del retràs, comparant-les amb les obtingudes per el seus predecessors sense la compensació, així com la seua implementació i validació en un braç robot industrial de 6 graus de llibertat. - Retenidors multi-freqüència no-lineals d'ordre alt (Capítol 4): generalització del concepte de retenidor bi-freqüència d'ordre alt amb models d'estimació no lineals, incloent informació tant de la planta a controlar, com del controlador(s) i sensor(s) utilitzat(s), obtenint-la a partir de tècniques d'aprenentatge. Així doncs, per obtindre el retenidor no lineal, es descriu una metodologia independent de la ferramenta d'aprenentatge utilitzada, però validada amb l'ús de rets neuronals artificials. Finalment es realitza un anàlisis de les propietats d'aquestos nous retenidors, comparant-los amb els seus predecessors basats amb funcions primitives, així com la seua implementació i validació amb un braç robot de 6 graus de llibertat i amb un robot mòbil de rodes. Per el que respecta al problema de generació de trajectòries factibles per al robot i per la mesura en la imatge, aquesta tesis proposa la nova estratègia de control basada amb el filtrat de la referència i la seua generalització des de el punt de vista multi-freqüència. - Estratègia de control basada amb el filtrat de la referència (Capítol 5): una nova estratègia de control es proposada per ampliar significativament l'espai de solucions dels sistemes robòtics realimentats amb sensors de visió artificial. La principal idea es la d'utilitzar les trajectòries optimes obtingudes per una trajectòria predita per un filtre de Kalman seguit d'un suavitzat basat en l'algoritme Rauch-Tung-Striebel (RTS) com noves referències per a un control donat. En aquest treball es proporciona tant la descripció del algoritme així com la seua implementació i validació utilitzant un braç robòtic industrial de 6 graus de llibertat. - Estratègia de control bi-freqüència basada en el filtrat (Capítol 5): generalització de l'estratègia de control basada am filtrat de la referència des de un punt de vista multi freqüència, amb un filtre de Kalman multi freqüència i un Kalman-Smoother dual basat amb la relació existent entre les freqüències del sensor i del controlador, reduint així el cost computacional de l'algoritme i, al mateix temps, donant solució al problema de la latència del sensor. L'algoritme d'implementació d'aquesta tècnica, així com la seua validaciSolanes Galbis, JE. (2015). MULTI-RATE VISUAL FEEDBACK ROBOT CONTROL [Tesis doctoral no publicada]. Universitat Politècnica de València. https://doi.org/10.4995/Thesis/10251/57951TESI