Gaussian Processes for Machine Learning in Robotics

Mención Internacional en el título de doctorNowadays, machine learning is widely used in robotics for a variety of tasks such as perception, control, planning, and decision making. Machine learning involves learning, reasoning, and acting based on the data. This is achieved by constructing computer programs that process the data, extract useful information or features, make predictions to infer unknown properties, and suggest actions to take or decisions to make. This computer program corresponds to a mathematical model of the data that describes the relationship between the variables that represent the observed data and properties of interest. The aforementioned model is learned based on the available training data, which is accomplished using a learning algorithm capable of automatically adjusting the parameters of the model to agree with the data. Therefore, the architecture of the model needs to be selected accordingly, which is not a trivial task and usually depends on the machine-learning engineer’s insights and past experience. The number of parameters to be tuned varies significantly with the selected machine learning model, ranging from two or three parameters for Gaussian processes (GP) to hundreds of thousands for artificial neural networks. However, as more complex and novel robotic applications emerge, data complexity increases and prior experience may be insufficient to define adequate mathematical models. In addition, traditional machine learning methods are prone to problems such as overfitting, which can lead to inaccurate predictions and catastrophic failures in critical applications. These methods provide probabilistic distributions as model outputs, allowing for estimating the uncertainty associated with predictions and making more informed decisions. That is, they provide a mean and variance for the model responses. This thesis focuses on the application of machine learning solutions based on Gaussian processes to various problems in robotics, with the aim of improving current methods and providing a new perspective. Key areas such as trajectory planning for unmanned aerial vehicles (UAVs), motion planning for robotic manipulators and model identification of nonlinear systems are addressed. In the field of path planning for UAVs, algorithms based on Gaussian processes that allow for more efficient planning and energy savings in exploration missions have been developed. These algorithms are compared with traditional analytical approaches, demonstrating their superiority in terms of efficiency when using machine learning. Area coverage and linear coverage algorithms with UAV formations are presented, as well as a sea surface search algorithm. Finally, these algorithms are compared with a new method that uses Gaussian processes to perform probabilistic predictions and optimise trajectory planning, resulting in improved performance and reduced energy consumption. Regarding motion planning for robotic manipulators, an approach based on Gaussian process models that provides a significant reduction in computational times is proposed. A Gaussian process model is used to approximate the configuration space of a robot, which provides valuable information to avoid collisions and improve safety in dynamic environments. This approach is compared to conventional collision checking methods and its effectiveness in terms of computational time and accuracy is demonstrated. In this application, the variance provides information about dangerous zones for the manipulator. In terms of creating models of non-linear systems, Gaussian processes also offer significant advantages. This approach is applied to a soft robotic arm system and UAV energy consumption models, where experimental data is used to train Gaussian process models that capture the relationships between system inputs and outputs. The results show accurate identification of system parameters and the ability to make reliable future predictions. In summary, this thesis presents a variety of applications of Gaussian processes in robotics, from trajectory and motion planning to model identification. These machine learning-based solutions provide probabilistic predictions and improve the ability of robots to perform tasks safely and efficiently. Gaussian processes are positioned as a powerful tool to address current challenges in robotics and open up new possibilities in the field.El aprendizaje automático ha revolucionado el campo de la robótica al ofrecer una amplia gama de aplicaciones en áreas como la percepción, el control, la planificación y la toma de decisiones. Este enfoque implica desarrollar programas informáticos que pueden procesar datos, extraer información valiosa, realizar predicciones y ofrecer recomendaciones o sugerencias de acciones. Estos programas se basan en modelos matemáticos que capturan las relaciones entre las variables que representan los datos observados y las propiedades que se desean analizar. Los modelos se entrenan utilizando algoritmos de optimización que ajustan automáticamente los parámetros para lograr un rendimiento óptimo. Sin embargo, a medida que surgen aplicaciones robóticas más complejas y novedosas, la complejidad de los datos aumenta y la experiencia previa puede resultar insuficiente para definir modelos matemáticos adecuados. Además, los métodos de aprendizaje automático tradicionales son propensos a problemas como el sobreajuste, lo que puede llevar a predicciones inexactas y fallos catastróficos en aplicaciones críticas. Para superar estos desafíos, los métodos probabilísticos de aprendizaje automático, como los procesos gaussianos, han ganado popularidad. Estos métodos ofrecen distribuciones probabilísticas como salidas del modelo, lo que permite estimar la incertidumbre asociada a las predicciones y tomar decisiones más informadas. Esto es, proporcionan una media y una varianza para las respuestas del modelo. Esta tesis se centra en la aplicación de soluciones de aprendizaje automático basadas en procesos gaussianos a diversos problemas en robótica, con el objetivo de mejorar los métodos actuales y proporcionar una nueva perspectiva. Se abordan áreas clave como la planificación de trayectorias para vehículos aéreos no tripulados (UAVs), la planificación de movimientos para manipuladores robóticos y la identificación de modelos de sistemas no lineales. En el campo de la planificación de trayectorias para UAVs, se han desarrollado algoritmos basados en procesos gaussianos que permiten una planificación más eficiente y un ahorro de energía en misiones de exploración. Estos algoritmos se comparan con los enfoques analíticos tradicionales, demostrando su superioridad en términos de eficiencia al utilizar el aprendizaje automático. Se presentan algoritmos de recubrimiento de áreas y recubrimiento lineal con formaciones de UAVs, así como un algoritmo de búsqueda en superficies marinas. Finalmente, estos algoritmos se comparan con un nuevo método que utiliza procesos gaussianos para realizar predicciones probabilísticas y optimizar la planificación de trayectorias, lo que resulta en un rendimiento mejorado y una reducción del consumo de energía. En cuanto a la planificación de movimientos para manipuladores robóticos, se propone un enfoque basado en modelos gaussianos que permite una reducción significativa en los tiempos de cálculo. Se utiliza un modelo de procesos gaussianos para aproximar el espacio de configuraciones de un robot, lo que proporciona información valiosa para evitar colisiones y mejorar la seguridad en entornos dinámicos. Este enfoque se compara con los métodos convencionales de planificación de movimientos y se demuestra su eficacia en términos de tiempo de cálculo y precisión de los movimientos. En esta aplicación, la varianza proporciona información sobre zonas peligrosas para el manipulador. En cuanto a la identificación de modelos de sistemas no lineales, los procesos gaussianos también ofrecen ventajas significativas. Este enfoque se aplica a un sistema de brazo robótico blando y a modelos de consumo energético de UAVs, donde se utilizan datos experimentales para entrenar un modelo de proceso gaussiano que captura las relaciones entre las entradas y las salidas del sistema. Los resultados muestran una identificación precisa de los parámetros del sistema y la capacidad de realizar predicciones futuras confiables. En resumen, esta tesis presenta una variedad de aplicaciones de procesos gaussianos en robótica, desde la planificación de trayectorias y movimientos hasta la identificación de modelos. Estas soluciones basadas en aprendizaje automático ofrecen predicciones probabilísticas y mejoran la capacidad de los robots para realizar tareas de manera segura y eficiente. Los procesos gaussianos se posicionan como una herramienta poderosa para abordar los desafíos actuales en robótica y abrir nuevas posibilidades en el campo.Programa de Doctorado en Ingeniería Eléctrica, Electrónica y Automática por la Universidad Carlos III de MadridPresidente: Juan Jesús Romero Cardalda.- Secretaria: María Dolores Blanco Rojas.- Vocal: Giuseppe Carbon

Reduction of dimensionality of a cellular actuator array for driving a robotic hand

Thesis (Ph. D.)--Massachusetts Institute of Technology, Dept. of Mechanical Engineering, 2007.Includes bibliographical references (p. 89-93).In an attempt to explore an alternative to today's robot actuators, a new approach to artificial muscle actuator design and control is presented. The objective of this research is to coordinate the multitude of artificial muscle actuator axes for a large DOF (degree of freedom) robotic system based on dimensionality reduction. An array of SMA actuators is segmented into many independently controlled, spatially discrete volumes, each contributing a small displacement to create a large motion. Segmented Binary Control is proposed where each segment is controlled in an on-off manner, creating a stepper-motor like actuator. This overcomes hysteresis and other nonlinearities of the actuator material. The segmented cellular architecture of SMA wires is extended to a multi-axis actuator array by arranging the segments in a two-dimensional array. The multi-axis control is streamlined and coordinated using a grouping of segments called C-segments in order to activate multiple links of a robot mechanism in a coordinated manner. This allows control of large DOF with a small number of controls. The proposed approach is inspired by the segmented architecture of biological muscles and synergies, a strategy of grouping output variables to simplify the control of large number of muscles. Data from various hand postures are collected using data glove and used in creating the C-segment design that is capable of performing the given postures. A lightweight Robotic Hand with 16 DOF is built using shape memory alloy actuators. This hand weighs less than 1kg including 32 SMA actuators and control circuitry. Eight C-segments that are ON-off controlled are used to create sixteen given postures. In the future, this approach can be applied to applications where the control signal is inherently limited due to limited amount of information that can be extracted or transferred to the robot, such as brain machine interface and tele-operation.by Kyu-Jin Cho.Ph.D

A Theory of Cheap Control in Embodied Systems

We present a framework for designing cheap control architectures for embodied agents. Our derivation is guided by the classical problem of universal approximation, whereby we explore the possibility of exploiting the agent's embodiment for a new and more efficient universal approximation of behaviors generated by sensorimotor control. This embodied universal approximation is compared with the classical non-embodied universal approximation. To exemplify our approach, we present a detailed quantitative case study for policy models defined in terms of conditional restricted Boltzmann machines. In contrast to non-embodied universal approximation, which requires an exponential number of parameters, in the embodied setting we are able to generate all possible behaviors with a drastically smaller model, thus obtaining cheap universal approximation. We test and corroborate the theory experimentally with a six-legged walking machine. The experiments show that the sufficient controller complexity predicted by our theory is tight, which means that the theory has direct practical implications. Keywords: cheap design, embodiment, sensorimotor loop, universal approximation, conditional restricted Boltzmann machineComment: 27 pages, 10 figure

Exploring the effects of robotic design on learning and neural control

The ongoing deep learning revolution has allowed computers to outclass humans in various games and perceive features imperceptible to humans during classification tasks. Current machine learning techniques have clearly distinguished themselves in specialized tasks. However, we have yet to see robots capable of performing multiple tasks at an expert level. Most work in this field is focused on the development of more sophisticated learning algorithms for a robot's controller given a largely static and presupposed robotic design. By focusing on the development of robotic bodies, rather than neural controllers, I have discovered that robots can be designed such that they overcome many of the current pitfalls encountered by neural controllers in multitask settings. Through this discovery, I also present novel metrics to explicitly measure the learning ability of a robotic design and its resistance to common problems such as catastrophic interference. Traditionally, the physical robot design requires human engineers to plan every aspect of the system, which is expensive and often relies on human intuition. In contrast, within the field of evolutionary robotics, evolutionary algorithms are used to automatically create optimized designs, however, such designs are often still limited in their ability to perform in a multitask setting. The metrics created and presented here give a novel path to automated design that allow evolved robots to synergize with their controller to improve the computational efficiency of their learning while overcoming catastrophic interference. Overall, this dissertation intimates the ability to automatically design robots that are more general purpose than current robots and that can perform various tasks while requiring less computation.Comment: arXiv admin note: text overlap with arXiv:2008.0639

Practical control methods for vacuum driven soft actuator modules

Vacuum-powered Soft Pneumatic Actuator (VSPA) Modules have been described to afford advantages for rapid development of reconfigurable, multi-DoF soft pneumatic robots powered by vacuum by reducing their logistical complexity, however they also present new challenges in the control of resulting systems. This framework features modules joined together over a simple embedded pneumatic and serial communication network and requires a unique approach to both low-level control implementation and high-level control strategy. We describe the structure and activation characteristics of a V-SPA Module and present practical methods for its control. These methods utilize software generated PWM activation through a unique serial protocol designed for LED networks and a heuristic mapping strategy for simplifying the spherical control of 3-DoF actuator modules

Developing Design and Analysis Framework for Hybrid Mechanical-Digital Control of Soft Robots: from Mechanics-Based Motion Sequencing to Physical Reservoir Computing

The recent advances in the field of soft robotics have made autonomous soft robots working in unstructured dynamic environments a close reality. These soft robots can potentially collaborate with humans without causing any harm, they can handle fragile objects safely, perform delicate surgeries inside body, etc. In our research we focus on origami based compliant mechanisms, that can be used as soft robotic skeleton. Origami mechanisms are inherently compliant, lightweight, compact, and possess unique mechanical properties such as– multi-stability, nonlinear dynamics, etc. Researchers have shown that multi-stable mechanisms have applications in motion-sequencing applications. Additionally, the nonlinear dynamic properties of origami and other soft, compliant mechanisms are shown to be useful for ‘morphological computation’ in which the body of the robot itself takes part in performing complex computations required for its control. In our research we demonstrate the motion-sequencing capability of multi-stable mechanisms through the example of bistable Kresling origami robot that is capable of peristaltic locomotion. Through careful theoretical analysis and thorough experiments, we show that we can harness multistability embedded in the origami robotic skeleton for generating actuation cycle of a peristaltic-like locomotion gait. The salient feature of this compliant robot is that we need only a single linear actuator to control the total length of the robot, and the snap-through actions generated during this motion autonomously change the individual segment lengths that lead to earthworm-like peristaltic locomotion gait. In effect, the motion-sequencing is hard-coded or embedded in the origami robot skeleton. This approach is expected to reduce the control requirement drastically as the robotic skeleton itself takes part in performing low-level control tasks. The soft robots that work in dynamic environments should be able to sense their surrounding and adapt their behavior autonomously to perform given tasks successfully. Thus, hard-coding a certain behavior as in motion-sequencing is not a viable option anymore. This led us to explore Physical Reservoir Computing (PRC), a computational framework that uses a physical body with nonlinear properties as a ‘dynamic reservoir’ for performing complex computations. The compliant robot ‘trained’ using this framework should be able to sense its surroundings and respond to them autonomously via an extensive network of sensor-actuator network embedded in robotic skeleton. We show for the first time through extensive numerical analysis that origami mechanisms can work as physical reservoirs. We also successfully demonstrate the emulation task using a Miura-ori based reservoir. The results of this work will pave the way for intelligently designed origami-based robots with embodied intelligence. These next generation of soft robots will be able to coordinate and modulate their activities autonomously such as switching locomotion gait and resisting external disturbances while navigating through unstructured environments

Dynamic Cellular Actuator Arrays and Expanded Fingerprint Method for Dynamic Modeling

Copyright © ElsevierDOI: http://dx.doi.org/10.1016/j.robot.2013.06.013A key step to understanding and producing natural motion is creating a physical, well understood actuator with a dynamic model resembling biological muscle. This actuator can then serve as the basis for building viable, full-strength, and safe muscles for disabled patients, rehabilitation, human force amplification, telerobotics, and humanoid robotic systems. This paper presents a cell-based flexible actuator modeling methodology and the General Fingerprint Method for systematically and efficiently calculating the actuators’ respective dynamic equations of motion. The cellular actuator arrays combine many flexible ‘cells’ in complex and varied topologies for combined large-scale motion. The cells can have varied internal dynamic models and common actuators such as piezoelectric, SMA, linear motor, and pneumatic technologies can fit the model by adding a flexible element in series with the actuator. The topology of the cellular actuator array lends it many of its properties allowing the final muscle to be catered to particular applications. The General Fingerprint Method allows for fast recalculation for different and/or changing structures and internal dynamics, and provides an intuitive base for future controls work. This paper also presents two physical SMA based cellular actuator arrays which validate the presented theory and give a basis for future development