Model-Free Design Optimization of a Hopping Robot and Its Comparison With a Human Designer

When developing a robot, design iterations in the physical world are necessary, even though they are often costly and not systematic. Here, we present an automated iterative design process without using modeling or simulation, which we refer to as “model-free design optimization” based on Bayesian optimization. This letter particularly focuses on the cooptimization of morphology and controller, by using a mechanism to balance parameter specific costs (i.e., morphology samplings are more expensive than control ones) for effective and efficient design optimization processes. A hopping robot was employed for a feasibility analysis of the proposed optimization method, in which minimalistic two-dimensional and four-dimensional design optimization experiments were performed in real life. The results show that the proposed approach is capable of improving both of the robot design problems within a defined time limit. The method is also compared to optimization performances of a human designer under the same conditions. The automated method has advantage in finding the best solution more quickly in the four-dimensional search space, while the human optimization performs better in the two-dimensional case.This work was supported by the U.K. Engineering and Physical Sciences Research Council under Grant EP/N03211X/1

Mechanism and Behaviour Co-optimisation of High Performance Mobile Robots

Mobile robots do not display the level of physical performance one would expect, given the specifications of their hardware. This research is based on the idea that their poor performance is at least partly due to their design, and proposes an optimisation approach for the design of high-performance mobile robots. The aim is to facilitate the design process, and produce versatile and robust robots that can exploit the maximum potential of today's technology. This can be achieved by a systematic optimisation study that is based on careful modelling of the robot's dynamics and its limitations, and takes into consideration the performance requirements that the robot is designed to meet. The approach is divided into two parts: (1) an optimisation framework, and (2) an optimisation methodology. In the framework, designs that can perform a large set of tasks are sought, by simultaneously optimising the design and the behaviours to perform them. The optimisation methodology consists of several stages, where various techniques are used for determining the design's most important parameters, and for maximising the chances of finding the best possible design based on the designer's evaluation criteria. The effectiveness of the optimisation approach is proved via a specific case-study of a high-performance balancing and hopping monopedal robot. The outcome is a robot design and a set of optimal behaviours that can meet several performance requirements of conflicting nature, by pushing the hardware to its limits in a safe way. The findings of this research demonstrate the importance of using realistic models, and taking into consideration the tasks that the robot is meant to perform in the design process

Viability in State-Action Space: Connecting Morphology, Control, and Learning

Wie können wir Robotern ermöglichen, modellfrei und direkt auf der Hardware zu lernen? Das maschinelle Lernen nimmt als Standardwerkzeug im Arsenal des Robotikers seinen Platz ein. Es gibt jedoch einige offene Fragen, wie man die Kontrolle über physikalische Systeme lernen kann. Diese Arbeit gibt zwei Antworten auf diese motivierende Frage. Das erste ist ein formales Mittel, um die inhärente Robustheit eines gegebenen Systemdesigns zu quantifizieren, bevor der Controller oder das Lernverfahren entworfen wird. Dies unterstreicht die Notwendigkeit, sowohl das Hardals auch das Software-Design eines Roboters zu berücksichtigen, da beide Aspekte in der Systemdynamik untrennbar miteinander verbunden sind. Die zweite ist die Formalisierung einer Sicherheitsmass, die modellfrei erlernt werden kann. Intuitiv zeigt diese Mass an, wie leicht ein Roboter Fehlschläge vermeiden kann. Auf diese Weise können Roboter unbekannte Umgebungen erkunden und gleichzeitig Ausfälle vermeiden. Die wichtigsten Beiträge dieser Dissertation basieren sich auf der Viabilitätstheorie. Viabilität bietet eine alternative Sichtweise auf dynamische Systeme: Anstatt sich auf die Konvergenzeigenschaften eines Systems in Richtung Gleichgewichte zu konzentrieren, wird der Fokus auf Menge von Fehlerzuständen und die Fähigkeit des Systems, diese zu vermeiden, verlagert. Diese Sichtweise eignet sich besonders gut für das Studium der Lernkontrolle an Robotern, da Stabilität im Sinne einer Konvergenz während des Lernprozesses selten gewährleistet werden kann. Der Begriff der Viabilität wird formal auf den Zustand-Aktion-Raum erweitert, mit Viabilitätsmengen von Staat-Aktionspaaren. Eine über diese Mengen definierte Mass ermöglicht eine quantifizierte Bewertung der Robustheit, die für die Familie aller fehlervermeidenden Regler gilt, und ebnet den Weg für ein sicheres, modellfreies Lernen. Die Arbeit beinhaltet auch zwei kleinere Beiträge. Der erste kleine Beitrag ist eine empirische Demonstration der Shaping durch ausschliessliche Modifikation der Systemdynamik. Diese Demonstration verdeutlicht die Bedeutung der Robustheit gegenüber Fehlern für die Lernkontrolle: Ausfälle können nicht nur Schäden verursachen, sondern liefern in der Regel auch keine nützlichen Gradienteninformationen für den Lernprozess. Der zweite kleine Beitrag ist eine Studie über die Wahl der Zustandsinitialisierungen. Entgegen der Intuition und der üblichen Praxis zeigt diese Studie, dass es zuverlässiger sein kann, das System gelegentlich aus einem Zustand zu initialisieren, der bekanntermassen unkontrollierbar ist.How can we enable robots to learn control model-free and directly on hardware? Machine learning is taking its place as a standard tool in the roboticist’s arsenal. However, there are several open questions on how to learn control for physical systems. This thesis provides two answers to this motivating question. The first is a formal means to quantify the inherent robustness of a given system design, prior to designing the controller or learning agent. This emphasizes the need to consider both the hardware and software design of a robot, which are inseparably intertwined in the system dynamics. The second is the formalization of a safety-measure, which can be learned model-free. Intuitively, this measure indicates how easily a robot can avoid failure, and enables robots to explore unknown environments while avoiding failures. The main contributions of this dissertation are based on viability theory. Viability theory provides a slightly unconventional view of dynamical systems: instead of focusing on a system’s convergence properties towards equilibria, the focus is shifted towards sets of failure states and the system’s ability to avoid these sets. This view is particularly well suited to studying learning control in robots, since stability in the sense of convergence can rarely be guaranteed during the learning process. The notion of viability is formally extended to state-action space, with viable sets of state-action pairs. A measure defined over these sets allows a quantified evaluation of robustness valid for the family of all failure-avoiding control policies, and also paves the way for enabling safe model-free learning. The thesis also includes two minor contributions. The first minor contribution is an empirical demonstration of shaping by exclusively modifying the system dynamics. This demonstration highlights the importance of robustness to failures for learning control: not only can failures cause damage, but they typically do not provide useful gradient information for the learning process. The second minor contribution is a study on the choice of state initializations. Counter to intuition and common practice, this study shows it can be more reliable to occasionally initialize the system from a state that is known to be uncontrollable

Integral admittance shaping: A unified framework for active exoskeleton control

© 2015 Elsevier B.V. Current strategies for lower-limb exoskeleton control include motion intent estimation, which is subject to inaccuracies in muscle torque estimation as well as modeling error. Approaches that rely on the phases of a uniform gait cycle have proven effective, but lack flexibility to aid other kinds of movement. This research aims at developing a more versatile control that can assist the lower limbs independently of the movement attempted. Our control strategy is based on modifying the dynamic response of the human limbs, specifically their mechanical admittance. Increasing the admittance makes the lower limbs more responsive to any muscle torque generated by the human user. We present Integral Admittance Shaping, a unified mathematical framework for: (a) determining the desired dynamic response of the coupled system formed by the human limb and the exoskeleton, and (b) synthesizing an exoskeleton controller capable of achieving said response. The present control formulation focuses on single degree-of-freedom exoskeleton devices providing performance augmentation. The algorithm generates a desired shape for the frequency response magnitude of the integral admittance (torque-to-angle relationship) of the coupled system. Simultaneously, it generates an optimal feedback controller capable of achieving the desired response while guaranteeing coupled stability and passivity. The potential effects of the exoskeleton's assistance are motion amplification for the same joint torque, and torque reduction for the same joint motion. The robustness of the derived exoskeleton controllers to parameter uncertainties is analyzed and discussed. Results from initial trials using the controller on an experimental exoskeleton are presented as well

Systematic Controller Design for Dynamic 3D Bipedal Robot Walking.

Virtual constraints and hybrid zero dynamics (HZD) have emerged as a powerful framework for controlling bipedal robot locomotion, as evidenced by the robust, energetically efficient, and natural-looking walking and running gaits achieved by planar robots such as Rabbit, ERNIE, and MABEL. However, the extension to 3D robots is more subtle, as the choice of virtual constraints has a deciding effect on the stability of a periodic orbit. Furthermore, previous methods did not provide a systematic means of designing virtual constraints to ensure stability. This thesis makes both experimental and theoretical contributions to the control of underactuated 3D bipedal robots. On the experimental side, we present the first realization of dynamic 3D walking using virtual constraints. The experimental success is achieved by augmenting a robust planar walking gait with a novel virtual constraint for the lateral swing hip angle. The resulting controller is tested in the laboratory on a human-scale bipedal robot (MARLO) and demonstrated to stabilize the lateral motion for unassisted 3D walking at approximately 1 m/s. MARLO is one of only two known robots to walk in 3D with stilt-like feet. On the theoretical side, we introduce a method to systematically tune a given choice of virtual constraints in order to stabilize a periodic orbit of a hybrid system. We demonstrate the method to stabilize a walking gait for MARLO, and show that the optimized controller leads to improved lateral control compared to the nominal virtual constraints. We also describe several extensions of the basic method, allowing the use of a restricted Poincaré map and the incorporation of disturbance rejection metrics in the optimization. Together, these methods comprise an important contribution to the theory of HZD.PhDElectrical Engineering: SystemsUniversity of Michigan, Horace H. Rackham School of Graduate Studieshttp://deepblue.lib.umich.edu/bitstream/2027.42/113370/1/bgbuss_1.pd

Dynamic Walking: Toward Agile and Efficient Bipedal Robots

Dynamic walking on bipedal robots has evolved from an idea in science fiction to a practical reality. This is due to continued progress in three key areas: a mathematical understanding of locomotion, the computational ability to encode this mathematics through optimization, and the hardware capable of realizing this understanding in practice. In this context, this review article outlines the end-to-end process of methods which have proven effective in the literature for achieving dynamic walking on bipedal robots. We begin by introducing mathematical models of locomotion, from reduced order models that capture essential walking behaviors to hybrid dynamical systems that encode the full order continuous dynamics along with discrete footstrike dynamics. These models form the basis for gait generation via (nonlinear) optimization problems. Finally, models and their generated gaits merge in the context of real-time control, wherein walking behaviors are translated to hardware. The concepts presented are illustrated throughout in simulation, and experimental instantiation on multiple walking platforms are highlighted to demonstrate the ability to realize dynamic walking on bipedal robots that is agile and efficient

Improving Robotic Cooking using Batch Bayesian Optimization

With advances in the field of robotic manipulation, sensing and machine learning, robotic chefs are expected to become prevalent in our kitchens and restaurants. Robotic chefs are envisioned to replicate human skills in order to reduce the burden of the cooking process. However, the potential of robots as a means to enhance the dining experience is unrecognised. This work introduces the concept of food quality optimization and its challenges with an automated omelette cooking robotic system. The design and control of the robotic system that uses general kitchen tools is presented first. Next, we investigate new optimization strategies for improving subjective food quality rating, a problem challenging because of the qualitative nature of the objective and strongly constrained number of function evaluations possible. Our results show that through appropriate design of the optimization routine using Batch Bayesian Optimization, improvements in the subjective evaluation of food quality can be achieved reliably, with very few trials and with the ability for bulk optimization. This study paves the way towards a broader vision of personalized food for taste-and-nutrition and transferable recipes