A Bio-inspired architecture for adaptive quadruped locomotion over irregular terrain

Tese de doutoramento Programa Doutoral em Engenharia Electrónica e de ComputadoresThis thesis presents a tentative advancement on walking control of small quadruped and humanoid position controlled robots, addressing the problem of walk generation by combining dynamical systems approach to motor control, insights from neuroethology research on vertebrate motor control and computational neuroscience. Legged locomotion is a complex dynamical process, despite the seemingly easy and natural behavior of the constantly present proficiency of legged animals. Research on locomotion and motor control in vertebrate animals from the last decades has brought to the attention of roboticists, the potential of the nature’s solutions to robot applications. Recent knowledge on the organization of complex motor generation and on mechanics and dynamics of locomotion has been successfully exploited to pursue agile robot locomotion. The work presented on this manuscript is part of an effort on the pursuit in devising a general, model free solution, for the generation of robust and adaptable walking behaviors. It strives to devise a practical solution applicable to real robots, such as the Sony’s quadruped AIBO and Robotis’ DARwIn- OP humanoid. The discussed solutions are inspired on the functional description of the vertebrate neural systems, especially on the concept of Central Pattern Generators (CPGs), their structure and organization, components and sensorimotor interactions. They use a dynamical systems approach for the implementation of the controller, especially on the use of nonlinear oscillators and exploitation of their properties. The main topics of this thesis are divided into three parts. The first part concerns quadruped locomotion, extending a previous CPG solution using nonlinear oscillators, and discussing an organization on three hierarchical levels of abstraction, sharing the purpose and knowledge of other works. It proposes a CPG solution which generates the walking motion for the whole-leg, which is then organized in a network for the production of quadrupedal gaits. The devised solution is able to produce goal-oriented locomotion and navigation as directed through highlevel commands from local planning methods. In this part, active balance on a standing quadruped is also addressed, proposing a method based on dynamical systems approach, exploring the integration of parallel postural mechanisms from several sensory modalities. The solutions are all successfully tested on the quadruped AIBO robot. In the second part, is addressed bipedal walking for humanoid robots. A CPG solution for biped walking based on the concept of motion primitives is proposed, loosely based on the idea of synergistic organization of vertebrate motor control. A set of motion primitives is shown to produce the basis of simple biped walking, and generalizable to goal-oriented walking. Using the proposed CPG, the inclusion of feedback mechanisms is investigated, for modulation and adaptation of walking, through phase transition control according to foot load information. The proposed solution is validated on the humanoid DARwIn-OP, and its application is evaluated within a whole-body control framework. The third part sidesteps a little from the other two topics. It discusses the CPG as having an alternative role to direct motor generation in locomotion, serving instead as a processor of sensory information for a feedback based motor generation. In this work a reflex based walking controller is devised for the compliant quadruped Oncilla robot, to serve as purely feedback based walking generation. The capabilities of the reflex network are shown in simulations, followed by a brief discussion on its limitations, and how they could be improved by the inclusion of a CPG.Esta tese apresenta uma tentativa de avanço no controlo de locomoção para pequenos robôs quadrúpedes e bipedes controlados por posição, endereçando o problema de geração motora através da combinação da abordagem de sistemas dinâmicos para o controlo motor, e perspectivas de investigação neuroetologia no controlo motor vertebrado e neurociência computacional. Andar é um processo dinâmico e complexo, apesar de parecer um comportamento fácil e natural devido à presença constante de animais proficientes em locomoção terrestre. Investigação na área da locomoção e controlo motor em animais vertebrados nas últimas decadas, trouxe à atenção dos roboticistas o potencial das soluções encontradas pela natureza aplicadas a aplicações robóticas. Conhecimento recente relativo à geração de comportamentos motores complexos e da mecânica da locomoção tem sido explorada com sucesso na procura de locomoção ágil na robótica. O trabalho apresentado neste documento é parte de um esforço no desenho de uma solução geral, e independente de modelos, para a geração robusta e adaptável de comportamentos locomotores. O foco é desenhar uma solução prática, aplicável a robôs reais, tal como o quadrúpede Sony AIBO e o humanóide DARwIn-OP. As soluções discutidas são inspiradas na descrição funcional do sistema nervoso vertebrado, especialmente no conceito de Central Pattern Generators (CPGs), a sua estrutura e organização, componentes e interacção sensorimotora. Estas soluções são implementadas usando uma abordagem em sistemas dinâmicos, focandos o uso de osciladores não lineares e a explorando as suas propriedades. Os tópicos principais desta tese estão divididos em três partes. A primeira parte explora o tema de locomoção quadrúpede, expandindo soluções prévias de CPGs usando osciladores não lineares, e discutindo uma organização em três níveis de abstracção, partilhando as ideias de outros trabalhos. Propõe uma solução de CPG que gera os movimentos locomotores para uma perna, que é depois organizado numa rede, para a produção de marcha quadrúpede. A solução concebida é capaz de produzir locomoção e navegação, comandada através de comandos de alto nível, produzidos por métodos de planeamento local. Nesta parte também endereçado o problema da manutenção do equilíbrio num robô quadrúpede parado, propondo um método baseado na abordagem em sistemas dinâmicos, explorando a integração de mecanismos posturais em paralelo, provenientes de várias modalidades sensoriais. As soluções são todas testadas com sucesso no robô quadrupede AIBO. Na segunda parte é endereçado o problema de locomoção bípede. É proposto um CPG baseado no conceito de motion primitives, baseadas na ideia de uma organização sinergética do controlo motor vertebrado. Um conjunto de motion primitives é usado para produzir a base de uma locomoção bípede simples e generalizável para navegação. Esta proposta de CPG é usada para de seguida se investigar a inclusão de mecanismos de feedback para modulação e adaptação da marcha, através do controlo de transições entre fases, de acordo com a informação de carga dos pés. A solução proposta é validada no robô humanóide DARwIn-OP, e a sua aplicação no contexto do framework de whole-body control é também avaliada. A terceira parte desvia um pouco dos outros dois tópicos. Discute o CPG como tendo um papel alternativo ao controlo motor directo, servindo em vez como um processador de informação sensorial para um mecanismo de locomoção puramente em feedback. Neste trabalho é desenhado um controlador baseado em reflexos para a geração da marcha de um quadrúpede compliant. As suas capacidades são demonstradas em simulação, seguidas por uma breve discussão nas suas limitações, e como estas podem ser ultrapassadas pela inclusão de um CPG.The presented work was possible thanks to the support by the Portuguese Science and Technology Foundation through the PhD grant SFRH/BD/62047/2009

The Future of Humanoid Robots

This book provides state of the art scientific and engineering research findings and developments in the field of humanoid robotics and its applications. It is expected that humanoids will change the way we interact with machines, and will have the ability to blend perfectly into an environment already designed for humans. The book contains chapters that aim to discover the future abilities of humanoid robots by presenting a variety of integrated research in various scientific and engineering fields, such as locomotion, perception, adaptive behavior, human-robot interaction, neuroscience and machine learning. The book is designed to be accessible and practical, with an emphasis on useful information to those working in the fields of robotics, cognitive science, artificial intelligence, computational methods and other fields of science directly or indirectly related to the development and usage of future humanoid robots. The editor of the book has extensive R&D experience, patents, and publications in the area of humanoid robotics, and his experience is reflected in editing the content of the book

Analysis and generation of highly dynamic motions of anthropomorphic systems: application to parkour

Cette thèse propose une approche interdisciplinaire originale du traitement du mouvement humain corps-complet grâce à l'utilisation couplée d'approches issues de la biomécanique, du contrôle moteur et de la robotique. Les méthodes biomécaniques sont utilisées pour l'enregistrement, le traitement et l'analyse du mouvement humain. L'approche > du contrôle moteur est étendue à l'étude des mouvements hautement dynamiques. Ceci permet de déterminer si d'éventuelles tâches dynamiques sont contrôlées et stabilisées par le cerveau, puis d'inférer une organisation hiérarchique des tâches motrices. Le formalisme de l'espace des tâches utilisé en robotique pour la génération de mouvement corps-complet ainsi que la hiérarchie des tâches extraites dans l'étude du contrôle moteur sont utilisés pour simuler des mouvements humains hautement dynamiques. Cette approche permet de mieux comprendre le mouvement humain et de générer des mouvements inspirés de l'humain pour d'autres systèmes anthropomorphes tel que des robots ou avatars. La discipline du Parkour, impliquant des actions hautement dynamiques tels que des sauts et des techniques d'atterisage, est choisie pour illustrer l'approche proposée.This thesis proposes an original and interdisciplinary approach to the treatment of whole-body human movements through the synergistic utilization of biomechanics, motor control and robotics. Robust methods of biomechanics are used to record, process and analyze whole-body human motions. The Uncontrolled Manifold approach (UCM) of motor control is extended to study highly dynamic movements processed in the biomechanical study, in order to determine if hypothesized dynamic tasks are being controlled stably by the central nervous system. This extension permits also to infer a hierarchical organization of the controlled dynamic tasks. The task space formalism of motion generation in robotics is used to generate whole-body motion by taking into account the hierarchy of tasks extracted in the motor control study. This approach permits to better understand the organization of human dynamic motions and provide a new methodology to generate whole-body human motions with anthropomorphic systems. A case study of highly dynamic and complex movements of Parkour, including jumps and landings, is utilized to illustrate the proposed approach

Porcine Spine Finite Element Model of Progressive Experimental Scoliosis and Assessment of a New Dual-Epiphyseal Growth Modulating Implant

RÉSUMÉ La scoliose est une déformation tridimensionnelle de la colonne vertébrale dont l’étiologie reste encore à élucider. Il est généralement admis que la progression de la déformation scoliotique pédiatrique est liée au principe d’Hueter-Volkmann qui stipule une réduction de la croissance suite à des contraintes en compression excessives au niveau de la concavité de la courbure scoliotique vs. sa convexité. Les stratégies de traitement des courbures sont difficiles, surtout chez les jeunes enfants. Typiquement, une intervention chirurgicale avec une instrumentation rachidienne accompagnée d’une arthrodèse segmentaire est nécessaire pour des courbures progressant au-delà de 40° d’angle de Cobb. De nouveaux dispositifs visent à manipuler la croissance vertébrale en exploitant le principe d’Hueter-Volkmann pour contrôler la progression de et corriger la courbure. Ces implants sans fusion exploitent la croissance vertébrale résiduelle en manipulant des gradients de croissance pour localement inverser la cunéiformisation vertébrale et, au fil du temps, réaligner la colonne vertébrale globalement. Des essais cliniques ont démontré une correction prometteuse pour les courbures généralement inférieures à 45°; cependant, les dispositifs actuels chevauchent l’espace du disque intervertébral et le compriment augmentant les risques de dégénérescence du disque à long terme. Par ailleurs, les implants nouvellement conçus sont généralement testés en utilisant des modèles animaux équivalents pour évaluer leur efficacité à corriger des déformations par l'intermédiaire de l’approche inverse (création d'une déformation) ou l’approche à 2- étapes (création d'une déformation suivie d’une correction). Néanmoins, une plate-forme de conception efficace est nécessaire pour évaluer la manipulation de la croissance à court et long termes par de nouveaux implants et de raccourcir le transfert de connaissances vers des applications cliniques. L’objectif général de cette thèse était de développer et de vérifier un modèle par éléments finis porcin (MEFp) unique en tant qu’une plateforme alternative pour la simulation de scolioses expérimentales progressives et des implants sans fusion, et d’évaluer un nouvel implant double-épiphysaire local ne chevauchant pas l’espace du disque sur des porcs immatures. Ainsi, les objectifs spécifiques suivants ont été complétés : 1) développer et----------ABSTRACT Scoliosis is a complex three-dimensional deformity of the spine whose etiology is yet to be elucidated. The pathomechanism of scoliosis progression is believed to be linked to the Hueter-Volkmann principle, by which growth is reduced due to increased growth plate compression, with the inverse also valid. Treatment strategies are challenging, especially in young children. Curves progressing beyond 40° Cobb angle are typically treated via invasive surgical interventions requiring spinal instrumentation accompanied by segmental spinal arthrodesis, impairing spinal mobility. New devices aim at manipulating vertebral growth by exploiting the Hueter-Volkmann principle to control curvature progression. These fusionless implants harness remaining vertebral growth by manipulating growth gradients to reverse vertebral wedging locally and, over time, globally realign the spine. Clinical trials have demonstrated promising deformity correction for curves generally below 45°; however, current devices bridge the intervertebral disc gap and predominantly compress the disc increasing the risks of longterm disc degeneration. Moreover, in a time-consuming manner, newly designed implants are commonly tested using equivalent animal models to assess their efficacy in correcting spinal deformities via the inverse (creation of a deformity) or the 2-step approaches (creation of a deformity followed by its subsequent correction). Nevertheless, a solid design platform is required to evaluate the short- and long-term growth manipulating efficacy of new implant designs and shorten knowledge transfer to clinical applications. The general objective of this thesis was to develop and verify a unique porcine spine finite element model (pFEM) as an alternative testing platform for the simulation of progressive experimental scoliosis and fusionless implants, and assess a new localized dualepiphyseal implant on immature pigs. Thus, specific objectives were devised as follows: 1) develop and verify a distinctive pFEM of the spine and ribcage, 2) develop and test, in vivo, a dual-epiphyseal implant incorporating a custom expansion mechanism, 3) exploit the developed pFEM to investigate differences between the inverse and 2-step fusionless implant testing approaches, and 4) exploit the pFEM to evaluate the biomechanical contribution of the ribcage in fusionless scoliosis surgery

Engineering derivatives from biological systems for advanced aerospace applications

The present study consisted of a literature survey, a survey of researchers, and a workshop on bionics. These tasks produced an extensive annotated bibliography of bionics research (282 citations), a directory of bionics researchers, and a workshop report on specific bionics research topics applicable to space technology. These deliverables are included as Appendix A, Appendix B, and Section 5.0, respectively. To provide organization to this highly interdisciplinary field and to serve as a guide for interested researchers, we have also prepared a taxonomy or classification of the various subelements of natural engineering systems. Finally, we have synthesized the results of the various components of this study into a discussion of the most promising opportunities for accelerated research, seeking solutions which apply engineering principles from natural systems to advanced aerospace problems. A discussion of opportunities within the areas of materials, structures, sensors, information processing, robotics, autonomous systems, life support systems, and aeronautics is given. Following the conclusions are six discipline summaries that highlight the potential benefits of research in these areas for NASA's space technology programs

Becoming Human with Humanoid

Nowadays, our expectations of robots have been significantly increases. The robot, which was initially only doing simple jobs, is now expected to be smarter and more dynamic. People want a robot that resembles a human (humanoid) has and has emotional intelligence that can perform action-reaction interactions. This book consists of two sections. The first section focuses on emotional intelligence, while the second section discusses the control of robotics. The contents of the book reveal the outcomes of research conducted by scholars in robotics fields to accommodate needs of society and industry

Towards Robust Bipedal Locomotion:From Simple Models To Full-Body Compliance

Thanks to better actuator technologies and control algorithms, humanoid robots to date can perform a wide range of locomotion activities outside lab environments. These robots face various control challenges like high dimensionality, contact switches during locomotion and a floating-base nature which makes them fall all the time. A rich set of sensory inputs and a high-bandwidth actuation are often needed to ensure fast and effective reactions to unforeseen conditions, e.g., terrain variations, external pushes, slippages, unknown payloads, etc. State of the art technologies today seem to provide such valuable hardware components. However, regarding software, there is plenty of room for improvement. Locomotion planning and control problems are often treated separately in conventional humanoid control algorithms. The control challenges mentioned above are probably the main reason for such separation. Here, planning refers to the process of finding consistent open-loop trajectories, which may take arbitrarily long computations off-line. Control, on the other hand, should be done very fast online to ensure stability. In this thesis, we want to link planning and control problems again and enable for online trajectory modification in a meaningful way. First, we propose a new way of describing robot geometries like molecules which breaks the complexity of conventional models. We use this technique and derive a planning algorithm that is fast enough to be used online for multi-contact motion planning. Similarly, we derive 3LP, a simplified linear three-mass model for bipedal walking, which offers orders of magnitude faster computations than full mechanical models. Next, we focus more on walking and use the 3LP model to formulate online control algorithms based on the foot-stepping strategy. The method is based on model predictive control, however, we also propose a faster controller with time-projection that demonstrates a close performance without numerical optimizations. We also deploy an efficient implementation of inverse dynamics together with advanced sensor fusion and actuator control algorithms to ensure a precise and compliant tracking of the simplified 3LP trajectories. Extensive simulations and hardware experiments on COMAN robot demonstrate effectiveness and strengths of our method. This thesis goes beyond humanoid walking applications. We further use the developed modeling tools to analyze and understand principles of human locomotion. Our 3LP model can describe the exchange of energy between human limbs in walking to some extent. We use this property to propose a metabolic-cost model of human walking which successfully describes trends in various conditions. The intrinsic power of the 3LP model to generate walking gaits in all these conditions makes it a handy solution for walking control and gait analysis, despite being yet a simplified model. To fill the reality gap, finally, we propose a kinematic conversion method that takes 3LP trajectories as input and generates more human-like postures. Using this method, the 3LP model, and the time-projecting controller, we introduce a graphical user interface in the end to simulate periodic and transient human-like walking conditions. We hope to use this combination in future to produce faster and more human-like walking gaits, possibly with more capable humanoid robots