6 research outputs found

    Reinforcement Learning Algorithms in Humanoid Robotics

    Get PDF

    Bipedal humanoid robot control by fuzzy adjustment of the reference walking plane

    Get PDF
    The two-legged humanoid structure has advantages for an assistive robot in the human living and working environment. A bipedal humanoid robot can avoid typical obstacles at homes and offices, reach consoles and appliances designed for human use and can be carried in human transport vehicles. Also, it is speculated that the absorption of robots in the human shape into the human society can be easier than that of other artificial forms. However, the control of bipedal walk is a challenge. Walking performance on solely even floor is not satisfactory. The complications of obtaining a balanced walk are dramatically more pronounced on uneven surfaces like inclined planes, which are quite commonly encountered in human surroundings. The difficulties lie in a variety of tasks ranging from sensor and data fusion to the design of adaptation systems which respond to changing surface conditions. This thesis presents a study on bipedal walk on inclined planes with changing slopes. A Zero Moment Point (ZMP) based gait synthesis technique is employed. The pitch angle reference for the foot sole plane −as expressed in a coordinate frame attached at the robot body − is adjusted online by a fuzzy logic system to adapt to different walking surface slopes. Average ankle pitch torques and the average value of the body pitch angle, computed over a history of a predetermined number of sampling instants, are used as the inputs to this system. The proposed control method is tested via walking experiments with the 29 degreesof- freedom (DOF) human-sized full-body humanoid robot SURALP (Sabanci University Robotics Research Laboratory Platform). Experiments are performed on even floor and inclined planes with different slopes. The results indicate that the approach presented is successful in enabling the robot to stably enter, ascend and leave inclined planes with 15 percent (8.5 degrees) grade. The thesis starts with a terminology section on bipedal walking and introduces a number of successful humanoid robot projects. A survey of control techniques for the walk on uneven surfaces is presented. The design and construction of the experimental robotic platform SURALP is discussed with the mechanical, electronic, walking reference generation and control aspects. The fuzzy reference adjustment system proposed for the walk on inclined planes is detailed and experimental results are presented

    Locomoção bípede adaptativa a partir de uma única demonstração usando primitivas de movimento

    Get PDF
    Doutoramento em Engenharia EletrotécnicaEste trabalho aborda o problema de capacidade de imitação da locomoção humana através da utilização de trajetórias de baixo nível codificadas com primitivas de movimento e utilizá-las para depois generalizar para novas situações, partindo apenas de uma demonstração única. Assim, nesta linha de pensamento, os principais objetivos deste trabalho são dois: o primeiro é analisar, extrair e codificar demonstrações efetuadas por um humano, obtidas por um sistema de captura de movimento de forma a modelar tarefas de locomoção bípede. Contudo, esta transferência não está limitada à simples reprodução desses movimentos, requerendo uma evolução das capacidades para adaptação a novas situações, assim como lidar com perturbações inesperadas. Assim, o segundo objetivo é o desenvolvimento e avaliação de uma estrutura de controlo com capacidade de modelação das ações, de tal forma que a demonstração única apreendida possa ser modificada para o robô se adaptar a diversas situações, tendo em conta a sua dinâmica e o ambiente onde está inserido. A ideia por detrás desta abordagem é resolver o problema da generalização a partir de uma demonstração única, combinando para isso duas estruturas básicas. A primeira consiste num sistema gerador de padrões baseado em primitivas de movimento utilizando sistemas dinâmicos (DS). Esta abordagem de codificação de movimentos possui propriedades desejáveis que a torna ideal para geração de trajetórias, tais como a possibilidade de modificar determinados parâmetros em tempo real, tais como a amplitude ou a frequência do ciclo do movimento e robustez a pequenas perturbações. A segunda estrutura, que está embebida na anterior, é composta por um conjunto de osciladores acoplados em fase que organizam as ações de unidades funcionais de forma coordenada. Mudanças em determinadas condições, como o instante de contacto ou impactos com o solo, levam a modelos com múltiplas fases. Assim, em vez de forçar o movimento do robô a situações pré-determinadas de forma temporal, o gerador de padrões de movimento proposto explora a transição entre diferentes fases que surgem da interação do robô com o ambiente, despoletadas por eventos sensoriais. A abordagem proposta é testada numa estrutura de simulação dinâmica, sendo que várias experiências são efetuadas para avaliar os métodos e o desempenho dos mesmos.This work addresses the problem of learning to imitate human locomotion actions through low-level trajectories encoded with motion primitives and generalizing them to new situations from a single demonstration. In this line of thought, the main objectives of this work are twofold: The first is to analyze, extract and encode human demonstrations taken from motion capture data in order to model biped locomotion tasks. However, transferring motion skills from humans to robots is not limited to the simple reproduction, but requires the evaluation of their ability to adapt to new situations, as well as to deal with unexpected disturbances. Therefore, the second objective is to develop and evaluate a control framework for action shaping such that the single-demonstration can be modulated to varying situations, taking into account the dynamics of the robot and its environment. The idea behind the approach is to address the problem of generalization from a single-demonstration by combining two basic structures. The first structure is a pattern generator system consisting of movement primitives learned and modelled by dynamical systems (DS). This encoding approach possesses desirable properties that make them well-suited for trajectory generation, namely the possibility to change parameters online such as the amplitude and the frequency of the limit cycle and the intrinsic robustness against small perturbations. The second structure, which is embedded in the previous one, consists of coupled phase oscillators that organize actions into functional coordinated units. The changing contact conditions plus the associated impacts with the ground lead to models with multiple phases. Instead of forcing the robot’s motion into a predefined fixed timing, the proposed pattern generator explores transition between phases that emerge from the interaction of the robot system with the environment, triggered by sensor-driven events. The proposed approach is tested in a dynamics simulation framework and several experiments are conducted to validate the methods and to assess the performance of a humanoid robot

    Humanoid Robots

    Get PDF
    For many years, the human being has been trying, in all ways, to recreate the complex mechanisms that form the human body. Such task is extremely complicated and the results are not totally satisfactory. However, with increasing technological advances based on theoretical and experimental researches, man gets, in a way, to copy or to imitate some systems of the human body. These researches not only intended to create humanoid robots, great part of them constituting autonomous systems, but also, in some way, to offer a higher knowledge of the systems that form the human body, objectifying possible applications in the technology of rehabilitation of human beings, gathering in a whole studies related not only to Robotics, but also to Biomechanics, Biomimmetics, Cybernetics, among other areas. This book presents a series of researches inspired by this ideal, carried through by various researchers worldwide, looking for to analyze and to discuss diverse subjects related to humanoid robots. The presented contributions explore aspects about robotic hands, learning, language, vision and locomotion
    corecore