173 research outputs found
Push recovery with stepping strategy based on time-projection control
In this paper, we present a simple control framework for on-line push
recovery with dynamic stepping properties. Due to relatively heavy legs in our
robot, we need to take swing dynamics into account and thus use a linear model
called 3LP which is composed of three pendulums to simulate swing and torso
dynamics. Based on 3LP equations, we formulate discrete LQR controllers and use
a particular time-projection method to adjust the next footstep location
on-line during the motion continuously. This adjustment, which is found based
on both pelvis and swing foot tracking errors, naturally takes the swing
dynamics into account. Suggested adjustments are added to the Cartesian 3LP
gaits and converted to joint-space trajectories through inverse kinematics.
Fixed and adaptive foot lift strategies also ensure enough ground clearance in
perturbed walking conditions. The proposed structure is robust, yet uses very
simple state estimation and basic position tracking. We rely on the physical
series elastic actuators to absorb impacts while introducing simple laws to
compensate their tracking bias. Extensive experiments demonstrate the
functionality of different control blocks and prove the effectiveness of
time-projection in extreme push recovery scenarios. We also show self-produced
and emergent walking gaits when the robot is subject to continuous dragging
forces. These gaits feature dynamic walking robustness due to relatively soft
springs in the ankles and avoiding any Zero Moment Point (ZMP) control in our
proposed architecture.Comment: 20 pages journal pape
Fast biped walking with a neuronal controller and physical computation
Biped walking remains a difficult problem and robot models can
greatly {facilitate} our understanding of the underlying
biomechanical principles as well as their neuronal control. The
goal of this study is to specifically demonstrate that stable
biped walking can be achieved by combining the physical properties
of the walking robot with a small, reflex-based neuronal network,
which is governed mainly by local sensor signals. This study shows
that human-like gaits emerge without {specific} position or
trajectory control and that the walker is able to compensate small
disturbances through its own dynamical properties. The reflexive
controller used here has the following characteristics, which are
different from earlier approaches: (1) Control is mainly local.
Hence, it uses only two signals (AEA=Anterior Extreme Angle and
GC=Ground Contact) which operate at the inter-joint level. All
other signals operate only at single joints. (2) Neither position
control nor trajectory tracking control is used. Instead, the
approximate nature of the local reflexes on each joint allows the
robot mechanics itself (e.g., its passive dynamics) to contribute
substantially to the overall gait trajectory computation. (3) The
motor control scheme used in the local reflexes of our robot is
more straightforward and has more biological plausibility than
that of other robots, because the outputs of the motorneurons in
our reflexive controller are directly driving the motors of the
joints, rather than working as references for position or velocity
control. As a consequence, the neural controller and the robot
mechanics are closely coupled as a neuro-mechanical system and
this study emphasises that dynamically stable biped walking gaits
emerge from the coupling between neural computation and physical
computation. This is demonstrated by different walking
experiments using two real robot as well as by a Poincar\'{e} map
analysis applied on a model of the robot in order to assess its
stability. In addition, this neuronal control structure allows the
use of a policy gradient reinforcement learning algorithm to tune
the parameters of the neurons in real-time, during walking. This
way the robot can reach a record-breaking walking speed of 3.5
leg-lengths per second after only a few minutes of online
learning, which is even comparable to the fastest relative speed
of human walking
Feedback Control of an Exoskeleton for Paraplegics: Toward Robustly Stable Hands-free Dynamic Walking
This manuscript presents control of a high-DOF fully actuated lower-limb
exoskeleton for paraplegic individuals. The key novelty is the ability for the
user to walk without the use of crutches or other external means of
stabilization. We harness the power of modern optimization techniques and
supervised machine learning to develop a smooth feedback control policy that
provides robust velocity regulation and perturbation rejection. Preliminary
evaluation of the stability and robustness of the proposed approach is
demonstrated through the Gazebo simulation environment. In addition,
preliminary experimental results with (complete) paraplegic individuals are
included for the previous version of the controller.Comment: Submitted to IEEE Control System Magazine. This version addresses
reviewers' concerns about the robustness of the algorithm and the motivation
for using such exoskeleton
A Bio-inspired architecture for adaptive quadruped locomotion over irregular terrain
Tese de doutoramento
Programa Doutoral em Engenharia Electrónica e de ComputadoresThis thesis presents a tentative advancement on walking control of small quadruped and humanoid
position controlled robots, addressing the problem of walk generation by combining dynamical systems
approach to motor control, insights from neuroethology research on vertebrate motor control and
computational neuroscience.
Legged locomotion is a complex dynamical process, despite the seemingly easy and natural behavior
of the constantly present proficiency of legged animals. Research on locomotion and motor control
in vertebrate animals from the last decades has brought to the attention of roboticists, the potential of
the nature’s solutions to robot applications. Recent knowledge on the organization of complex motor
generation and on mechanics and dynamics of locomotion has been successfully exploited to pursue
agile robot locomotion.
The work presented on this manuscript is part of an effort on the pursuit in devising a general,
model free solution, for the generation of robust and adaptable walking behaviors. It strives to devise a
practical solution applicable to real robots, such as the Sony’s quadruped AIBO and Robotis’ DARwIn-
OP humanoid. The discussed solutions are inspired on the functional description of the vertebrate
neural systems, especially on the concept of Central Pattern Generators (CPGs), their structure and
organization, components and sensorimotor interactions. They use a dynamical systems approach for
the implementation of the controller, especially on the use of nonlinear oscillators and exploitation of
their properties.
The main topics of this thesis are divided into three parts.
The first part concerns quadruped locomotion, extending a previous CPG solution using nonlinear
oscillators, and discussing an organization on three hierarchical levels of abstraction, sharing the purpose
and knowledge of other works. It proposes a CPG solution which generates the walking motion
for the whole-leg, which is then organized in a network for the production of quadrupedal gaits. The
devised solution is able to produce goal-oriented locomotion and navigation as directed through highlevel
commands from local planning methods. In this part, active balance on a standing quadruped is
also addressed, proposing a method based on dynamical systems approach, exploring the integration of
parallel postural mechanisms from several sensory modalities. The solutions are all successfully tested on the quadruped AIBO robot.
In the second part, is addressed bipedal walking for humanoid robots. A CPG solution for biped
walking based on the concept of motion primitives is proposed, loosely based on the idea of synergistic
organization of vertebrate motor control. A set of motion primitives is shown to produce the basis
of simple biped walking, and generalizable to goal-oriented walking. Using the proposed CPG, the
inclusion of feedback mechanisms is investigated, for modulation and adaptation of walking, through
phase transition control according to foot load information. The proposed solution is validated on the
humanoid DARwIn-OP, and its application is evaluated within a whole-body control framework.
The third part sidesteps a little from the other two topics. It discusses the CPG as having an alternative
role to direct motor generation in locomotion, serving instead as a processor of sensory information
for a feedback based motor generation. In this work a reflex based walking controller is devised for the
compliant quadruped Oncilla robot, to serve as purely feedback based walking generation. The capabilities
of the reflex network are shown in simulations, followed by a brief discussion on its limitations,
and how they could be improved by the inclusion of a CPG.Esta tese apresenta uma tentativa de avanço no controlo de locomoção para pequenos robôs quadrúpedes
e bipedes controlados por posição, endereçando o problema de geração motora através da combinação
da abordagem de sistemas dinâmicos para o controlo motor, e perspectivas de investigação
neuroetologia no controlo motor vertebrado e neurociência computacional.
Andar é um processo dinâmico e complexo, apesar de parecer um comportamento fácil e natural
devido à presença constante de animais proficientes em locomoção terrestre. Investigação na área da locomoção
e controlo motor em animais vertebrados nas últimas decadas, trouxe à atenção dos roboticistas
o potencial das soluções encontradas pela natureza aplicadas a aplicações robóticas. Conhecimento
recente relativo à geração de comportamentos motores complexos e da mecânica da locomoção tem
sido explorada com sucesso na procura de locomoção ágil na robótica.
O trabalho apresentado neste documento é parte de um esforço no desenho de uma solução geral,
e independente de modelos, para a geração robusta e adaptável de comportamentos locomotores. O
foco é desenhar uma solução prática, aplicável a robôs reais, tal como o quadrúpede Sony AIBO e
o humanóide DARwIn-OP. As soluções discutidas são inspiradas na descrição funcional do sistema
nervoso vertebrado, especialmente no conceito de Central Pattern Generators (CPGs), a sua estrutura e
organização, componentes e interacção sensorimotora. Estas soluções são implementadas usando uma
abordagem em sistemas dinâmicos, focandos o uso de osciladores não lineares e a explorando as suas
propriedades.
Os tópicos principais desta tese estão divididos em três partes.
A primeira parte explora o tema de locomoção quadrúpede, expandindo soluções prévias de CPGs
usando osciladores não lineares, e discutindo uma organização em três níveis de abstracção, partilhando
as ideias de outros trabalhos. Propõe uma solução de CPG que gera os movimentos locomotores
para uma perna, que é depois organizado numa rede, para a produção de marcha quadrúpede. A
solução concebida é capaz de produzir locomoção e navegação, comandada através de comandos de alto
nível, produzidos por métodos de planeamento local. Nesta parte também endereçado o problema da
manutenção do equilíbrio num robô quadrúpede parado, propondo um método baseado na abordagem
em sistemas dinâmicos, explorando a integração de mecanismos posturais em paralelo, provenientes de várias modalidades sensoriais. As soluções são todas testadas com sucesso no robô quadrupede AIBO.
Na segunda parte é endereçado o problema de locomoção bípede. É proposto um CPG baseado
no conceito de motion primitives, baseadas na ideia de uma organização sinergética do controlo motor
vertebrado. Um conjunto de motion primitives é usado para produzir a base de uma locomoção bípede
simples e generalizável para navegação. Esta proposta de CPG é usada para de seguida se investigar
a inclusão de mecanismos de feedback para modulação e adaptação da marcha, através do controlo de
transições entre fases, de acordo com a informação de carga dos pés. A solução proposta é validada
no robô humanóide DARwIn-OP, e a sua aplicação no contexto do framework de whole-body control é
também avaliada.
A terceira parte desvia um pouco dos outros dois tópicos. Discute o CPG como tendo um papel
alternativo ao controlo motor directo, servindo em vez como um processador de informação sensorial
para um mecanismo de locomoção puramente em feedback. Neste trabalho é desenhado um controlador
baseado em reflexos para a geração da marcha de um quadrúpede compliant. As suas capacidades são
demonstradas em simulação, seguidas por uma breve discussão nas suas limitações, e como estas podem
ser ultrapassadas pela inclusão de um CPG.The presented work was possible thanks to the support by the Portuguese Science and Technology Foundation through the PhD grant SFRH/BD/62047/2009
Analytic and Learned Footstep Control for Robust Bipedal Walking
Bipedal walking is a complex, balance-critical whole-body motion with inherently unstable inverted pendulum-like dynamics. Strong disturbances must be quickly responded to by altering the walking motion and placing the next step in the right place at the right time. Unfortunately, the high number of degrees of freedom of the humanoid body makes the fast computation of well-placed steps a particularly challenging task. Sensor noise, imprecise actuation, and latency in the sensomotoric feedback loop impose further challenges when controlling real hardware. This dissertation addresses these challenges and describes a method of generating a robust walking motion for bipedal robots. Fast modification of footstep placement and timing allows agile control of the walking velocity and the absorption of strong disturbances. In a divide and conquer manner, the concepts of motion and balance are solved separately from each other, and consolidated in a way that a low-dimensional balance controller controls the timing and the footstep locations of a high-dimensional motion generator. Central pattern generated oscillatory motion signals are used for the synthesis of an open-loop stable walk on flat ground, which lacks the ability to respond to disturbances due to the absence of feedback. The Central Pattern Generator exhibits a low-dimensional parameter set to influence the timing and the landing coordinates of the swing foot. For balance control, a simple inverted pendulum-based physical model is used to represent the principal dynamics of walking. The model is robust to disturbances in a way that it returns to an ideal trajectory from a wide range of initial conditions by employing a combination of Zero Moment Point control, step timing, and foot placement strategies. The simulation of the model and its controller output are computed efficiently in closed form, supporting high-frequency balance control at the cost of an insignificant computational load. Additionally, the sagittal step size produced by the controller can be trained online during walking with a novel, gradient descent-based machine learning method. While the analytic controller forms the core of reliable walking, the trained sagittal step size complements the analytic controller in order to improve the overall walking performance. The balanced whole-body walking motion arises by using the footstep coordinates and the step timing predicted by the low-dimensional model as control input for the Central Pattern Generator. Real robot experiments are presented as evidence for disturbance-resistant, omnidirectional gait control, with arguably the strongest push-recovery capabilities to date
Recommended from our members
Control Implementation of Dynamic Locomotion on Compliant, Underactuated, Force-Controlled Legged Robots with Non-Anthropomorphic Design
The control of locomotion on legged robots traditionally involves a robot that takes a standard legged form, such as the anthropomorphic humanoid, the dog-like quadruped, or the bird-like biped. Additionally, these systems will often be actuated with position-controlled servos or series-elastic actuators that are connected through rigid links. This work investigates the control implementation of dynamic, force-controlled locomotion on a family of legged systems that significantly deviate from these classic paradigms by incorporating modern, state-of-the-art proprioceptive actuators on uniquely configured compliant legs that do not closely resemble those found in nature. The results of this work can be used to better inform how to implement controllers on legged systems without stiff, position-controlled actuators, and also provide insight on how intelligently designed mechanical features can potentially simplify the control of complex, nonlinear dynamical systems like legged robots. To this end, this work presents the approach to control for a family of non-anthropomorphic bipedal robotic systems which are developed both in simulation and with physical hardware. The first is the Non-Anthropomorphic Biped, Version 1 (NABi-1) that features position-controlled joints along with a compliant foot element on a minimally actuated leg, and is controlled using simple open-loop trajectories based on the Zero Moment Point. The second system is the second version of the non-anthropomorphic biped (NABi-2) which utilizes the proprioceptive Back-drivable Electromagnetic Actuator for Robotics (BEAR) modules for actuation and fully realizes feedback-based force controlled locomotion. These systems are used to highlight both the strengths and weaknesses of utilizing proprioceptive actuation in systems, and suggest the tradeoffs that are made when using force control for dynamic locomotion. These systems also present case studies for different approaches to system design when it comes to bipedal legged robots
Applied optimal control for dynamically stable legged locomotion
Thesis (Ph. D.)--Massachusetts Institute of Technology, Dept. of Electrical Engineering and Computer Science, 2004.Includes bibliographical references (p. 79-84).Online learning and controller adaptation will be an essential component for legged robots in the next few years as they begin to leave the laboratory setting and join our world. I present the first example of a learning system which is able to quickly and reliably acquire a robust feedback control policy for 3D dynamic bipedal walking from a blank slate using only trials implemented on the physical robot. The robot begins walking within a minute and learning converges in approximately 20 minutes. The learning works quickly enough that the robot is able to continually adapt to the terrain as it walks. This success can be attributed in part to the mechanics of our robot, which is capable of stable walking down a small ramp even when the computer is turned off. In this thesis, I analyze the dynamics of passive dynamic walking, starting with reduced planar models and working up to experiments on our real robot. I describe, in detail, the actor-critic reinforcement learning algorithm that is implemented on the return map dynamics of the biped. Finally, I address issues of scaling and controller augmentation using tools from optimal control theory and a simulation of a planar one-leg hopping robot. These learning results provide a starting point for the production of robust and energy efficient walking and running robots that work well initially, and continue to improve with experience.by Russell L. Tedrake.Ph.D
Humanoid Robots
For many years, the human being has been trying, in all ways, to recreate the complex mechanisms that form the human body. Such task is extremely complicated and the results are not totally satisfactory. However, with increasing technological advances based on theoretical and experimental researches, man gets, in a way, to copy or to imitate some systems of the human body. These researches not only intended to create humanoid robots, great part of them constituting autonomous systems, but also, in some way, to offer a higher knowledge of the systems that form the human body, objectifying possible applications in the technology of rehabilitation of human beings, gathering in a whole studies related not only to Robotics, but also to Biomechanics, Biomimmetics, Cybernetics, among other areas. This book presents a series of researches inspired by this ideal, carried through by various researchers worldwide, looking for to analyze and to discuss diverse subjects related to humanoid robots. The presented contributions explore aspects about robotic hands, learning, language, vision and locomotion
A comprehensive gaze stabilization controller based on cerebellar internal models
Gaze stabilization is essential for clear vision; it is the combined effect of two reflexes relying on vestibular inputs: the vestibulocollic reflex (VCR), which stabilizes the head in space and the vestibulo-ocular reflex (VOR), which stabilizes the visual axis to minimize retinal image motion. The VOR works in conjunction with the opto-kinetic reflex (OKR), which is a visual feedback mechanism that allows the eye to move at the same speed as the observed scene. Together they keep the image stationary on the retina. In this work, we implement on a humanoid robot a model of gaze stabilization based on the coordination of VCR, VOR and OKR. The model, inspired by neuroscientific cerebellar theories, is provided with learning and adaptation capabilities based on internal models. We present the results for the gaze stabilization model on three sets of experiments conducted on the SABIAN robot and on the iCub simulator, validating the robustness of the proposed control method. The first set of experiments focused on the controller response to a set of disturbance frequencies along the vertical plane. The second shows the performances of the system under three-dimensional disturbances. The last set of experiments was carried out to test the capability of the proposed model to stabilize the gaze in locomotion tasks. The results confirm that the proposed model is beneficial in all cases reducing the retinal slip (velocity of the image on the retina) and keeping the orientation of the head stable
- …