1,287 research outputs found
Momentum Control with Hierarchical Inverse Dynamics on a Torque-Controlled Humanoid
Hierarchical inverse dynamics based on cascades of quadratic programs have
been proposed for the control of legged robots. They have important benefits
but to the best of our knowledge have never been implemented on a torque
controlled humanoid where model inaccuracies, sensor noise and real-time
computation requirements can be problematic. Using a reformulation of existing
algorithms, we propose a simplification of the problem that allows to achieve
real-time control. Momentum-based control is integrated in the task hierarchy
and a LQR design approach is used to compute the desired associated closed-loop
behavior and improve performance. Extensive experiments on various balancing
and tracking tasks show very robust performance in the face of unknown
disturbances, even when the humanoid is standing on one foot. Our results
demonstrate that hierarchical inverse dynamics together with momentum control
can be efficiently used for feedback control under real robot conditions.Comment: 21 pages, 11 figures, 4 tables in Autonomous Robots (2015
Exploring Restart Distributions
We consider the generic approach of using an experience memory to help
exploration by adapting a restart distribution. That is, given the capacity to
reset the state with those corresponding to the agent's past observations, we
help exploration by promoting faster state-space coverage via restarting the
agent from a more diverse set of initial states, as well as allowing it to
restart in states associated with significant past experiences. This approach
is compatible with both on-policy and off-policy methods. However, a caveat is
that altering the distribution of initial states could change the optimal
policies when searching within a restricted class of policies. To reduce this
unsought learning bias, we evaluate our approach in deep reinforcement learning
which benefits from the high representational capacity of deep neural networks.
We instantiate three variants of our approach, each inspired by an idea in the
context of experience replay. Using these variants, we show that performance
gains can be achieved, especially in hard exploration problems.Comment: RLDM 201
Balancing experiments on a torque-controlled humanoid with hierarchical inverse dynamics
Recently several hierarchical inverse dynamics controllers based on cascades
of quadratic programs have been proposed for application on torque controlled
robots. They have important theoretical benefits but have never been
implemented on a torque controlled robot where model inaccuracies and real-time
computation requirements can be problematic. In this contribution we present an
experimental evaluation of these algorithms in the context of balance control
for a humanoid robot. The presented experiments demonstrate the applicability
of the approach under real robot conditions (i.e. model uncertainty, estimation
errors, etc). We propose a simplification of the optimization problem that
allows us to decrease computation time enough to implement it in a fast torque
control loop. We implement a momentum-based balance controller which shows
robust performance in face of unknown disturbances, even when the robot is
standing on only one foot. In a second experiment, a tracking task is evaluated
to demonstrate the performance of the controller with more complicated
hierarchies. Our results show that hierarchical inverse dynamics controllers
can be used for feedback control of humanoid robots and that momentum-based
balance control can be efficiently implemented on a real robot.Comment: appears in IEEE/RSJ International Conference on Intelligent Robots
and Systems (IROS), 201
Negotiating Large Obstacles with a Humanoid Robot via Multi-Contact Motion Planning
Incremental progress in humanoid robot locomotion over the years has achieved essential capabilities such as navigation over
at or uneven terrain, stepping over small obstacles and imbing stairls. However, the locomotion research has mostly been limited to using only bipedal gait and only foot contacts with the environment, using the upper body for balancing without considering additional external contacts. As a result, challenging locomotion tasks like climbing over large obstacles relative to the size of the robot have remained unsolved. In this paper, we address this class of open problems with an approach based on multi-contact motion planning, guided by physical human demonstrations. Our goal is to make humanoid locomotion
problem more tractable by taking advantage of objects in the surrounding environment instead of avoiding them. We propose a multi-contact motion planning algorithm for humanoid robot locomotion which exploits the multi-contacts at the upper and lower body limbs. We propose a contact stability measure, which simplies the contact search from demonstration and
contact transition motion generation for the multi-contact motion planning algorithm. The algorithm uses the whole-body motions generated via Quadratic Programming (QP) based solver methods. The multi-contact motion planning algorithm is applied for a challenging task of climbing over a relatively larger obstacle compared to the robot. We validate our
planning approach with simulations and experiments for climbing over a large wooden obstacle with COMAN, which is a complaint humanoid robot with 23 degrees of freedom (DOF). We also propose a generalization method, the \Policy-Contraction Learning Method" to extend the algorithm for generating new multi-contact plans for our multi-contact motion planner, that can adapt to changes in the environment. The method learns a general policy and the multi-contact behavior from the human demonstrations, for generating new multi-contact plans for the obstacle-negotiation
Learning Task Priorities from Demonstrations
Bimanual operations in humanoids offer the possibility to carry out more than
one manipulation task at the same time, which in turn introduces the problem of
task prioritization. We address this problem from a learning from demonstration
perspective, by extending the Task-Parameterized Gaussian Mixture Model
(TP-GMM) to Jacobian and null space structures. The proposed approach is tested
on bimanual skills but can be applied in any scenario where the prioritization
between potentially conflicting tasks needs to be learned. We evaluate the
proposed framework in: two different tasks with humanoids requiring the
learning of priorities and a loco-manipulation scenario, showing that the
approach can be exploited to learn the prioritization of multiple tasks in
parallel.Comment: Accepted for publication at the IEEE Transactions on Robotic
Synthesis of Subject-Specific Human Balance Responses using a Task-Level Neuromuscular Control Platform
Many activities of daily living require a high level of neuromuscular coordination and balance control to avoid falls. Complex musculoskeletal models paired with detailed neuromuscular simulations complement experimental studies and uncover principles of coordinated and uncoordinated movements. Here, we created a closed-loop forward dynamic simulation framework that utilizes a detailed musculoskeletal model (19 degrees of freedom, and 92 Muscles) to synthesize human balance responses after support-surface perturbation. In addition, surrogate response models of task-level experimental kinematics from two healthy subjects were provided as inputs to our closedloop simulations to inform the design of the task-level controller. The predicted muscle EMGs and the resulting synthesized subject joint angles showed good conformity with the average of experimental trials. The simulated whole-body center of mass displacements, generated from a single kinematics trial per perturbation direction, were on average, within 7 mm (anterior perturbations) and 13 mm (posterior perturbations) of experimental displacements. Our results confirmed how a complex subject-specific movement can be reconstructed by sequencing and prioritizing multiple task-level commands to achieve desired movements. By combining the multidisciplinary approaches of robotics and biomechanics, the platform demonstrated here offers great potential for studying human movement control and subject-specific outcome prediction
- …