Predicting the motions and forces of wearable robotic systems using optimal control

Wearable robotic systems are being developed to prevent injury to the low back. Designing a wearable robotic system is challenging because it is difficult to predict how the exoskeleton will affect the movement of the wearer. To aid the design of exoskeletons, we formulate and numerically solve an optimal control problem (OCP) to predict the movements and forces of a person as they lift a 15 kg box from the ground both without (human-only OCP) and with (with-exo OCP) the aid of an exoskeleton. We model the human body as a sagittal-plane multibody system that is actuated by agonist and antagonist pairs of muscle torque generators (MTGs) at each joint. Using the literature as a guide, we have derived a set of MTGs that capture the active torque–angle, passive torque–angle, and torque–velocity characteristics of the flexor and extensor groups surrounding the hip, knee, ankle, lumbar spine, shoulder, elbow, and wrist. Uniquely, these MTGs are continuous to the second derivative and so are compatible with gradient-based optimization. The exoskeleton is modeled as a rigid-body mechanism that is actuated by a motor at the hip and the lumbar spine and is coupled to the wearer through kinematic constraints. We evaluate our results by comparing our predictions with experimental recordings of a human subject. Our results indicate that the predicted peak lumbar-flexion angles and extension torques of the human-only OCP are within the range reported in the literature. The results of the with-exo OCP indicate that the exoskeleton motors should provide relatively little support during the descent to the box but apply a substantial amount of support during the ascent phase. The support provided by the lumbar motor is similar in shape to the net moment generated at the L5/S1 joint by the body; however, the support of the hip motor is more complex because it is coupled to the passive forces that are being generated by the hip extensors of the human subject. The simulations developed in this study are specific to lifting motion and a lower back exoskeleton. However, the framework is applicable for simulating a large range of robotic-assisted human motions

Modeling of human movement for the generation of humanoid robot motion

La robotique humanoïde arrive a maturité avec des robots plus rapides et plus précis. Pour faire face à la complexité mécanique, la recherche a commencé à regarder au-delà du cadre habituel de la robotique, vers les sciences de la vie, afin de mieux organiser le contrôle du mouvement. Cette thèse explore le lien entre mouvement humain et le contrôle des systèmes anthropomorphes tels que les robots humanoïdes. Tout d’abord, en utilisant des méthodes classiques de la robotique, telles que l’optimisation, nous étudions les principes qui sont à la base de mouvements répétitifs humains, tels que ceux effectués lorsqu’on joue au yoyo. Nous nous concentrons ensuite sur la locomotion en nous inspirant de résultats en neurosciences qui mettent en évidence le rôle de la tête dans la marche humaine. En développant une interface permettant à un utilisateur de commander la tête du robot, nous proposons une méthode de contrôle du mouvement corps-complet d’un robot humanoïde, incluant la production de pas et permettant au corps de suivre le mouvement de la tête. Cette idée est poursuivie dans l’étude finale dans laquelle nous analysons la locomotion de sujets humains, dirigée vers une cible, afin d’extraire des caractéristiques du mouvement sous forme invariants. En faisant le lien entre la notion “d’invariant” en neurosciences et celle de “tâche cinématique” en robotique humanoïde, nous développons une méthode pour produire une locomotion réaliste pour d’autres systèmes anthropomorphes. Dans ce cas, les résultats sont illustrés sur le robot humanoïde HRP2 du LAAS-CNRS. La contribution générale de cette thèse est de montrer que, bien que la planification de mouvement pour les robots humanoïdes peut être traitée par des méthodes classiques de robotique, la production de mouvements réalistes nécessite de combiner ces méthodes à l’observation systématique et formelle du comportement humain. ABSTRACT : Humanoid robotics is coming of age with faster and more agile robots. To compliment the physical complexity of humanoid robots, the robotics algorithms being developed to derive their motion have also become progressively complex. The work in this thesis spans across two research fields, human neuroscience and humanoid robotics, and brings some ideas from the former to aid the latter. By exploring the anthropological link between the structure of a human and that of a humanoid robot we aim to guide conventional robotics methods like local optimization and task-based inverse kinematics towards more realistic human-like solutions. First, we look at dynamic manipulation of human hand trajectories while playing with a yoyo. By recording human yoyo playing, we identify the control scheme used as well as a detailed dynamic model of the hand-yoyo system. Using optimization this model is then used to implement stable yoyo-playing within the kinematic and dynamic limits of the humanoid HRP-2. The thesis then extends its focus to human and humanoid locomotion. We take inspiration from human neuroscience research on the role of the head in human walking and implement a humanoid robotics analogy to this. By allowing a user to steer the head of a humanoid, we develop a control method to generate deliberative whole-body humanoid motion including stepping, purely as a consequence of the head movement. This idea of understanding locomotion as a consequence of reaching a goal is extended in the final study where we look at human motion in more detail. Here, we aim to draw to a link between “invariants” in neuroscience and “kinematic tasks” in humanoid robotics. We record and extract stereotypical characteristics of human movements during a walking and grasping task. These results are then normalized and generalized such that they can be regenerated for other anthropomorphic figures with different kinematic limits than that of humans. The final experiments show a generalized stack of tasks that can generate realistic walking and grasping motion for the humanoid HRP-2. The general contribution of this thesis is in showing that while motion planning for humanoid robots can be tackled by classical methods of robotics, the production of realistic movements necessitate the combination of these methods with the systematic and formal observation of human behavior

Walking Paths to and from a Goal Differ: On the Role of Bearing Angle in the Formation of Human Locomotion Paths

The path that humans take while walking to a goal is the result of a cognitive process modulated by the perception of the environment and physiological constraints. The path shape and timing implicitly embeds aspects of the architecture behind this process. Here, locomotion paths were investigated during a simple task of walking to and from a goal, by looking at the evolution of the position of the human on a horizontal (x,y) plane. We found that the path while walking to a goal was not the same as that while returning from it. Forward-return paths were systematically separated by 0.5-1.9m, or about 5% of the goal distance. We show that this path separation occurs as a consequence of anticipating the desired body orientation at the goal while keeping the target in view. The magnitude of this separation was strongly influenced by the bearing angle (difference between body orientation and angle to goal) and the final orientation imposed at the goal. This phenomenon highlights the impact of a trade-off between a directional perceptual apparatus-eyes in the head on the shoulders-and and physiological limitations, in the formation of human locomotion paths. Our results give an insight into the influence of environmental and perceptual variables on human locomotion and provide a basis for further mathematical study of these mechanisms

Motion optimization and parameter identification for a human and lower-back exoskeleton model

Designing an exoskeleton to reduce the risk of low-back injury during lifting is challenging. Computational models of the human-robot system coupled with predictive movement simulations can help to simplify this design process. Here, we present a study that models the interaction between a human model actuated by muscles and a lower-back exoskeleton. We provide a computational framework for identifying the spring parameters of the exoskeleton using an optimal control approach and forward-dynamics simulations. This is applied to generate dynamically consistent bending and lifting movements in the sagittal plane. Our computations are able to predict motions and forces of the human and exoskeleton that are within the torque limits of a subject. The identified exoskeleton could also yield a considerable reduction of the peak lower-back torques as well as the cumulative lower-back load during the movements. This work is relevant to the research communities working on human-robot interaction, and can be used as a basis for a better human-centered design process

Predicting the influence of hip and lumbar flexibility on lifting motions using optimal control

Computational models of the human body coupled with optimization can be used to predict the influence of variables that cannot be experimentally manipulated. Here, we present a study that predicts the motion of the human body while lifting a box, as a function of flexibility of the hip and lumbar joints in the sagittal plane. We modeled the human body in the sagittal plane with joints actuated by pairs of agonist-antagonist muscle torque generators, and a passive hamstring muscle. The characteristics of a stiff, average and flexible person were represented by co-varying the lumbar range-of-motion, lumbar passive extensor-torque and the hamstring passive muscle-force. We used optimal control to solve for motions that simulated lifting a 10 kg box from a 0.3 m height. The solution minimized the total sum of the normalized squared active and passive muscle torques and the normalized passive hamstring muscle forces, over the duration of the motion. The predicted motion of the average lifter agreed well with experimental data in the literature. The change in model flexibility affected the predicted joint angles, with the stiffer models flexing more at the hip and knee, and less at the lumbar joint, to complete the lift. Stiffer models produced similar passive lumbar torque and higher hamstring muscle force components than the more flexible models. The variation between the motion characteristics of the models suggest that flexibility may play an important role in determining lifting technique

Inverse optimal control as a tool to understand human yoyo playing

This paper presents an inverse optimal control approach to identify objective functions of human motion from motion capture measurements. We apply it to analyze human yoyo playing. Yoyo playing may seem easy to us to learn but it is a challenging problem from a mechanical point of view involving a hybrid dynamics model. We recorded vertical yoyo playing of humans measuring yoyo height and rotation angle as well as the corresponding hand motions. Results of inverse optimal control are presented showing a mixed criterion of cycle time and terms depending on yoyo and hand acceleration and velocity

HRP-2 plays the yoyo: From human to humanoid yoyo playing using optimal control

Yoyo playing may seem easy for a human, but it is a challenging problem for a humanoid robot. This paper presents an approach to generate yoyo motions for the humanoid robot, HRP-2, based on motion recorded from human yoyo playing, dynamical models and numerical optimal control techniques. We recorded vertical yoyo playing of 4 subjects measuring yoyo height and rotation angle as well as the corresponding hand motions. A detailed multi-phase yoyo model with impact collisions and control patterns of human yoyo playing were identified from these measurements. Based on this knowledge, reliable yoyo motions within the feasibility ranges of HRP-2 were generated using optimal control. The resulting motions have been implemented on the robot using open-loop and event-based quasi open-loop control strategies