Analysis of Human Push Recovery Motions Based on Optimization

The ability to cope with large perturbations is essential to avoid falling for humans as well as for humanoid robots. Every day millions of people are affected by injuries due to falling. This is a huge problem not only for the individuum but also for the society as it costs the health care systems billions of euros. Also in the field of humanoid robots fall avoidance is very important as it protects robots against breakage. In this thesis, the problem of fall avoidance is addressed using a combination of optimization, human-modeling and recorded push recovery motions. The aim is to identify the principles that lead to human-like push recovery motions. The human is modeled by rigid segments combined by joints leading to an underactuated multi-body representation. These models are included in multiple stage optimal control problems to reconstruct and sythesize human push recovery motions considering the dynamics of a human over the whole time horizon. Due to the high nonlinearity, the optimization problem is solved based on a direct multiple shooting method. To analyze the human push recovery motions, dynamically-consistent motions for the model that closely track experimental data are produced. The joint angles and joint torques for the human model controlled by joint torque derivatives are compared for perturbed and unperturbed motions from two subjects. The results verify the assumption that the heavier the perturbation is and the higher it is applied at the upper body, the larger are the resulting joint torques. We show that including optimally chosen spring-damper elements in the joints can reduce the active joint torques significantly. We further exploit our motion reconstruction approach to determine the states that are most affected during a perturbation. Relevant parameters such as the orientation and position of the head and body, joint angles and torques of the perturbed motions are analyzed for deviations to the unperturbed motions at the point in time when the push occurs. Identifying the point in time when the model states of the perturbed motions differ from the unperturbed motions, the reaction times are determined. To better understand human push recovery motions, we also investigate in a motion sythesis approach. This approach enables a control hypothesis, in the form of a specific objective function, to be formed. The minimization of effort combined with a periodicity formulation results in human-like motions and the influence of the push strength is analyzed. Formulating the objective function as a weighted linear combination of possible optimality criteria provides the possibility to analyze different optimality criteria and their resulting motion. The difficulty is, that for a given motion, it is not known, which criteria lead to that specific motion. In this thesis, the results for different basal objective functions are analyzed. These studies prepare to determine the optimal weights of the criteria by including the presented motion generation formulation in an inverse optimal control problem. Having analyzed general weights that lead to a good approximation of the human recovery motions, the resulting objective function can be used to generate push recovery motions also for humanoid robots or assistive devices such as exoskeletons. To show another application in the improvement of technical assistive devices, we include two combined human exoskeleton models of different weights in our calculations. This allows us to analyze the joint torques for these models including the exoskeletons and compare the results to a human model. As the resulting joint torques are quite large, we also formulate combined human exoskeleton models with passive spring-damper elements that act in parallel to the active torques. This compliant formulation leads to a significant reduction of the active joint torque needed for the recovery motion. The reduction of the active joint torques allows the reduction of energy needed for the recovery motion or can enable the recovery from stronger perturbations

Control of human gait stability through foot placement

During human walking, the centre of mass (CoM) is outside the base of support for most of the time, which poses a challenge to stabilizing the gait pattern. Nevertheless, most of us are able to walk without substantial problems. In this review, we aim to provide an integrative overview of how humans cope with an underactuated gait pattern. A central idea that emerges from the literature is that foot placement is crucial in maintaining a stable gait pattern. In this review, we explore this idea; we first describe mechanical models and concepts that have been used to predict how foot placement can be used to control gait stability. These concepts, such as for instance the extrapolated CoM concept, the foot placement estimator concept and the capture point concept, provide explicit predictions on where to place the foot relative to the body at each step, such that gait is stabilized. Next, we describe empirical findings on foot placement during human gait in unperturbed and perturbed conditions. We conclude that humans show behaviour that is largely in accordance with the aforementioned concepts, with foot placement being actively coordinated to body CoM kinematics during the preceding step. In this section, we also address the requirements for such control in terms of the sensory information and the motor strategies that can implement such control, as well as the parts of the central nervous system that may be involved. We show that visual, vestibular and proprioceptive information contribute to estimation of the state of the CoM. Foot placement is adjusted to variations in CoM state mainly by modulation of hip abductor muscle activity during the swing phase of gait, and this process appears to be under spinal and supraspinal, including cortical, control. We conclude with a description of how control of foot placement can be impaired in humans, using ageing as a primary example and with some reference to pathology, and we address alternative strategies available to stabilize gait, which include modulation of ankle moments in the stance leg and changes in body angular momentum, such as rapid trunk tilts. Finally, for future research, we believe that especially the integration of consideration of environmental constraints on foot placement with balance control deserves attention

Computational and Robotic Models of Human Postural Control

Currently, no bipedal robot exhibits fully human-like characteristics in terms of its postural control and movement. Current biped robots move more slowly than humans and are much less stable. Humans utilize a variety of sensory systems to maintain balance, primary among them being the visual, vestibular and proprioceptive systems. A key finding of human postural control experiments has been that the integration of sensory information appears to be dynamically regulated to adapt to changing environmental conditions and the available sensory information, a process referred to as "sensory re-weighting." In contrast, in robotics, the emphasis has been on controlling the location of the center of pressure based on proprioception, with little use of vestibular signals (inertial sensing) and no use of vision. Joint-level PD control with only proprioceptive feedback forms the core of robot standing balance control. More advanced schemes have been proposed but not yet implemented. The multiple sensory sources used by humans to maintain balance allow for more complex sensorimotor strategies not seen in biped robots, and arguably contribute to robust human balance function across a variety of environments and perturbations. Our goal is to replicate this robust human balance behavior in robots.In this work, we review results exploring sensory re-weighting in humans, through a series of experimental protocols, and describe implementations of sensory re-weighting in simulation and on a robot

A MECHANISTIC APPROACH TO POSTURAL DEVELOPMENT IN CHILDREN

Upright standing is intrinsically unstable and requires active control. The central nervous system's feedback process is the active control that integrates multi-sensory information to generate appropriate motor commands to control the plant (the body with its musculotendon actuators). Maintaining standing balance is not trivial for a developing child because the feedback and the plant are both developing and the sensory inputs used for feedback are continually changing. Knowledge gaps exist in characterizing the critical ability of adaptive multi-sensory reweighting for standing balance control in children. Furthermore, the separate contributions of the plant and feedback and their relationship are poorly understood in children, especially when considering that the body is multi-jointed and feedback is multi-sensory. The purposes of this dissertation are to use a mechanistic approach to study multi-sensory abilities of typically developing (TD) children and children with Developmental Coordination Disorder (DCD). The specific aims are: 1) to characterize postural control under different multi-sensory conditions in TD children and children with DCD; 2) to characterize the development of adaptive multi-sensory reweighting in TD children and children with DCD; and, 3) to identify the plant and feedback for postural control in TD children and how they change in response to visual reweighting. In the first experiment (Aim 1), TD children, adults, and 7-year-old children with DCD are tested under four sensory conditions (no touch/no vision, with touch/no vision, no touch/with vision, and with touch/with vision). We found that touch robustly attenuated standing sway in all age groups. Children with DCD used touch less effectively than their TD peers and they also benefited from using vision to reduce sway. In the second experiment (Aim 2), TD children (4- to 10-year-old) and children with DCD (6- to 11-year-old) were presented with simultaneous small-amplitude touch bar and visual scene movement at 0.28 and 0.2 Hz, respectively, within five conditions that independently varied the amplitude of the stimuli. We found that TD children can reweight to both touch and vision from 4 years on and the amount of reweighting increased with age. However, multi-sensory fusion (i.e., inter-modal reweighting) was only observed in the older children. Children with DCD reweight to both touch and vision at a later age (10.8 years) than their TD peers. Even older children with DCD do not show advanced multisensory fusion. Two signature deficits of multisensory reweighting are a weak vision reweighting and a general phase lag to both sensory modalities. The final aim involves closed-loop system identification of the plant and feedback using electromyography (EMG) and kinematic responses to a high- or low-amplitude visual perturbation and two mechanical perturbations in children ages six and ten years and adults. We found that the plant is different between children and adults. Children demonstrate a smaller phase difference between trunk and leg than adults at higher frequencies. Feedback in children is qualitatively similar to adults. Quantitatively, children show less phase advance at the peak of the feedback curve which may be due to a longer time delay. Under the high and low visual amplitude conditions, children show less gain change (interpreted as reweighting) than adults in the kinematic and EMG responses. The observed kinematic and EMG reweighting are mainly due to the different use of visual information by the central nervous system as measured by the open-loop mapping from visual scene angle to EMG activity. The plant and the feedback do not contribute to reweighting

Subtask Control in Human Locomotion

Maintenance of upright posture during walking is one the most important tasks to ensure flexible and stable mobility, along with speed adjustment, wayfinding and obstacle avoidance. These underlying functions, or subtasks, are simultaneously coordinated by the nervous system, which relies heavily on sensory feedback to obtain continual estimates of self-motion. This dissertation reports the findings of four experiments which made use of visual and mechanical perturbations to probe the interplay of these subtasks during treadmill walking. To confront the inherent nonlinearity of human gait, novel frequency domain analyses and impulse response functions that take into account phase of the gait cycle were used to characterize perturbation-response relationships. In the first experiment, transient visual scene motion was used to probe how visual input simultaneously influenced multiple subtasks, but at different phases of the gait cycle. In the second experiment, kinematics and muscle activity response variables showed an amplitude dependency on visual scene motion during walking that indicates vision is reweighted in a manner similar to standing posture. The third experiment used a metronome to constrain walking, revealing two time scales of locomotive control. The final experiment made use of both visual and mechanical perturbations simultaneously to probe the subtasks of postural orientation upright and positional maintenance on the treadmill. Doing so revealed that the nervous system prioritizes control of postural orientation over positional maintenance. In sum, this dissertation shows that sensory and mechanical perturbations provide insight as to how the nervous system controls coexisting, underlying functions during walking

Mechanisms of energy optimization in human walking

Humans can learn to move optimally. For many movements, we have a control strategy—or control policy—that optimizes some objective. In walking, we prefer the combination of step widths, step lengths, and speeds that optimizes the amount of energy we need. In familiar contexts, we have had many opportunities to establish this optimal control policy. But in new contexts, the nervous system must quickly learn new control policies in order to continue to move optimally. Our lab has recently demonstrated that humans can continuously optimize energetic cost during walking. This is an impressive feat given that the nervous system has tens of thousands of motor units at its disposal, and it can coordinate these motor units over millisecond timescales, which results in countless combinations of motor unit coordination. The goal of this thesis is to determine how the nervous system navigates this combinatorial problem to learn new energy optimal control policies in new walking contexts. I used three distinct studies to accomplish this goal. For the first two studies, I designed and implemented a simple mechatronic system that applies energetic penalties in the form of walking incline as a function of gait. This creates a new relationship between gait and energetic cost—or new cost landscape—that shifts the energy optimal gait. For the third study, I used exoskeletons that apply assistive torques to each ankle at each walking step to shift the energy optimal gait. The first study tested whether previous findings that people can learn to adapt their control policy when the energy optimum is shifted along step frequency generalize to a different gait parameter and to a different experimental setup. I found that, like step frequency, people can learn to adapt their control policy when the energy optimum is shifted along step width. The second study tested if and how energy optimization extends to multiple gait parameters at the same time. I found that, when the energy optimum is shifted along step width and step frequency, people are limited in their ability to optimize both gait parameters. The third study asked how people learn in which ways to optimize their policy. I found that general variability leads to specific adaptation toward optimal policies. Taken together, these findings provide insight into the mechanisms that underlie energy optimization in walking, as well as the limitations of this optimization