Imprecise dynamic walking with time-projection control

We present a new walking foot-placement controller based on 3LP, a 3D model of bipedal walking that is composed of three pendulums to simulate falling, swing and torso dynamics. Taking advantage of linear equations and closed-form solutions of the 3LP model, our proposed controller projects intermediate states of the biped back to the beginning of the phase for which a discrete LQR controller is designed. After the projection, a proper control policy is generated by this LQR controller and used at the intermediate time. This control paradigm reacts to disturbances immediately and includes rules to account for swing dynamics and leg-retraction. We apply it to a simulated Atlas robot in position-control, always commanded to perform in-place walking. The stance hip joint in our robot keeps the torso upright to let the robot naturally fall, and the swing hip joint tracks the desired footstep location. Combined with simple Center of Pressure (CoP) damping rules in the low-level controller, our foot-placement enables the robot to recover from strong pushes and produce periodic walking gaits when subject to persistent sources of disturbance, externally or internally. These gaits are imprecise, i.e., emergent from asymmetry sources rather than precisely imposing a desired velocity to the robot. Also in extreme conditions, restricting linearity assumptions of the 3LP model are often violated, but the system remains robust in our simulations. An extensive analysis of closed-loop eigenvalues, viable regions and sensitivity to push timings further demonstrate the strengths of our simple controller

Feedback Control of an Exoskeleton for Paraplegics: Toward Robustly Stable Hands-free Dynamic Walking

This manuscript presents control of a high-DOF fully actuated lower-limb exoskeleton for paraplegic individuals. The key novelty is the ability for the user to walk without the use of crutches or other external means of stabilization. We harness the power of modern optimization techniques and supervised machine learning to develop a smooth feedback control policy that provides robust velocity regulation and perturbation rejection. Preliminary evaluation of the stability and robustness of the proposed approach is demonstrated through the Gazebo simulation environment. In addition, preliminary experimental results with (complete) paraplegic individuals are included for the previous version of the controller.Comment: Submitted to IEEE Control System Magazine. This version addresses reviewers' concerns about the robustness of the algorithm and the motivation for using such exoskeleton

Don't break a leg: Running birds from quail to ostrich prioritise leg safety and economy in uneven terrain

Cursorial ground birds are paragons of bipedal running that span a 500-fold mass range from quail to ostrich. Here we investigate the task-level control priorities of cursorial birds by analysing how they negotiate single-step obstacles that create a conflict between body stability (attenuating deviations in body motion) and consistent leg force–length dynamics (for economy and leg safety). We also test the hypothesis that control priorities shift between body stability and leg safety with increasing body size, reflecting use of active control to overcome size-related challenges. Weight-support demands lead to a shift towards straighter legs and stiffer steady gait with increasing body size, but it remains unknown whether non-steady locomotor priorities diverge with size. We found that all measured species used a consistent obstacle negotiation strategy, involving unsteady body dynamics to minimise fluctuations in leg posture and loading across multiple steps, not directly prioritising body stability. Peak leg forces remained remarkably consistent across obstacle terrain, within 0.35 body weights of level running for obstacle heights from 0.1 to 0.5 times leg length. All species used similar stance leg actuation patterns, involving asymmetric force–length trajectories and posture-dependent actuation to add or remove energy depending on landing conditions. We present a simple stance leg model that explains key features of avian bipedal locomotion, and suggests economy as a key priority on both level and uneven terrain. We suggest that running ground birds target the closely coupled priorities of economy and leg safety as the direct imperatives of control, with adequate stability achieved through appropriately tuned intrinsic dynamics

Don't break a leg: Running birds from quail to ostrich prioritise leg safety and economy in uneven terrain

Cursorial ground birds are paragons of bipedal running that span a 500-fold mass range from quail to ostrich. Here we investigate the task-level control priorities of cursorial birds by analysing how they negotiate single-step obstacles that create a conflict between body stability (attenuating deviations in body motion) and consistent leg force–length dynamics (for economy and leg safety). We also test the hypothesis that control priorities shift between body stability and leg safety with increasing body size, reflecting use of active control to overcome size-related challenges. Weight-support demands lead to a shift towards straighter legs and stiffer steady gait with increasing body size, but it remains unknown whether non-steady locomotor priorities diverge with size. We found that all measured species used a consistent obstacle negotiation strategy, involving unsteady body dynamics to minimise fluctuations in leg posture and loading across multiple steps, not directly prioritising body stability. Peak leg forces remained remarkably consistent across obstacle terrain, within 0.35 body weights of level running for obstacle heights from 0.1 to 0.5 times leg length. All species used similar stance leg actuation patterns, involving asymmetric force–length trajectories and posture-dependent actuation to add or remove energy depending on landing conditions. We present a simple stance leg model that explains key features of avian bipedal locomotion, and suggests economy as a key priority on both level and uneven terrain. We suggest that running ground birds target the closely coupled priorities of economy and leg safety as the direct imperatives of control, with adequate stability achieved through appropriately tuned intrinsic dynamics

Learning Contact-Rich Manipulation Skills with Guided Policy Search

Autonomous learning of object manipulation skills can enable robots to acquire rich behavioral repertoires that scale to the variety of objects found in the real world. However, current motion skill learning methods typically restrict the behavior to a compact, low-dimensional representation, limiting its expressiveness and generality. In this paper, we extend a recently developed policy search method \cite{la-lnnpg-14} and use it to learn a range of dynamic manipulation behaviors with highly general policy representations, without using known models or example demonstrations. Our approach learns a set of trajectories for the desired motion skill by using iteratively refitted time-varying linear models, and then unifies these trajectories into a single control policy that can generalize to new situations. To enable this method to run on a real robot, we introduce several improvements that reduce the sample count and automate parameter selection. We show that our method can acquire fast, fluent behaviors after only minutes of interaction time, and can learn robust controllers for complex tasks, including putting together a toy airplane, stacking tight-fitting lego blocks, placing wooden rings onto tight-fitting pegs, inserting a shoe tree into a shoe, and screwing bottle caps onto bottles

New control strategies for neuroprosthetic systems

The availability of techniques to artificially excite paralyzed muscles opens enormous potential for restoring both upper and lower extremity movements with\ud neuroprostheses. Neuroprostheses must stimulate muscle, and control and regulate the artificial movements produced. Control methods to accomplish these tasks include feedforward (open-loop), feedback, and adaptive control. Feedforward control requires a great deal of information about the biomechanical behavior of the limb. For the upper extremity, an artificial motor program was developed to provide such movement program input to a neuroprosthesis. In lower extremity control, one group achieved their best results by attempting to meet naturally perceived gait objectives rather than to follow an exact joint angle trajectory. Adaptive feedforward control, as implemented in the cycleto-cycle controller, gave good compensation for the gradual decrease in performance observed with open-loop control. A neural network controller was able to control its system to customize stimulation parameters in order to generate a desired output trajectory in a given individual and to maintain tracking performance in the presence of muscle fatigue. The authors believe that practical FNS control systems must\ud exhibit many of these features of neurophysiological systems