Lower limb stiffness estimation during running: the effect of using kinematic constraints in muscle force optimization algorithms

The focus of this paper is on the effect of muscle force optimization algorithms on the human lower limb stiffness estimation. By using a forward dynamic neuromusculoskeletal model coupled with a muscle short-range stiffness model we computed the human joint stiffness of the lower limb during running. The joint stiffness values are calculated using two different muscle force optimization procedures, namely: Toque-based and Torque/Kinematic-based algorithm. A comparison between the processed EMG signal and the corresponding estimated muscle forces with the two optimization algorithms is provided. We found that the two stiffness estimates are strongly influenced by the adopted algorithm. We observed different magnitude and timing of both the estimated muscle forces and joint stiffness time profile with respect to each gait phase, as function of the optimization algorithm used

Estimation of Gait Kinematics and Kinetics from Inertial Sensor Data Using Optimal Control of Musculoskeletal Models

Inertial sensing enables field studies of human movement and ambulant assessment of patients. However, the challenge is to obtain a comprehensive analysis from low-quality data and sparse measurements. In this paper, we present a method to estimate gait kinematics and kinetics directly from raw inertial sensor data performing a single dynamic optimization. We formulated an optimal control problem to track accelerometer and gyroscope data with a planar musculoskeletal model. In addition, we minimized muscular effort to ensure a unique solution and to prevent the model from tracking noisy measurements too closely. For evaluation, we recorded data of ten subjects walking and running at six different speeds using seven inertial measurement units (IMUs). Results were compared to a conventional analysis using optical motion capture and a force plate. High correlations were achieved for gait kinematics (rho \u3e= 0.93) and kinetics (rho \u3e= 0.90). In contrast to existing IMU processing methods, a dynamically consistent simulation was obtained and we were able to estimate running kinetics. Besides kinematics and kinetics, further metrics such as muscle activations and metabolic cost can be directly obtained from simulated model movements. In summary, the method is insensitive to sensor noise and drift and provides a detailed analysis solely based on inertial sensor data

Simulation And Control At the Boundaries Between Humans And Assistive Robots

Human-machine interaction has become an important area of research as progress is made in the fields of rehabilitation robotics, powered prostheses, and advanced exercise machines. Adding to the advances in this area, a novel controller for a powered transfemoral prosthesis is introduced that requires limited tuning and explicitly considers energy regeneration. Results from a trial conducted with an individual with an amputation show self-powering operation for the prosthesis while concurrently attaining basic gait fidelity across varied walking speeds. Experience in prosthesis development revealed that, though every effort is made to ensure the safety of the human subject, limited testing of such devices prior to human trials can be completed in the current research environment. Two complementary alternatives are developed to fill that gap. First, the feasibility of implementing impulse-momentum sliding mode control on a robot that can physically replace a human with a transfemoral amputation to emulate weight-bearing for initial prototype walking tests is established. Second, a more general human simulation approach is proposed that can be used in any of the aforementioned human-machine interaction fields. Seeking this general human simulation method, a unique pair of solutions for simulating a Hill muscle-actuated linkage system is formulated. These include using the Lyapunov-based backstepping control method to generate a closed-loop tracking simulation and, motivated by limitations observed in backstepping, an optimal control solver based on differential flatness and sum of squares polynomials in support of receding horizon controlled (e.g. model predictive control) or open-loop simulations. v The backstepping framework provides insight into muscle redundancy resolution. The optimal control framework uses this insight to produce a computationally efficient approach to musculoskeletal system modeling. A simulation of a human arm is evaluated in both structures. Strong tracking performance is achieved in the backstepping case. An exercise optimization application using the optimal control solver showcases the computational benefits of the solver and reveals the feasibility of finding trajectories for human-exercise machine interaction that can isolate a muscle of interest for strengthening

Prediction and control in human neuromusculoskeletal models

Computational neuromusculoskeletal modelling enables the generation and testing of hypotheses about human movement on a large scale, in silico. Humanoid models, which increasingly aim to replicate the full complexity of the human nervous and musculoskeletal systems, are built on extensive prior knowledge, extracted from anatomical imaging, kinematic and kinetic measurement, and codified as model description. Where inverse dynamic analysis is applied, its basis is in Newton's laws of motion, and in solving for muscular redundancy it is necessary to invoke knowledge of central nervous motor strategy. This epistemological approach contrasts strongly with the models of machine learning, which are generally over-parameterised and largely data-driven. Even as spectacular performance has been delivered by the application of these models in a number of discrete domains of artificial intelligence, work towards general human-level intelligence has faltered, leading many to wonder if the data-driven approach is fundamentally limited, and spurring efforts to combine machine learning with knowledge-based modelling. Through a series of five studies, this thesis explores the combination of neuromusculoskeletal modelling with machine learning in order to enhance the core tasks of prediction and control. Several principles for the development of clinically useful artificially intelligent systems emerge: stability, computational efficiency and incorporation of prior knowledge. The first study concerns the use of neural network function approximators for the prediction of internal forces during human movement, an important task with many clinical applications, but one for which the standard tools of modelling are slow and cumbersome. By training on a large dataset of motions and their corresponding forces, state of the art performance is demonstrated, with many-fold increases in inference speed enabling the deployment of trained models for use in a real time biofeedback system. Neural networks trained in this way, to imitate some optimal controller, encode a mapping from high-level movement descriptors to actuator commands, and may thus be deployed in simulation as \textit{policies} to control the actions of humanoid models. Unfortunately, the high complexity of realistic simulation makes stable control a challenging task, beyond the capabilities of such naively trained models. The objective of the second study was to improve performance and stability of policy-based controllers for humanoid models in simulation. A novel technique was developed, borrowing from established unsupervised adversarial methods in computer vision. This technique enabled significant gains in performance relative to a neural network baseline, without the need for additional access to the optimal controller. For the third study, increases in the capabilities of these policy-based controllers were sought. Reinforcement learning is widely considered the most powerful means of optimising such policies, but it is computationally inefficient, and this inefficiency limits its clinical utility. To mitigate this problem, a novel framework, making use of domain-specific knowledge present in motion data, and in an inverse model of the biomechanical system, was developed. Training on simple desktop hardware, this framework enabled rapid initialisation of humanoid models that were able to move naturally through a 3-dimensional simulated environment, with 900-fold improvements in sample efficiency relative to a related technique based on pure reinforcement learning. After training with subject-specific anatomical parameters, and motion data, learned policies represent personalised models of motor control that may be further interrogated to test hypotheses about movement. For the fourth study, subject-specific controllers were taken and used as the substrate for transfer learning, by removing kinematic constraints and optimising with respect to the magnitude of the medial knee joint reaction force, an important biomechanical variable in osteoarthritis of the knee. Models learned new kinematic strategies for the reduction of this biomarker, which were subsequently validated by their use, in the real world, to construct subject-specific routines for real time gait retraining. Six out of eight subjects were able to reduce medial knee joint loading by pursuing the personalised kinematic targets found in simulation. Personalisation of assistive devices, such as limb prostheses, is another area of growing interest, and one for which computational frameworks promise cost-effective solutions. Reinforcement learning provides powerful techniques for this task but the expansion of the scope of optimisation, to include previously static elements of a prosthesis, is problematic for its complexity and resulting sample inefficiency. The fifth and final study demonstrates a new algorithm that leverages the methods described in the previous studies, and additional techniques for variance control, to surmount this problem, improving sample efficiency and simultaneously, through the use of prior knowledge encoded in motion data, providing a rational means of determining optimality in the prosthesis. Trained models were able to jointly optimise motor control and prosthesis design to enable improved performance in a walking task, and optimised designs were robust to both random seed and reward specification. This algorithm could be used to speed the design and production of real personalised prostheses, representing a potent realisation of the potential benefits of combined reinforcement learning and realistic neuromusculoskeletal modelling.Open Acces

Multi-level personalization of neuromusculoskeletal models to estimate physiologically plausible knee joint contact forces in children

Neuromusculoskeletal models are a powerful tool to investigate the internal biomechanics of an individual. However, commonly used neuromusculoskeletal models are generated via linear scaling of generic templates derived from elderly adult anatomies and poorly represent a child, let alone children with a neuromuscular disorder whose musculoskeletal structures and muscle activation patterns are profoundly altered. Model personalization can capture abnormalities and appropriately describe the underlying (altered) biomechanics of an individual. In this work, we explored the effect of six different levels of neuromusculoskeletal model personalization on estimates of muscle forces and knee joint contact forces to tease out the importance of model personalization for normal and abnormal musculoskeletal structures and muscle activation patterns. For six children, with and without cerebral palsy, generic scaled models were developed and progressively personalized by (1) tuning and calibrating musculotendon units' parameters, (2) implementing an electromyogram-assisted approach to synthesize muscle activations, and (3) replacing generic anatomies with image-based bony geometries, and physiologically and physically plausible muscle kinematics. Biomechanical simulations of gait were performed in the OpenSim and CEINMS software on ten overground walking trials per participant. A mixed-ANOVA test, with Bonferroni corrections, was conducted to compare all models' estimates. The model with the highest level of personalization produced the most physiologically plausible estimates. Model personalization is crucial to produce physiologically plausible estimates of internal biomechanical quantities. In particular, personalization of musculoskeletal anatomy and muscle activation patterns had the largest effect overall. Increased research efforts are needed to ease the creation of personalized neuromusculoskeletal models

Moving horizon estimation of human kinematics and muscle forces

Human-robot interaction based on real-time kinematics or electromyography (EMG) feedback improves rehabilitation using assist-as-needed strategies. Muscle forces are expected to provide even more comprehensive information than EMG to control these assistive rehabilitation devices. Measuring in vivo muscle force is challenging, leading to the development of numerical methods to estimate them. Due to their high computational cost, forward dynamics-based optimization algorithms were not viable for real-time estimation until recently. To achieve muscle forces estimation in real time, a moving horizon estimator (MHE) algorithm was used to track experimental biosignals. Two participants were equipped with EMG sensors and skin markers that were streamed in real time and used as targets for the MHE. The upper-limb musculoskeletal (MSK) model was composed of 10 degrees-of-freedom actuated by 31 muscles. The MHE relies on a series of overlapping trajectory optimization subproblems of which the following parameters have been adjusted: the fixed duration and the frame to export. We based this adjustment on the estimation delay, the muscle saturation, the joint kinematic mean power frequency, and errors to experimental data. Our algorithm provided consistent estimates of muscle forces and kinematics with visual feedback at 30 Hz with a 110 ms delay. This method is promising to guide rehabilitation and enrich assistive device control laws with personalized force estimations