Muscle Synergies Facilitate Computational Prediction of Subject-Specific Walking Motions.

Researchers have explored a variety of neurorehabilitation approaches to restore normal walking function following a stroke. However, there is currently no objective means for prescribing and implementing treatments that are likely to maximize recovery of walking function for any particular patient. As a first step toward optimizing neurorehabilitation effectiveness, this study develops and evaluates a patient-specific synergy-controlled neuromusculoskeletal simulation framework that can predict walking motions for an individual post-stroke. The main question we addressed was whether driving a subject-specific neuromusculoskeletal model with muscle synergy controls (5 per leg) facilitates generation of accurate walking predictions compared to a model driven by muscle activation controls (35 per leg) or joint torque controls (5 per leg). To explore this question, we developed a subject-specific neuromusculoskeletal model of a single high-functioning hemiparetic subject using instrumented treadmill walking data collected at the subject's self-selected speed of 0.5 m/s. The model included subject-specific representations of lower-body kinematic structure, foot-ground contact behavior, electromyography-driven muscle force generation, and neural control limitations and remaining capabilities. Using direct collocation optimal control and the subject-specific model, we evaluated the ability of the three control approaches to predict the subject's walking kinematics and kinetics at two speeds (0.5 and 0.8 m/s) for which experimental data were available from the subject. We also evaluated whether synergy controls could predict a physically realistic gait period at one speed (1.1 m/s) for which no experimental data were available. All three control approaches predicted the subject's walking kinematics and kinetics (including ground reaction forces) well for the model calibration speed of 0.5 m/s. However, only activation and synergy controls could predict the subject's walking kinematics and kinetics well for the faster non-calibration speed of 0.8 m/s, with synergy controls predicting the new gait period the most accurately. When used to predict how the subject would walk at 1.1 m/s, synergy controls predicted a gait period close to that estimated from the linear relationship between gait speed and stride length. These findings suggest that our neuromusculoskeletal simulation framework may be able to bridge the gap between patient-specific muscle synergy information and resulting functional capabilities and limitations

In silico case studies of compliant robots: AMARSI deliverable 3.3

In the deliverable 3.2 we presented how the morphological computing ap- proach can significantly facilitate the control strategy in several scenarios, e.g. quadruped locomotion, bipedal locomotion and reaching. In particular, the Kitty experimental platform is an example of the use of morphological computation to allow quadruped locomotion. In this deliverable we continue with the simulation studies on the application of the different morphological computation strategies to control a robotic system

Revisiting the Body-Schema Concept in the Context of Whole-Body Postural-Focal Dynamics

The body-schema concept is revisited in the context of embodied cognition, further developing the theory formulated by Marc Jeannerod that the motor system is part of a simulation network related to action, whose function is not only to shape the motor system for preparing an action (either overt or covert) but also to provide the self with information on the feasibility and the meaning of potential actions. The proposed computational formulation is based on a dynamical system approach, which is linked to an extension of the equilibrium-point hypothesis, called Passive Motor Paradigm: this dynamical system generates goal-oriented, spatio-temporal, sensorimotor patterns, integrating a direct and inverse internal model in a multi-referential framework. The purpose of such computational model is to operate at the same time as a general synergy formation machinery for planning whole-body actions in humanoid robots and/or for predicting coordinated sensory–motor patterns in human movements. In order to illustrate the computational approach, the integration of simultaneous, even partially conflicting tasks will be analyzed in some detail with regard to postural-focal dynamics, which can be defined as the fusion of a focal task, namely reaching a target with the whole-body, and a postural task, namely maintaining overall stability

On Neuromechanical Approaches for the Study of Biological Grasp and Manipulation

Biological and robotic grasp and manipulation are undeniably similar at the level of mechanical task performance. However, their underlying fundamental biological vs. engineering mechanisms are, by definition, dramatically different and can even be antithetical. Even our approach to each is diametrically opposite: inductive science for the study of biological systems vs. engineering synthesis for the design and construction of robotic systems. The past 20 years have seen several conceptual advances in both fields and the quest to unify them. Chief among them is the reluctant recognition that their underlying fundamental mechanisms may actually share limited common ground, while exhibiting many fundamental differences. This recognition is particularly liberating because it allows us to resolve and move beyond multiple paradoxes and contradictions that arose from the initial reasonable assumption of a large common ground. Here, we begin by introducing the perspective of neuromechanics, which emphasizes that real-world behavior emerges from the intimate interactions among the physical structure of the system, the mechanical requirements of a task, the feasible neural control actions to produce it, and the ability of the neuromuscular system to adapt through interactions with the environment. This allows us to articulate a succinct overview of a few salient conceptual paradoxes and contradictions regarding under-determined vs. over-determined mechanics, under- vs. over-actuated control, prescribed vs. emergent function, learning vs. implementation vs. adaptation, prescriptive vs. descriptive synergies, and optimal vs. habitual performance. We conclude by presenting open questions and suggesting directions for future research. We hope this frank assessment of the state-of-the-art will encourage and guide these communities to continue to interact and make progress in these important areas

Bio­-inspired approaches to the control and modelling of an anthropomimetic robot

Introducing robots into human environments requires them to handle settings designed specifically for human size and morphology, however, large, conventional humanoid robots with stiff, high powered joint actuators pose a significant danger to humans. By contrast, “anthropomimetic” robots mimic both human morphology and internal structure; skeleton, muscles, compliance and high redundancy. Although far safer, their resultant compliant structure presents a formidable challenge to conventional control. Here we review, and seek to address, characteristic control issues of this class of robot, whilst exploiting their biomimetic nature by drawing upon biological motor control research. We derive a novel learning controller for discovering effective reaching actions created through sustained activation of one or more muscle synergies, an approach which draws upon strong, recent evidence from animal and humans studies, but is almost unexplored to date in musculoskeletal robot literature. Since the best synergies for a given robot will be unknown, we derive a deliberately simple reinforcement learning approach intended to allow their emergence, in particular those patterns which aid linearization of control. We also draw upon optimal control theories to encourage the emergence of smoother movement by incorporating signal dependent noise and trial repetition. In addition, we argue the utility of developing a detailed dynamic model of a complete robot and present a stable, physics-­‐‑based model, of the anthropomimetic ECCERobot, running in real time with 55 muscles and 88 degrees of freedom. Using the model, we find that effective reaching actions can be learned which employ only two sequential motor co-­‐‑activation patterns, each controlled by just a single common driving signal. Factor analysis shows the emergent muscle co-­‐‑activations can be reconstructed to significant accuracy using weighted combinations of only 13 common fragments, labelled “candidate synergies”. Using these synergies as drivable units the same controller learns the same task both faster and better, however, other reaching tasks perform less well, proportional to dissimilarity; we therefore propose that modifications enabling emergence of a more generic set of synergies are required. Finally, we propose a continuous controller for the robot, based on model predictive control, incorporating our model as a predictive component for state estimation, delay-­‐‑ compensation and planning, including merging of the robot and sensed environment into a single model. We test the delay compensation mechanism by controlling a second copy of the model acting as a proxy for the real robot, finding that performance is significantly improved if a precise degree of compensation is applied and show how rapidly an un-­‐‑compensated controller fails as the model accuracy degrades

Effects of overground walking with a robotic exoskeleton on lower limb muscle synergies

Les exosquelettes robotisés de marche (ERM) représentent une intervention prometteuse dans le domaine de la réadaptation locomotrice. Sur le plan clinique, les ERM facilitent la mise en application de principes de neuroplasticité. Jusqu'à présent, la majorité des études analysant les effets de l’ERM a été menée avec des ERM fournissant une assistance robotique complète le long d’une trajectoire de mouvements prédéfinie des membres inférieurs (MI) de façon à reproduire la marche de façon quasi parfaite à très basse vitesse. La nouvelle génération d’ERM, maintenant disponible sur le marché, propose de nouveaux modes de contrôles qui permettent, entre autres, une liberté de mouvement accrue aux MIs (c.-à-d. trajectoire non imposée) et une possibilité d’offrir une assistance ou résistance aux mouvements de différentes intensités surtout pendant la phase d’oscillation du cycle de marche. Cependant, les effets de ces modes de contrôles sur la coordination musculaire des MI pendant la marche au sol avec l’ERM, caractérisé via l’extraction de synergies musculaires (SM), restent méconnus. Cette thèse mesure et compare les caractéristiques des SM (c.-à-d. nombre, profils d’activation, composition musculaire et contribution relative des muscles) pendant la la marche au sol sans ou avec un ERM paramétré avec six différents modes de contrôle chez des individus en bonne santé (articles #1 et #2) et d’autres ayant une lésion médullaire incomplète (LMI) (article #3). Les signaux électromyographiques (EMG) des différents muscles clés des MI, enregistrés lors de la marche, ont été utilisés afin d’extraire les SM avec un algorithme de factorisation matricielle non négative. La similarité des cosinus et les coefficients de corrélation ont caractérisé les similitudes entre les caractéristiques des SM. Les résultats montrent que: 1) les profils d'activation temporelle et le nombre de SM sont modifiés en fonction de la vitesse de marche avec, entre autres une augmentation de la vitesse de marche entrainant une fusion de SM, chez les individus en bonne santé marchant sans ERM ; 2) lorsque ces derniers marchent avec un ERM, les différents modes de contrôle testés ne dupliquent pas adéquatement les SM retrouvées lors de la marche sans ERM. En fait, uniquement le mode de contrôle libérant la contrainte de trajectoire de mouvements des MIs dans le plan sagittal lors de la phase d’oscillation reproduit les principales caractéristiques des SM retrouvées pendant la marche sans ERM ; 3) le nombre et la composition musculaire des SM sont modifiés pendant la marche sans ERM chez les personnes ayant une LMI. Cependant, parmi tous les modes de contrôle étudiés, seul le mode de contrôle libérant le contrôle de la trajectoire de mouvements des MI et assistant l’oscillation du MIs (c.-à-d. HASSIST) permets l’extraction de SM similaire à celles observées chez des individus en santé lors d'une marche sans ERM. Dans l’ensemble, cette thèse a mis en évidence le fait que différentes demandes biomécaniques liées à la marche (c.-à-d. vitesse de marche, modes de contrôle de l’ERM) modifient le nombre et les caractéristiques de SM chez les personnes en santé. Cette thèse a également confirmé que la coordination musculaire, mise en évidence via l’analyse de SM, est altérée chez les personnes ayant une LMI et a tendance à se normaliser lors de la marche avec l’ERM paramétré dans le mode de HASSIST. Les nouvelles preuves appuieront les professionnels de la réadaptation dans le processus de prise de décision concernant la sélection du mode de contrôle des MIs lors de l’entrainement locomoteur utilisant avec un ERM.Wearable robotic exoskeletons (WRE) represent a promising rehabilitation intervention for locomotor rehabilitation training that aligns with activity-based neuroplasticity principles in terms of optimal sensory input, massed repetition, and proper kinematics. Thus far, most studies that investigated the effects of WRE have used WRE that provide full robotic assistance and fixed trajectory guidance to the lower extremity (L/E) to generate close-to-normal walking kinematics, usually at very slow speeds. Based on clinicians’ feedback, current commercially-available WRE have additional control options to be able to integrate these devices into the recovery process of individuals who have maintained some ability to walk after an injury to the central nervous system. In this context, WRE now offer additional degrees of movements for the L/E to move freely and different strategies to assist or resist movement, particularly during the gait cycle’s swing phase. However, the extent that these additional WRE control options affect L/E neuromuscular control during walking, typically characterized using muscle synergies (MSs), remains unknown. This thesis measures and compares MSs characteristics (i.e., number, temporal activation profile, and muscles contributing to a specific synergy [weightings]) during typical overground walking, with and without a WRE, in six different control modes, in abled-bodied individuals (Articles #1 and #2) and individuals with incomplete spinal cord injury (iSCI; Article #3). Surface EMG of key L/E muscles were recorded while walking and used to extract MSs using a non-negative matrix factorization algorithm. Cosine similarity and correlation coefficients characterized, grouped, and indicated similarities between MS characteristics. Results demonstrated that: 1) the number of MSs and MS temporal activation profiles in able-bodied individuals walking without WRE are modified by walking speed and that, as speed increased, specific MSs were fused or merged compared to MSs at slow speeds; 2) In able-bodied individuals walking with WRE, few WRE control modes maintained the typical MSs characteristics that were found during overground walking without WRE. Moreover, freeing the L/E swing trajectory imposed by the WRE best reproduced those MSs characteristics during overground walking without the WRE; and 3) After an iSCI, alterations to the number and the composition of MSs were observed during walking without WRE. However, of all WRE control modes that were investigated, only HASSIST (i.e., freeing WRE control over L/E swing trajectory while assisting the user’s self-selected trajectory) reproduced the number and composition of MSs found in abled-bodied individuals during overground walking without WRE. Altogether, the results of this thesis demonstrated that different walking-related biomechanical demands (i.e., walking speed) and most of the WRE control modes can alter some MSs, and their characteristics, in able-bodied individuals. This research also confirmed that impaired muscle coordination, assessed via MSs, can adapt when walking with a WRE set with specific control options (e.g., HASSIST). These MS adaptations mimicked typical MS characteristics extracted during overground walking. The evidence generated by this thesis will support the decision-making process when selecting specific L/E control options during WRE walking, allowing rehabilitation professionals to refine WRE locomotor training protocols

Motion representation with spiking neural networks for grasping and manipulation

Die Natur bedient sich Millionen von Jahren der Evolution, um adaptive physikalische Systeme mit effizienten Steuerungsstrategien zu erzeugen. Im Gegensatz zur konventionellen Robotik plant der Mensch nicht einfach eine Bewegung und führt sie aus, sondern es gibt eine Kombination aus mehreren Regelkreisen, die zusammenarbeiten, um den Arm zu bewegen und ein Objekt mit der Hand zu greifen. Mit der Forschung an humanoiden und biologisch inspirierten Robotern werden komplexe kinematische Strukturen und komplizierte Aktor- und Sensorsysteme entwickelt. Diese Systeme sind schwierig zu steuern und zu programmieren, und die klassischen Methoden der Robotik können deren Stärken nicht immer optimal ausnutzen. Die neurowissenschaftliche Forschung hat große Fortschritte beim Verständnis der verschiedenen Gehirnregionen und ihrer entsprechenden Funktionen gemacht. Dennoch basieren die meisten Modelle auf groß angelegten Simulationen, die sich auf die Reproduktion der Konnektivität und der statistischen neuronalen Aktivität konzentrieren. Dies öffnet eine Lücke bei der Anwendung verschiedener Paradigmen, um Gehirnmechanismen und Lernprinzipien zu validieren und Funktionsmodelle zur Steuerung von Robotern zu entwickeln. Ein vielversprechendes Paradigma ist die ereignis-basierte Berechnung mit SNNs. SNNs fokussieren sich auf die biologischen Aspekte von Neuronen und replizieren deren Arbeitsweise. Sie sind für spike- basierte Kommunikation ausgelegt und ermöglichen die Erforschung von Mechanismen des Gehirns für das Lernen mittels neuronaler Plastizität. Spike-basierte Kommunikation nutzt hoch parallelisierten Hardware-Optimierungen mittels neuromorpher Chips, die einen geringen Energieverbrauch und schnelle lokale Operationen ermöglichen. In dieser Arbeit werden verschiedene SNNs zur Durchführung von Bewegungss- teuerung für Manipulations- und Greifaufgaben mit einem Roboterarm und einer anthropomorphen Hand vorgestellt. Diese basieren auf biologisch inspirierten funktionalen Modellen des menschlichen Gehirns. Ein Motor-Primitiv wird auf parametrische Weise mit einem Aktivierungsparameter und einer Abbildungsfunktion auf die Roboterkinematik übertragen. Die Topologie des SNNs spiegelt die kinematische Struktur des Roboters wider. Die Steuerung des Roboters erfolgt über das Joint Position Interface. Um komplexe Bewegungen und Verhaltensweisen modellieren zu können, werden die Primitive in verschiedenen Schichten einer Hierarchie angeordnet. Dies ermöglicht die Kombination und Parametrisierung der Primitiven und die Wiederverwendung von einfachen Primitiven für verschiedene Bewegungen. Es gibt verschiedene Aktivierungsmechanismen für den Parameter, der ein Motorprimitiv steuert — willkürliche, rhythmische und reflexartige. Außerdem bestehen verschiedene Möglichkeiten neue Motorprimitive entweder online oder offline zu lernen. Die Bewegung kann entweder als Funktion modelliert oder durch Imitation der menschlichen Ausführung gelernt werden. Die SNNs können in andere Steuerungssysteme integriert oder mit anderen SNNs kombiniert werden. Die Berechnung der inversen Kinematik oder die Validierung von Konfigurationen für die Planung ist nicht erforderlich, da der Motorprimitivraum nur durchführbare Bewegungen hat und keine ungültigen Konfigurationen enthält. Für die Evaluierung wurden folgende Szenarien betrachtet, das Zeigen auf verschiedene Ziele, das Verfolgen einer Trajektorie, das Ausführen von rhythmischen oder sich wiederholenden Bewegungen, das Ausführen von Reflexen und das Greifen von einfachen Objekten. Zusätzlich werden die Modelle des Arms und der Hand kombiniert und erweitert, um die mehrbeinige Fortbewegung als Anwendungsfall der Steuerungsarchitektur mit Motorprimitiven zu modellieren. Als Anwendungen für einen Arm (3 DoFs) wurden die Erzeugung von Zeigebewegungen und das perzeptionsgetriebene Erreichen von Zielen modelliert. Zur Erzeugung von Zeigebewegun- gen wurde ein Basisprimitiv, das auf den Mittelpunkt einer Ebene zeigt, offline mit vier Korrekturprimitiven kombiniert, die eine neue Trajektorie erzeugen. Für das wahrnehmungsgesteuerte Erreichen eines Ziels werden drei Primitive online kombiniert unter Verwendung eines Zielsignals. Als Anwendungen für eine Fünf-Finger-Hand (9 DoFs) wurden individuelle Finger-aktivierungen und Soft-Grasping mit nachgiebiger Steuerung modelliert. Die Greif- bewegungen werden mit Motor-Primitiven in einer Hierarchie modelliert, wobei die Finger-Primitive die Synergien zwischen den Gelenken und die Hand-Primitive die unterschiedlichen Affordanzen zur Koordination der Finger darstellen. Für jeden Finger werden zwei Reflexe hinzugefügt, zum Aktivieren oder Stoppen der Bewegung bei Kontakt und zum Aktivieren der nachgiebigen Steuerung. Dieser Ansatz bietet enorme Flexibilität, da Motorprimitive wiederverwendet, parametrisiert und auf unterschiedliche Weise kombiniert werden können. Neue Primitive können definiert oder gelernt werden. Ein wichtiger Aspekt dieser Arbeit ist, dass im Gegensatz zu Deep Learning und End-to-End-Lernmethoden, keine umfangreichen Datensätze benötigt werden, um neue Bewegungen zu lernen. Durch die Verwendung von Motorprimitiven kann der gleiche Modellierungsansatz für verschiedene Roboter verwendet werden, indem die Abbildung der Primitive auf die Roboterkinematik neu definiert wird. Die Experimente zeigen, dass durch Motor- primitive die Motorsteuerung für die Manipulation, das Greifen und die Lokomotion vereinfacht werden kann. SNNs für Robotikanwendungen ist immer noch ein Diskussionspunkt. Es gibt keinen State-of-the-Art-Lernalgorithmus, es gibt kein Framework ähnlich dem für Deep Learning, und die Parametrisierung von SNNs ist eine Kunst. Nichtsdestotrotz können Robotikanwendungen - wie Manipulation und Greifen - Benchmarks und realistische Szenarien liefern, um neurowissenschaftliche Modelle zu validieren. Außerdem kann die Robotik die Möglichkeiten der ereignis- basierten Berechnung mit SNNs und neuromorpher Hardware nutzen. Die physikalis- che Nachbildung eines biologischen Systems, das vollständig mit SNNs implementiert und auf echten Robotern evaluiert wurde, kann neue Erkenntnisse darüber liefern, wie der Mensch die Motorsteuerung und Sensorverarbeitung durchführt und wie diese in der Robotik angewendet werden können. Modellfreie Bewegungssteuerungen, inspiriert von den Mechanismen des menschlichen Gehirns, können die Programmierung von Robotern verbessern, indem sie die Steuerung adaptiver und flexibler machen

Hierarchical neural control of human postural balance and bipedal walking in sagittal plane

Thesis (Ph. D.)--Massachusetts Institute of Technology, Dept. of Electrical Engineering and Computer Science, 2006.This electronic version was submitted by the student author. The certified thesis is available in the Institute Archives and Special Collections.Includes bibliographical references (p. 177-192).The cerebrocerebellar system has been known to be a central part in human motion control and execution. However, engineering descriptions of the system, especially in relation to lower body motion, have been very limited. This thesis proposes an integrated hierarchical neural model of sagittal planar human postural balance and biped walking to 1) investigate an explicit mechanism of the cerebrocerebellar and other related neural systems, 2) explain the principles of human postural balancing and biped walking control in terms of the central nervous systems, and 3) provide a biologically inspired framework for the design of humanoid or other biomorphic robot locomotion. The modeling was designed to confirm neurophysiological plausibility and achieve practical simplicity as well. The combination of scheduled long-loop proprioceptive and force feedback represents the cerebrocerebellar system to implement postural balance strategies despite the presence of signal transmission delays and phase lags. The model demonstrates that the postural control can be substantially linear within regions of the kinematic state-space with switching driven by sensed variables.(cont.) A improved and simplified version of the cerebrocerebellar system is combined with the spinal pattern generation to account for human nominal walking and various robustness tasks. The synergy organization of the spinal pattern generation simplifies control of joint actuation. The substantial decoupling of the various neural circuits facilitates generation of modulated behaviors. This thesis suggests that kinematic control with no explicit internal model of body dynamics may be sufficient for those lower body motion tasks and play a common role in postural balance and walking. All simulated performances are evaluated with respect to actual observations of kinematics, electromyogram, etc.by Sungho JoPh.D

Optimization of Muscle Activity for Task-Level Goals Predicts Complex Changes in Limb Forces across Biomechanical Contexts

Optimality principles have been proposed as a general framework for understanding motor control in animals and humans largely based on their ability to predict general features movement in idealized motor tasks. However, generalizing these concepts past proof-of-principle to understand the neuromechanical transformation from task-level control to detailed execution-level muscle activity and forces during behaviorally-relevant motor tasks has proved difficult. In an unrestrained balance task in cats, we demonstrate that achieving task-level constraints center of mass forces and moments while minimizing control effort predicts detailed patterns of muscle activity and ground reaction forces in an anatomically-realistic musculoskeletal model. Whereas optimization is typically used to resolve redundancy at a single level of the motor hierarchy, we simultaneously resolved redundancy across both muscles and limbs and directly compared predictions to experimental measures across multiple perturbation directions that elicit different intra- and interlimb coordination patterns. Further, although some candidate task-level variables and cost functions generated indistinguishable predictions in a single biomechanical context, we identified a common optimization framework that could predict up to 48 experimental conditions per animal (n = 3) across both perturbation directions and different biomechanical contexts created by altering animals' postural configuration. Predictions were further improved by imposing experimentally-derived muscle synergy constraints, suggesting additional task variables or costs that may be relevant to the neural control of balance. These results suggested that reduced-dimension neural control mechanisms such as muscle synergies can achieve similar kinetics to the optimal solution, but with increased control effort (≈2×) compared to individual muscle control. Our results are consistent with the idea that hierarchical, task-level neural control mechanisms previously associated with voluntary tasks may also be used in automatic brainstem-mediated pathways for balance