New control strategies for neuroprosthetic systems

The availability of techniques to artificially excite paralyzed muscles opens enormous potential for restoring both upper and lower extremity movements with\ud neuroprostheses. Neuroprostheses must stimulate muscle, and control and regulate the artificial movements produced. Control methods to accomplish these tasks include feedforward (open-loop), feedback, and adaptive control. Feedforward control requires a great deal of information about the biomechanical behavior of the limb. For the upper extremity, an artificial motor program was developed to provide such movement program input to a neuroprosthesis. In lower extremity control, one group achieved their best results by attempting to meet naturally perceived gait objectives rather than to follow an exact joint angle trajectory. Adaptive feedforward control, as implemented in the cycleto-cycle controller, gave good compensation for the gradual decrease in performance observed with open-loop control. A neural network controller was able to control its system to customize stimulation parameters in order to generate a desired output trajectory in a given individual and to maintain tracking performance in the presence of muscle fatigue. The authors believe that practical FNS control systems must\ud exhibit many of these features of neurophysiological systems

Muscle Synergies Facilitate Computational Prediction of Subject-Specific Walking Motions.

Researchers have explored a variety of neurorehabilitation approaches to restore normal walking function following a stroke. However, there is currently no objective means for prescribing and implementing treatments that are likely to maximize recovery of walking function for any particular patient. As a first step toward optimizing neurorehabilitation effectiveness, this study develops and evaluates a patient-specific synergy-controlled neuromusculoskeletal simulation framework that can predict walking motions for an individual post-stroke. The main question we addressed was whether driving a subject-specific neuromusculoskeletal model with muscle synergy controls (5 per leg) facilitates generation of accurate walking predictions compared to a model driven by muscle activation controls (35 per leg) or joint torque controls (5 per leg). To explore this question, we developed a subject-specific neuromusculoskeletal model of a single high-functioning hemiparetic subject using instrumented treadmill walking data collected at the subject's self-selected speed of 0.5 m/s. The model included subject-specific representations of lower-body kinematic structure, foot-ground contact behavior, electromyography-driven muscle force generation, and neural control limitations and remaining capabilities. Using direct collocation optimal control and the subject-specific model, we evaluated the ability of the three control approaches to predict the subject's walking kinematics and kinetics at two speeds (0.5 and 0.8 m/s) for which experimental data were available from the subject. We also evaluated whether synergy controls could predict a physically realistic gait period at one speed (1.1 m/s) for which no experimental data were available. All three control approaches predicted the subject's walking kinematics and kinetics (including ground reaction forces) well for the model calibration speed of 0.5 m/s. However, only activation and synergy controls could predict the subject's walking kinematics and kinetics well for the faster non-calibration speed of 0.8 m/s, with synergy controls predicting the new gait period the most accurately. When used to predict how the subject would walk at 1.1 m/s, synergy controls predicted a gait period close to that estimated from the linear relationship between gait speed and stride length. These findings suggest that our neuromusculoskeletal simulation framework may be able to bridge the gap between patient-specific muscle synergy information and resulting functional capabilities and limitations

State Variables of the Arm May Be Encoded by Single Neuron Activity in the Monkey Motor Cortex

Revealing the type of information encoded by neurons activity in the motor cortex is essential not only for understanding the mechanism of motion control but also for developing a brain-machine interface. Thus far, the concept of preferred direction vector (PD) has dominated the discussion regarding how neural activity encodes information; however, a unified view of exactly what information is encoded has not yet been established. In the present study, a model was constructed to describe temporal neuron activity by a dot product of the PD and the movement variables vector consisting of joint torque and angular velocity. The plausibility of this model was tested by comparing estimated neural activity with that recorded from the monkey motor cortex, and it was found that this model was able to explain the temporal pattern of neuron activity irrespective of its passive responsiveness. The mean determination coefficients of neurons that responded to proprioceptive stimuli and that responded to visual stimuli were relatively high values of 0.57 and 0.58, respectively. These results suggest that neurons in the monkey motor cortex encode state variables of the arm in a framework of modern control theory and that this information could be decoded for controlling a brain-machine interface

Control of position and movement is simplified by combined muscle spindle and Golgi tendon organ feedback

Whereas muscle spindles play a prominent role in current theories of human motor control, Golgi tendon organs (GTO) and their associated tendons are often neglected. This is surprising since there is ample evidence that both tendons and GTOs contribute importantly to neuromusculoskeletal dynamics. Using detailed musculoskeletal models, we provide evidence that simple feedback using muscle spindles alone results in very poor control of joint position and movement since muscle spindles cannot sense changes in tendon length that occur with changes in muscle force. We propose that a combination of spindle and GTO afferents can provide an estimate of muscle-tendon complex length, which can be effectively used for low-level feedback during both postural and movement tasks. The feasibility of the proposed scheme was tested using detailed musculoskeletal models of the human arm. Responses to transient and static perturbations were simulated using a 1-degree-of-freedom (DOF) model of the arm and showed that the combined feedback enabled the system to respond faster, reach steady state faster, and achieve smaller static position errors. Finally, we incorporated the proposed scheme in an optimally controlled 2-DOF model of the arm for fast point-to-point shoulder and elbow movements. Simulations showed that the proposed feedback could be easily incorporated in the optimal control framework without complicating the computation of the optimal control solution, yet greatly enhancing the system's response to perturbations. The theoretical analyses in this study might furthermore provide insight about the strong physiological couplings found between muscle spindle and GTO afferents in the human nervous system. © 2013 the American Physiological Society

Development and Biomechanical Analysis toward a Mechanically Passive Wearable Shoulder Exoskeleton

Shoulder disability is a prevalent health issue associated with various orthopedic and neurological conditions, like rotator cuff tear and peripheral nerve injury. Many individuals with shoulder disability experience mild to moderate impairment and struggle with elevating the shoulder or holding the arm against gravity. To address this clinical need, I have focused my research on developing wearable passive exoskeletons that provide continuous at-home movement assistance. Through a combination of experiments and computational tools, I aim to optimize the design of these exoskeletons. In pursuit of this goal, I have designed, fabricated, and preliminarily evaluated a wearable, passive, cam-driven shoulder exoskeleton prototype. Notably, the exoskeleton features a modular spring-cam-wheel module, allowing customizable assistive force to compensate for different proportions of the shoulder elevation moment due to gravity. The results of my research demonstrated that this exoskeleton, providing modest one-fourth gravity moment compensation at the shoulder, can effectively reduce muscle activity, including deltoid and rotator cuff muscles. One crucial aspect of passive shoulder exoskeleton design is determining the optimal anti-gravity assistance level. I have addressed this challenge using computational tools and found that an assistance level within the range of 20-30% of the maximum gravity torque at the shoulder joint yields superior performance for specific shoulder functional tasks. When facing a new task dynamic, such as wearing a passive shoulder exoskeleton, the human neuro-musculoskeletal system adapts and modulates limb impedance at the end-limb (i.e., hand) to enhance task stability. I have presented development and validation of a realistic neuromusculoskeletal model of the upper limb that can predict stiffness modulation and motor adaptation in response to newly introduced environments and force fields. Future studies will explore the model\u27s applicability in predicting stiffness modulation for 3D movements in novel environments, such as passive assistive devices\u27 force fields

Remembering Forward: Neural Correlates of Memory and Prediction in Human Motor Adaptation

We used functional MR imaging (FMRI), a robotic manipulandum and systems identification techniques to examine neural correlates of predictive compensation for spring-like loads during goal-directed wrist movements in neurologically-intact humans. Although load changed unpredictably from one trial to the next, subjects nevertheless used sensorimotor memories from recent movements to predict and compensate upcoming loads. Prediction enabled subjects to adapt performance so that the task was accomplished with minimum effort. Population analyses of functional images revealed a distributed, bilateral network of cortical and subcortical activity supporting predictive load compensation during visual target capture. Cortical regions – including prefrontal, parietal and hippocampal cortices – exhibited trial-by-trial fluctuations in BOLD signal consistent with the storage and recall of sensorimotor memories or “states” important for spatial working memory. Bilateral activations in associative regions of the striatum demonstrated temporal correlation with the magnitude of kinematic performance error (a signal that could drive reward-optimizing reinforcement learning and the prospective scaling of previously learned motor programs). BOLD signal correlations with load prediction were observed in the cerebellar cortex and red nuclei (consistent with the idea that these structures generate adaptive fusimotor signals facilitating cancelation of expected proprioceptive feedback, as required for conditional feedback adjustments to ongoing motor commands and feedback error learning). Analysis of single subject images revealed that predictive activity was at least as likely to be observed in more than one of these neural systems as in just one. We conclude therefore that motor adaptation is mediated by predictive compensations supported by multiple, distributed, cortical and subcortical structures

Active vibration damping of the Space Shuttle remote manipulator system

The feasibility of providing active damping augmentation of the Space Shuttle Remote Manipulator System (RMS) following normal payload handling operations is investigated. The approach used in the analysis is described, and the results for both linear and nonlinear performance analysis of candidate laws are presented, demonstrating that significant improvement in the RMS dynamic response can be achieved through active control using measured RMS tip acceleration data for feedback

Muscular Properties and Balance Control in Older Adults

The goal of this dissertation was to understand the role of age-related changes in muscle mechanical properties in the control of upright posture in humans. First, a methodology for estimating subject-specific muscle properties in healthy young and older individuals was developed. Magnetic resonance and ultrasound imaging were used in conjunction with dynamometer experiments, musculoskeletal modeling, and numerical optimization to estimate the properties of the dorsiflexor and individual plantarflexor (gastrocnemius and soleus) muscles for 12 young and 12 older adults (balanced for gender). With aging there were declines in maximal isometric strength and increases in series-elastic stiffness in the male subjects, but no differences in the female subjects. Regardless of gender, there were age-related changes in the shape of the force-velocity relation, such that the older subjects produced less relative force during both concentric and eccentric muscle contractions. The second study tested the balance abilities of the same subjects under a variety of static (quiet stance, leaning forward/backward) and dynamic (swaying at preferred/imposed frequencies, maximal reaching, external perturbation) conditions. The older adults performed more poorly on most of the balance tasks. While maximal isometric force made a smaller than expected contribution to predicting balancing ability, the force-length, force-velocity and force-extension properties of the muscles were all predictive of the age-related declines in balance control, explaining ~40% of the variance as independent predictors and ~50% when these factors were combined. Finally, a feedback-driven inverted pendulum model of postural control was developed, which incorporated realistic representations of young and old dorsiflexor and individual plantarflexor muscles using the previously estimated mechanical properties. A sensitivity analysis was performed by manipulating the properties of the plantarflexor muscles. The balancing ability of the model was most influenced by the optimal length of the contractile component and the slack length of the series elastic component of the plantarflexor muscle models. The quiet stance model highlighted the importance of the force-length relation of muscle to the stabilization of upright posture. This dissertation demonstrated that there are age-related changes in the dorsi- and plantarflexor mechanical properties, and these changes are associated with the declines in postural control that accompany aging

Deep Haptic Model Predictive Control for Robot-Assisted Dressing

Robot-assisted dressing offers an opportunity to benefit the lives of many people with disabilities, such as some older adults. However, robots currently lack common sense about the physical implications of their actions on people. The physical implications of dressing are complicated by non-rigid garments, which can result in a robot indirectly applying high forces to a person's body. We present a deep recurrent model that, when given a proposed action by the robot, predicts the forces a garment will apply to a person's body. We also show that a robot can provide better dressing assistance by using this model with model predictive control. The predictions made by our model only use haptic and kinematic observations from the robot's end effector, which are readily attainable. Collecting training data from real world physical human-robot interaction can be time consuming, costly, and put people at risk. Instead, we train our predictive model using data collected in an entirely self-supervised fashion from a physics-based simulation. We evaluated our approach with a PR2 robot that attempted to pull a hospital gown onto the arms of 10 human participants. With a 0.2s prediction horizon, our controller succeeded at high rates and lowered applied force while navigating the garment around a persons fist and elbow without getting caught. Shorter prediction horizons resulted in significantly reduced performance with the sleeve catching on the participants' fists and elbows, demonstrating the value of our model's predictions. These behaviors of mitigating catches emerged from our deep predictive model and the controller objective function, which primarily penalizes high forces.Comment: 8 pages, 12 figures, 1 table, 2018 IEEE International Conference on Robotics and Automation (ICRA