The dynamics of motor learning through the formation of internal models

A medical student learning to perform a laparoscopic procedure or a recently paralyzed user of a powered wheelchair must learn to operate machinery via interfaces that translate their actions into commands for an external device. Since the user\u2019s actions are selected from a number of alternatives that would result in the same effect in the control space of the external device, learning to use such interfaces involves dealing with redundancy. Subjects need to learn an externally chosen many-to-one map that transforms their actions into device commands. Mathematically, we describe this type of learning as a deterministic dynamical process, whose state is the evolving forward and inverse internal models of the interface. The forward model predicts the outcomes of actions, while the inverse model generates actions designed to attain desired outcomes. Both the mathematical analysis of the proposed model of learning dynamics and the learning performance observed in a group of subjects demonstrate a first-order exponential convergence of the learning process toward a particular state that depends only on the initial state of the inverse and forward models and on the sequence of targets supplied to the users. Noise is not only present but necessary for the convergence of learning through the minimization of the difference between actual and predicted outcomes

Upper Body-Based Power Wheelchair Control Interface for Individuals with Tetraplegia

Many power wheelchair control interfaces are not sufficient for individuals with severely limited upper limb mobility. The majority of controllers that do not rely on coordinated arm and hand movements provide users a limited vocabulary of commands and often do not take advantage of the user's residual motion. We developed a body-machine interface (BMI) that leverages the flexibility and customizability of redundant control by using high dimensional changes in shoulder kinematics to generate proportional control commands for a power wheelchair. In this study, three individuals with cervical spinal cord injuries were able to control a power wheelchair safely and accurately using only small shoulder movements. With the BMI, participants were able to achieve their desired trajectories and, after five sessions driving, were able to achieve smoothness that was similar to the smoothness with their current joystick. All participants were twice as slow using the BMI however improved with practice. Importantly, users were able to generalize training controlling a computer to driving a power wheelchair, and employed similar strategies when controlling both devices. Overall, this work suggests that the BMI can be an effective wheelchair control interface for individuals with high-level spinal cord injuries who have limited arm and hand control

Attentive Learning of Sequential Handwriting Movements: A Neural Network Model

Defense Advanced research Projects Agency and the Office of Naval Research (N00014-95-1-0409, N00014-92-J-1309); National Science Foundation (IRI-97-20333); National Institutes of Health (I-R29-DC02952-01)

Movement distributions of stroke survivors exhibit distinct patterns that evolve with training

BACKGROUND: While clinical assessments provide tools for characterizing abilities in motor-impaired individuals, concerns remain over their repeatability and reliability. Typical robot-assisted training studies focus on repetition of prescribed actions, yet such movement data provides an incomplete account of abnormal patterns of coordination. Recent studies have shown positive effects from self-directed movement, yet such a training paradigm leads to challenges in how to quantify and interpret performance. METHODS: With data from chronic stroke survivors (n = 10, practicing for 3 days), we tabulated histograms of the displacement, velocity, and acceleration for planar motion, and examined whether modeling of distributions could reveal changes in available movement patterns. We contrasted these results with scalar measures of the range of motion. We performed linear discriminant analysis (LDA) classification with selected histogram features to compare predictions versus actual subject identifiers. As a basis of comparison, we also present an age-matched control group of healthy individuals (n = 10, practicing for 1 day). RESULTS: Analysis of range of motion did not show improvement from self-directed movement training for the stroke survivors in this study. However, examination of distributions indicated that increased multivariate normal components were needed to accurately model the patterns of movement after training. Stroke survivors generally exhibited more complex distributions of motor exploration compared to the age-matched control group. Classification using linear discriminant analysis revealed that movement patterns were identifiable by individual. Individuals in the control group were more difficult to identify using classification methods, consistent with the idea that motor deficits contribute significantly to unique movement signatures. CONCLUSIONS: Distribution analysis revealed individual patterns of abnormal coordination in stroke survivors and changes in these patterns with training. These findings were not apparent from scalar metrics that simply summarized properties of motor exploration. Our results suggest new methods for characterizing motor capabilities, and could provide the basis for powerful tools for designing customized therapy

Embodied Gesture Processing: Motor-Based Integration of Perception and Action in Social Artificial Agents

A close coupling of perception and action processes is assumed to play an important role in basic capabilities of social interaction, such as guiding attention and observation of others’ behavior, coordinating the form and functions of behavior, or grounding the understanding of others’ behavior in one’s own experiences. In the attempt to endow artificial embodied agents with similar abilities, we present a probabilistic model for the integration of perception and generation of hand-arm gestures via a hierarchy of shared motor representations, allowing for combined bottom-up and top-down processing. Results from human-agent interactions are reported demonstrating the model’s performance in learning, observation, imitation, and generation of gestures

A model of open-loop control of equilibrium position and stiffness of the human elbow joint

According to the equilibrium point theory, the control of posture and movement involves the setting of equilibrium joint positions (EP) and the independent modulation of stiffness. One model of EP control, the α-model, posits that stable EPs and stiffness are set open-loop, i.e. without the aid of feedback. The purpose of the present study was to explore for the elbow joint the range over which stable EPs can be set open-loop and to investigate the effect of co-contraction on intrinsic low-frequency elbow joint stiffness (

Use of Self-Selected Postures to Regulate Multi-Joint Stiffness During Unconstrained Tasks

The human motor system is highly redundant, having more kinematic degrees of freedom than necessary to complete a given task. Understanding how kinematic redundancies are utilized in different tasks remains a fundamental question in motor control. One possibility is that they can be used to tune the mechanical properties of a limb to the specific requirements of a task. For example, many tasks such as tool usage compromise arm stability along specific directions. These tasks only can be completed if the nervous system adapts the mechanical properties of the arm such that the arm, coupled to the tool, remains stable. The purpose of this study was to determine if posture selection is a critical component of endpoint stiffness regulation during unconstrained tasks.Three-dimensional (3D) estimates of endpoint stiffness were used to quantify limb mechanics. Most previous studies examining endpoint stiffness adaptation were completed in 2D using constrained postures to maintain a non-redundant mapping between joint angles and hand location. Our hypothesis was that during unconstrained conditions, subjects would select arm postures that matched endpoint stiffness to the functional requirements of the task. The hypothesis was tested during endpoint tracking tasks in which subjects interacted with unstable haptic environments, simulated using a 3D robotic manipulator. We found that arm posture had a significant effect on endpoint tracking accuracy and that subjects selected postures that improved tracking performance. For environments in which arm posture had a large effect on tracking accuracy, the self-selected postures oriented the direction of maximal endpoint stiffness towards the direction of the unstable haptic environment.These results demonstrate how changes in arm posture can have a dramatic effect on task performance and suggest that postural selection is a fundamental mechanism by which kinematic redundancies can be exploited to regulate arm stiffness in unconstrained tasks