The dynamics of motor learning through the formation of internal models

A medical student learning to perform a laparoscopic procedure or a recently paralyzed user of a powered wheelchair must learn to operate machinery via interfaces that translate their actions into commands for an external device. Since the user\u2019s actions are selected from a number of alternatives that would result in the same effect in the control space of the external device, learning to use such interfaces involves dealing with redundancy. Subjects need to learn an externally chosen many-to-one map that transforms their actions into device commands. Mathematically, we describe this type of learning as a deterministic dynamical process, whose state is the evolving forward and inverse internal models of the interface. The forward model predicts the outcomes of actions, while the inverse model generates actions designed to attain desired outcomes. Both the mathematical analysis of the proposed model of learning dynamics and the learning performance observed in a group of subjects demonstrate a first-order exponential convergence of the learning process toward a particular state that depends only on the initial state of the inverse and forward models and on the sequence of targets supplied to the users. Noise is not only present but necessary for the convergence of learning through the minimization of the difference between actual and predicted outcomes

Upper Body-Based Power Wheelchair Control Interface for Individuals with Tetraplegia

Many power wheelchair control interfaces are not sufficient for individuals with severely limited upper limb mobility. The majority of controllers that do not rely on coordinated arm and hand movements provide users a limited vocabulary of commands and often do not take advantage of the user's residual motion. We developed a body-machine interface (BMI) that leverages the flexibility and customizability of redundant control by using high dimensional changes in shoulder kinematics to generate proportional control commands for a power wheelchair. In this study, three individuals with cervical spinal cord injuries were able to control a power wheelchair safely and accurately using only small shoulder movements. With the BMI, participants were able to achieve their desired trajectories and, after five sessions driving, were able to achieve smoothness that was similar to the smoothness with their current joystick. All participants were twice as slow using the BMI however improved with practice. Importantly, users were able to generalize training controlling a computer to driving a power wheelchair, and employed similar strategies when controlling both devices. Overall, this work suggests that the BMI can be an effective wheelchair control interface for individuals with high-level spinal cord injuries who have limited arm and hand control

Do we use a priori knowledge of gravity when making elbow rotations?

In this study, we aim to investigate whether motor commands, emanating from movement planning, are customized to movement orientation relative to gravity from the first trial on. Participants made fast point-to-point elbow flexions and extensions in the transverse plane. We compared movements that had been practiced in reclined orientation either against or with gravity with the same movement relative to the body axis made in the upright orientation (neutral compared to gravity). For each movement type, five rotations from reclined to upright orientation were made. For each rotation, we analyzed the first trial in upright orientation and the directly preceding trial in reclined orientation. Additionally, we analyzed the last five trials of a 30-trial block in upright position and compared these trials with the first trials in upright orientation. Although participants moved fast, gravitational torques were substantial. The change in body orientation affected movement planning: we found a decrease in peak angular velocity and a decrease in amplitude for the first trials made in the upright orientation, regardless of whether the previous movements in reclined orientation were made against or with gravity. We found that these decreases disappeared after participants familiarized themselves with moving in upright position in a 30-trial block. These results indicate that participants used a general strategy, corresponding to the strategy observed in situations with unreliable or limited information on external conditions. From this, we conclude that during movement planning, a priori knowledge of gravity was not used to specifically customize motor commands for the neutral gravity condition

Attentive Learning of Sequential Handwriting Movements: A Neural Network Model

Defense Advanced research Projects Agency and the Office of Naval Research (N00014-95-1-0409, N00014-92-J-1309); National Science Foundation (IRI-97-20333); National Institutes of Health (I-R29-DC02952-01)

Movement distributions of stroke survivors exhibit distinct patterns that evolve with training

BACKGROUND: While clinical assessments provide tools for characterizing abilities in motor-impaired individuals, concerns remain over their repeatability and reliability. Typical robot-assisted training studies focus on repetition of prescribed actions, yet such movement data provides an incomplete account of abnormal patterns of coordination. Recent studies have shown positive effects from self-directed movement, yet such a training paradigm leads to challenges in how to quantify and interpret performance. METHODS: With data from chronic stroke survivors (n = 10, practicing for 3 days), we tabulated histograms of the displacement, velocity, and acceleration for planar motion, and examined whether modeling of distributions could reveal changes in available movement patterns. We contrasted these results with scalar measures of the range of motion. We performed linear discriminant analysis (LDA) classification with selected histogram features to compare predictions versus actual subject identifiers. As a basis of comparison, we also present an age-matched control group of healthy individuals (n = 10, practicing for 1 day). RESULTS: Analysis of range of motion did not show improvement from self-directed movement training for the stroke survivors in this study. However, examination of distributions indicated that increased multivariate normal components were needed to accurately model the patterns of movement after training. Stroke survivors generally exhibited more complex distributions of motor exploration compared to the age-matched control group. Classification using linear discriminant analysis revealed that movement patterns were identifiable by individual. Individuals in the control group were more difficult to identify using classification methods, consistent with the idea that motor deficits contribute significantly to unique movement signatures. CONCLUSIONS: Distribution analysis revealed individual patterns of abnormal coordination in stroke survivors and changes in these patterns with training. These findings were not apparent from scalar metrics that simply summarized properties of motor exploration. Our results suggest new methods for characterizing motor capabilities, and could provide the basis for powerful tools for designing customized therapy

Embodied Gesture Processing: Motor-Based Integration of Perception and Action in Social Artificial Agents

A close coupling of perception and action processes is assumed to play an important role in basic capabilities of social interaction, such as guiding attention and observation of others’ behavior, coordinating the form and functions of behavior, or grounding the understanding of others’ behavior in one’s own experiences. In the attempt to endow artificial embodied agents with similar abilities, we present a probabilistic model for the integration of perception and generation of hand-arm gestures via a hierarchy of shared motor representations, allowing for combined bottom-up and top-down processing. Results from human-agent interactions are reported demonstrating the model’s performance in learning, observation, imitation, and generation of gestures

Conclusions on motor control depend on the type of model used to represent the periphery

Within the field of motor control, there is no consensus on which kinematic and kinetic aspects of movements are planned or controlled. Perturbing goal-directed movements is a frequently used tool to answer this question. To be able to draw conclusions about motor control from kinematic responses to perturbations, a model of the periphery (i.e., the skeleton, muscle-tendon complexes, and spinal reflex circuitry) is required. The purpose of the present study was to determine to what extent such conclusions depend on the level of simplification with which the dynamical properties of the periphery are modeled. For this purpose, we simulated fast goal-directed single-joint movement with four existing types of models. We tested how three types of perturbations affected movement trajectory if motor commands remained unchanged. We found that the four types of models of the periphery showed different robustness to the perturbations, leading to different predictions on how accurate motor commands need to be, i.e., how accurate the knowledge of external conditions needs to be. This means that when interpreting kinematic responses obtained in perturbation experiments the level of error correction attributed to adaptation of motor commands depends on the type of model used to describe the periphery