How does our motor system determine its learning rate?

Motor learning is driven by movement errors. The speed of learning can be quantified by the learning rate, which is the proportion of an error that is corrected for in the planning of the next movement. Previous studies have shown that the learning rate depends on the reliability of the error signal and on the uncertainty of the motor system’s own state. These dependences are in agreement with the predictions of the Kalman filter, which is a state estimator that can be used to determine the optimal learning rate for each movement such that the expected movement error is minimized. Here we test whether not only the average behaviour is optimal, as the previous studies showed, but if the learning rate is chosen optimally in every individual movement. Subjects made repeated movements to visual targets with their unseen hand. They received visual feedback about their endpoint error immediately after each movement. The reliability of these error-signals was varied across three conditions. The results are inconsistent with the predictions of the Kalman filter because correction for large errors in the beginning of a series of movements to a fixed target was not as fast as predicted and the learning rates for the extent and the direction of the movements did not differ in the way predicted by the Kalman filter. Instead, a simpler model that uses the same learning rate for all movements with the same error-signal reliability can explain the data. We conclude that our brain does not apply state estimation to determine the optimal planning correction for every individual movement, but it employs a simpler strategy of using a fixed learning rate for all movements with the same level of error-signal reliability

What autocorrelation tells us about motor variability: Insights from dart throwing

In sports such as golf and darts it is important that one can produce ballistic movements of an object towards a goal location with as little variability as possible. A factor that influences this variability is the extent to which motor planning is updated from movement to movement based on observed errors. Previous work has shown that for reaching movements, our motor system uses the learning rate (the proportion of an error that is corrected for in the planning of the next movement) that is optimal for minimizing the endpoint variability. Here we examined whether the learning rate is hard-wired and therefore automatically optimal, or whether it is optimized through experience. We compared the performance of experienced dart players and beginners in a dart task. A hallmark of the optimal learning rate is that the lag-1 autocorrelation of movement endpoints is zero. We found that the lag-1 autocorrelation of experienced dart players was near zero, implying a near-optimal learning rate, whereas it was negative for beginners, suggesting a larger than optimal learning rate. We conclude that learning rates for trial-by-trial motor learning are optimized through experience. This study also highlights the usefulness of the lag-1 autocorrelation as an index of performance in studying motor-skill learning

Sources of variability in interceptive movements

In order to successfully intercept a moving target one must be at the right place at the right time. But simply being there is seldom enough. One usually needs to make contact in a certain manner, for instance to hit the target in a certain direction. How this is best achieved depends on the exact task, but to get an idea of what factors may limit performance we asked people to hit a moving virtual disk through a virtual goal, and analysed the spatial and temporal variability in the way in which they did so. We estimated that for our task the standard deviations in timing and spatial accuracy are about 20 ms and 5 mm. Additional variability arises from individual movements being planned slightly differently and being adjusted during execution. We argue that the way that our subjects moved was precisely tailored to the task demands, and that the movement accuracy is not only limited by the muscles and their activation, but also-and probably even mainly-by the resolution of visual perception

Neuromotor Noise, Error Tolerance and Velocity-Dependent Costs in Skilled Performance

In motor tasks with redundancy neuromotor noise can lead to variations in execution while achieving relative invariance in the result. The present study examined whether humans find solutions that are tolerant to intrinsic noise. Using a throwing task in a virtual set-up where an infinite set of angle and velocity combinations at ball release yield throwing accuracy, our computational approach permitted quantitative predictions about solution strategies that are tolerant to noise. Based on a mathematical model of the task expected results were computed and provided predictions about error-tolerant strategies (Hypothesis 1). As strategies can take on a large range of velocities, a second hypothesis was that subjects select strategies that minimize velocity at release to avoid costs associated with signal- or velocity-dependent noise or higher energy demands (Hypothesis 2). Two experiments with different target constellations tested these two hypotheses. Results of Experiment 1 showed that subjects chose solutions with high error-tolerance, although these solutions also had relatively low velocity. These two benefits seemed to outweigh that for many subjects these solutions were close to a high-penalty area, i.e. they were risky. Experiment 2 dissociated the two hypotheses. Results showed that individuals were consistent with Hypothesis 1 although their solutions were distributed over a range of velocities. Additional analyses revealed that a velocity-dependent increase in variability was absent, probably due to the presence of a solution manifold that channeled variability in a task-specific manner. Hence, the general acceptance of signal-dependent noise may need some qualification. These findings have significance for the fundamental understanding of how the central nervous system deals with its inherent neuromotor noise

How the required precision influences the way we intercept a moving object

Do people perform a given motor task differently if it is easy than if it is difficult? To find out, we asked subjects to intercept moving virtual targets by tapping on them with their fingers. We examined how their behaviour depended on the required precision. Everything about the task was the same on all trials except the extent to which the fingertip and target had to overlap for the target to be considered hit. The target disappeared with a sound if it was hit and deflected away from the fingertip if it was missed. In separate sessions, the required precision was varied from being quite lenient about the required overlap to being very demanding. Requiring a higher precision obviously decreased the number of targets that were hit, but it did not reduce the variability in where the subjects tapped with respect to the target. Requiring a higher precision reduced the systematic deviations from landing at the target centre and the lag-one autocorrelation in such deviations, presumably because subjects received information about smaller deviations from hitting the target centre. We found no evidence for lasting effects of training with a certain required precision. All the results can be reproduced with a model in which the precision of individual movements is independent of the required precision, and in which feedback associated with missing the target is used to reduce systematic errors. We conclude that people do not approach this motor task differently when it is easy than when it is difficult. © 2013 Springer-Verlag Berlin Heidelberg

Optimal Control of Saccades by Spatial-Temporal Activity Patterns in the Monkey Superior Colliculus

A major challenge in computational neurobiology is to understand how populations of noisy, broadly-tuned neurons produce accurate goal-directed actions such as saccades. Saccades are high-velocity eye movements that have stereotyped, nonlinear kinematics; their duration increases with amplitude, while peak eye-velocity saturates for large saccades. Recent theories suggest that these characteristics reflect a deliberate strategy that optimizes a speed-accuracy tradeoff in the presence of signal-dependent noise in the neural control signals. Here we argue that the midbrain superior colliculus (SC), a key sensorimotor interface that contains a topographically-organized map of saccade vectors, is in an ideal position to implement such an optimization principle. Most models attribute the nonlinear saccade kinematics to saturation in the brainstem pulse generator downstream from the SC. However, there is little data to support this assumption. We now present new neurophysiological evidence for an alternative scheme, which proposes that these properties reside in the spatial-temporal dynamics of SC activity. As predicted by this scheme, we found a remarkably systematic organization in the burst properties of saccade-related neurons along the rostral-to-caudal (i.e., amplitude-coding) dimension of the SC motor map: peak firing-rates systematically decrease for cells encoding larger saccades, while burst durations and skewness increase, suggesting that this spatial gradient underlies the increase in duration and skewness of the eye velocity profiles with amplitude. We also show that all neurons in the recruited population synchronize their burst profiles, indicating that the burst-timing of each cell is determined by the planned saccade vector in which it participates, rather than by its anatomical location. Together with the observation that saccade-related SC cells indeed show signal-dependent noise, this precisely tuned organization of SC burst activity strongly supports the notion of an optimal motor-control principle embedded in the SC motor map as it fully accounts for the straight trajectories and kinematic nonlinearity of saccades

Specific genomic aberrations in primary colorectal cancer are associated with liver metastases

Background: Accurate staging of colorectal cancer (CRC) with clinicopathological parameters is important for predicting prognosis and guiding treatment but provides no information about organ site of metastases. Patterns of genomic aberrations in primary colorectal tumors may reveal a chromosomal signature for organ specific metastases. Methods: Array Comparative Genomic Hybridization (aCGH) was employed to asses DNA copy number changes in primary colorectal tumors of three distinctive patient groups. This included formalin-fixed, paraffin-embedded tissue of patients who developed liver metastases (LM; n = 36), metastases (PM; n = 37) and a group that remained metastases-free (M0; n = 25). A novel statistical method for identifying recurrent copy number changes, KC-SMART, was used to find specific locations of genomic aberrations specific for various groups. We created a classifier for organ specific metastases based on the aCGH data using Prediction Analysis for Microarrays (PAM). Results: Specifically in the tumors of primary CRC patients who subsequently developed liver metastasis, KC-SMART analysis identified genomic aberrations on chromosome 20q. LM-PAM, a shrunken centroids classifier for liver metastases occurrence, was able to distinguish the LM group from the other groups (M0&PM) with 80% accuracy (78% sensitivity and 86% specificity). The classification is predominantly based on chromosome 20q aberrations. Conclusion: Liver specific CRC metastases may be predicted with a high accuracy based on specific genomic aberrations in the primary CRC tumor. The ability to predict the site of metastases is important for improvement of personalized patient management.MediamaticsElectrical Engineering, Mathematics and Computer Scienc

Quantitative copy number analysis by Multiplex Ligation-dependent Probe Amplification (MLPA) of BRCA1-associated breast cancer regions identifies BRCAness

Our group has previously employed array Comparative Genomic Hybridization (aCGH) to assess the genomic patterns of BRCA1-mutated breast cancers. We have shown that the so-called BRCA1-like(aCGH) profile is also present in about half of all triple-negative sporadic breast cancers and is predictive for benefit from intensified alkylating chemotherapy. As aCGH is a rather complex method, we translated the BRCA1(aCGH) profile to a Multiplex Ligation-dependent Probe Amplification (MLPA) assay, to identify both BRCA1-mutated breast cancers and sporadic cases with a BRCA1-like(aCGH) profile. The most important genomic regions of the original aCGH based classifier (3q22-27, 5q12-14, 6p23-22, 12p13, 12q21-23, 13q31-34) were mapped to a set of 34 MLPA probes. The training set consisted of 39 BRCA1-like(aCGH) breast cancers and 45 non-BRCA1-like(aCGH) breast cancers, which had previously been analyzed by aCGH. The BRCA1-like(aCGH) group consisted of germline BRCA1-mutated cases and sporadic tumours with low BRCA1 gene expression and/or BRCA1 promoter methylation. We trained a shrunken centroids classifier on the training set and validation was performed on an independent test set of 40 BRCA1-like(aCGH) breast cancers and 32 non-BRCA1-like(aCGH) breast cancer tumours. In addition, we validated the set prospectively on 69 new triple-negative tumours. BRCAness in the training set of 84 tumours could accurately be predicted by prediction analysis of microarrays (PAM) (accuracy 94%). Application of this classifier on the independent validation set correctly predicted BRCA-like status of 62 out of 72 breast tumours (86%). Sensitivity and specificity were 85% and 87%, respectively. When the MLPA-test was subsequently applied to 46 breast tumour samples from a randomized clinical trial, the same survival benefit for BRCA1-like tumours associated with intensified alkylating chemotherapy was shown as was previously reported using the aCGH assay. Since the MLPA assay can identify BRCA1-deficient breast cancer patients, this method could be applied both for clinical genetic testing and as a predictor of treatment benefit. BRCA1-like tumours are highly sensitive to chemotherapy with DNA damaging agents, and most likely to poly ADP ribose polymerase (PARP)-inhibitors. The MLPA assay is rapid and robust, can easily be multiplexed, and works well with DNA derived from paraffin-embedded tissue