Thought experiment: Decoding cognitive processes from the fMRI data of one individual

Wegrzyn M, Aust J, Barnstorf L, et al. Thought experiment: Decoding cognitive processes from the fMRI data of one individual. PLOS ONE. 2018;13(9): e0204338.Cognitive processes, such as the generation of language, can be mapped onto the brain using fMRI. These maps can in turn be used for decoding the respective processes from the brain activation patterns. Given individual variations in brain anatomy and organization, analyzes on the level of the single person are important to improve our understanding of how cognitive processes correspond to patterns of brain activity. They also allow to advance clinical applications of fMRI, because in the clinical setting making diagnoses for single cases is imperative. In the present study, we used mental imagery tasks to investigate language production, motor functions, visuo-spatial memory, face processing, and resting-state activity in a single person. Analysis methods were based on similarity metrics, including correlations between training and test data, as well as correlations with maps from the NeuroSynth meta-analysis. The goal was to make accurate predictions regarding the cognitive domain (e.g. language) and the specific content (e.g. animal names) of single 30-second blocks. Four teams used the dataset, each blinded regarding the true labels of the test data. Results showed that the similarity metrics allowed to reach the highest degrees of accuracy when predicting the cognitive domain of a block. Overall, 23 of the 25 test blocks could be correctly predicted by three of the four teams. Excluding the unspecific rest condition, up to 10 out of 20 blocks could be successfully decoded regarding their specific content. The study shows how the information contained in a single fMRI session and in each of its single blocks can allow to draw inferences about the cognitive processes an individual engaged in. Simple methods like correlations between blocks of fMRI data can serve as highly reliable approaches for cognitive decoding. We discuss the implications of our results in the context of clinical fMRI applications, with a focus on how decoding can support functional localization

Prior movement of one arm can facilitate motor adaptation in the other

Segments of a limb's motion sequence can be adjusted based on linked segments of the same sequence. Prerequisite for such adaptation to occur is that kinematics of the linked segments correctly predict which adjustments are needed. We show that use of kinematic information to improve performance is even possible when a prior linked movement is performed with a different limb. For example, a skilled juggler might have learned how to correctly adjust his catching movement of the left hand when the right hand deviated from the intended throwing action in a specific way. Linkage is possibly a key mechanism of the human motor system for learning complex bimanual skills. Our study emphasizes that motor learning of specific movements or skills should not be studied in isolation but within their motor sequence context

Speed sonification in a unimanual timing and a bimanual coordination tapping task

Gippert M, Heed T, Hermann T. Speed sonification in a unimanual timing and a bimanual coordination tapping task. In: Bresin R, Hansen K, Pauletto S, eds. Proceedings of ISon2019, the 6th Interactive Sonification Workshop. Stockholm, Sweden: Interactive-Sonification.org; 2019.This paper introduces systematic research on how uni- and bimanual tapping tasks can profit from interactive sonification of hand-surface interactions to support coordination. To that end, we developed a new experimental platform featuring a web app that allows multi-touch tablet-based interaction for sonification experiments. We present and discuss two experiments to test tap-interval-to-tone-frequency-mappings, to assess their ability to support rhythmic, resp. polyrhythmic tapping. The results, although negative with regards to our initial hypothesis, provide guidance for subsequent experiments to better understand how sonification can best be used to support coordination tasks, particularly in motor control contexts that involve discrete, goal-directed movements