Simultaneous inference for misaligned multivariate functional data

We consider inference for misaligned multivariate functional data that represents the same underlying curve, but where the functional samples have systematic differences in shape. In this paper we introduce a new class of generally applicable models where warping effects are modeled through nonlinear transformation of latent Gaussian variables and systematic shape differences are modeled by Gaussian processes. To model cross-covariance between sample coordinates we introduce a class of low-dimensional cross-covariance structures suitable for modeling multivariate functional data. We present a method for doing maximum-likelihood estimation in the models and apply the method to three data sets. The first data set is from a motion tracking system where the spatial positions of a large number of body-markers are tracked in three-dimensions over time. The second data set consists of height and weight measurements for Danish boys. The third data set consists of three-dimensional spatial hand paths from a controlled obstacle-avoidance experiment. We use the developed method to estimate the cross-covariance structure, and use a classification setup to demonstrate that the method outperforms state-of-the-art methods for handling misaligned curve data.Comment: 44 pages in total including tables and figures. Additional 9 pages of supplementary material and reference

A review and consideration on the kinematics of reach-to-grasp movements in macaque monkeys

The bases for understanding the neuronal mechanisms that underlie the control of reach-to-grasp movements among nonhuman primates, particularly macaques, has been widely studied. However, only a few kinematic descriptions of their prehensile actions are available. A thorough understanding of macaques' prehensile movements is manifestly critical, in light of their role in biomedical research as valuable models for studying neuromotor disorders and brain mechanisms, as well as for developing brain-machine interfaces to facilitate arm control. This article aims to review the current state of knowledge on the kinematics of grasping movements that macaques perform in naturalistic, semi-naturalistic, and laboratory settings, to answer the following questions: Are kinematic signatures affected by the context within which the movement is performed? In what ways is kinematics of humans' and macaques' prehensile actions similar/dissimilar? Our analysis reflects the challenges involved in making comparisons across settings and species due to the heterogeneous picture in terms of the number of subjects, stimuli, conditions, and hands used. The kinematics of free-ranging macaques are characterized by distinctive features that are exhibited neither by macaques in laboratory setting nor human subjects. The temporal incidence of key kinematic landmarks diverges significantly between species, indicating disparities in the overall organization of movement. Given such complexities, we attempt a synthesis of extant body of evidence, intending to generate some significant implications for directions that future research might take, to recognize the remaining gaps and pursue the insights and resolutions to generate an interpretation of movement kinematics that accounts for all settings and subjects

Spatial encoding in primate hippocampus during free navigation.

The hippocampus comprises two neural signals-place cells and θ oscillations-that contribute to facets of spatial navigation. Although their complementary relationship has been well established in rodents, their respective contributions in the primate brain during free navigation remains unclear. Here, we recorded neural activity in the hippocampus of freely moving marmosets as they naturally explored a spatial environment to more explicitly investigate this issue. We report place cells in marmoset hippocampus during free navigation that exhibit remarkable parallels to analogous neurons in other mammalian species. Although θ oscillations were prevalent in the marmoset hippocampus, the patterns of activity were notably different than in other taxa. This local field potential oscillation occurred in short bouts (approximately .4 s)-rather than continuously-and was neither significantly modulated by locomotion nor consistently coupled to place-cell activity. These findings suggest that the relationship between place-cell activity and θ oscillations in primate hippocampus during free navigation differs substantially from rodents and paint an intriguing comparative picture regarding the neural basis of spatial navigation across mammals

Speaking Rate Effects on Locus Equation Slope

A locus equation describes a 1st order regression fit to a scatter of vowel steady-state frequency values predicting vowel onset frequency values. Locus equation coefficients are often interpreted as indices of coarticulation. Speaking rate variations with a constant consonant–vowel form are thought to induce changes in the degree of coarticulation. In the current work, the hypothesis that locus slope is a transparent index of coarticulation is examined through the analysis of acoustic samples of large-scale, nearly continuous variations in speaking rate. Following the methodological conventions for locus equation derivation, data pooled across ten vowels yield locus equation slopes that are mostly consistent with the hypothesis that locus equations vary systematically with coarticulation. Comparable analyses between different four-vowel pools reveal variations in the locus slope range and changes in locus slope sensitivity to rate change. Analyses across rate but within vowels are substantially less consistent with the locus hypothesis. Taken together, these findings suggest that the practice of vowel pooling exerts a non-negligible influence on locus outcomes. Results are discussed within the context of articulatory accounts of locus equations and the effects of speaking rate change

Toward a semi-self-paced EEG brain computer interface: decoding initiation state from non-initiation state in dedicated time slots.

Brain computer interfaces (BCIs) offer a broad class of neurologically impaired individuals an alternative means to interact with the environment. Many BCIs are "synchronous" systems, in which the system sets the timing of the interaction and tries to infer what control command the subject is issuing at each prompting. In contrast, in "asynchronous" BCIs subjects pace the interaction and the system must determine when the subject's control command occurs. In this paper we propose a new idea for BCI which draws upon the strengths of both approaches. The subjects are externally paced and the BCI is able to determine when control commands are issued by decoding the subject's intention for initiating control in dedicated time slots. A single task with randomly interleaved trials was designed to test whether it can be used as stimulus for inducing initiation and non-initiation states when the sensory and motor requirements for the two types of trials are very nearly identical. Further, the essential problem on the discrimination between initiation state and non-initiation state was studied. We tested the ability of EEG spectral power to distinguish between these two states. Among the four standard EEG frequency bands, beta band power recorded over parietal-occipital cortices provided the best performance, achieving an average accuracy of 86% for the correct classification of initiation and non-initiation states. Moreover, delta band power recorded over parietal and motor areas yielded a good performance and thus could also be used as an alternative feature to discriminate these two mental states. The results demonstrate the viability of our proposed idea for a BCI design based on conventional EEG features. Our proposal offers the potential to mitigate the signal detection challenges of fully asynchronous BCIs, while providing greater flexibility to the subject than traditional synchronous BCIs

Buffer loading and chunking in sequential keypressing

Thirty-six participants practiced a task in which they continuously cycled through a fixed series of nine keypresses, each carried out by a single finger (cf. Keele & Summers, 1976). The results of the first experimental phase, the practice phase, support the notion that pauses between successive keypresses at fixed locations induces the development of integrated sequence representations (i.e., motor chunks) and reject the idea that a rhythm is learned. When different sequences were produced in the transfer phase, performance dropped considerably unless the sequence was relatively short and there was ample time for preparation. This demonstrates that motor chunks are content specific and that the absence of motor chunks shows when there is no time for advance loading of the motor buffer or the capacity of the motor buffer is insufficient to contain the entire keypressing sequence

Haptics for the development of fundamental rhythm skills, including multi-limb coordination

This chapter considers the use of haptics for learning fundamental rhythm skills, including skills that depend on multi-limb coordination. Different sensory modalities have different strengths and weaknesses for the development of skills related to rhythm. For example, vision has low temporal resolution and performs poorly for tracking rhythms in real-time, whereas hearing is highly accurate. However, in the case of multi-limbed rhythms, neither hearing nor sight are particularly well suited to communicating exactly which limb does what and when, or how the limbs coordinate. By contrast, haptics can work especially well in this area, by applying haptic signals independently to each limb. We review relevant theories, including embodied interaction and biological entrainment. We present a range of applications of the Haptic Bracelets, which are computer-controlled wireless vibrotactile devices, one attached to each wrist and ankle. Haptic pulses are used to guide users in playing rhythmic patterns that require multi-limb coordination. One immediate aim of the system is to support the development of practical rhythm skills and multi-limb coordination. A longer-term goal is to aid the development of a wider range of fundamental rhythm skills including recognising, identifying, memorising, retaining, analysing, reproducing, coordinating, modifying and creating rhythms – particularly multi-stream (i.e. polyphonic) rhythmic sequences. Empirical results are presented. We reflect on related work, and discuss design issues for using haptics to support rhythm skills. Skills of this kind are essential not just to drummers and percussionists but also to keyboards players, and more generally to all musicians who need a firm grasp of rhythm

An Ensemble Analysis of Electromyographic Activity during Whole Body Pointing with the Use of Support Vector Machines

We explored the use of support vector machines (SVM) in order to analyze the ensemble activities of 24 postural and focal muscles recorded during a whole body pointing task. Because of the large number of variables involved in motor control studies, such multivariate methods have much to offer over the standard univariate techniques that are currently employed in the field to detect modifications. The SVM was used to uncover the principle differences underlying several variations of the task. Five variants of the task were used. An unconstrained reaching, two constrained at the focal level and two at the postural level. Using the electromyographic (EMG) data, the SVM proved capable of distinguishing all the unconstrained from the constrained conditions with a success of approximately 80% or above. In all cases, including those with focal constraints, the collective postural muscle EMGs were as good as or better than those from focal muscles for discriminating between conditions. This was unexpected especially in the case with focal constraints. In trying to rank the importance of particular features of the postural EMGs we found the maximum amplitude rather than the moment at which it occurred to be more discriminative. A classification using the muscles one at a time permitted us to identify some of the postural muscles that are significantly altered between conditions. In this case, the use of a multivariate method also permitted the use of the entire muscle EMG waveform rather than the difficult process of defining and extracting any particular variable. The best accuracy was obtained from muscles of the leg rather than from the trunk. By identifying the features that are important in discrimination, the use of the SVM permitted us to identify some of the features that are adapted when constraints are placed on a complex motor task

Machine Analysis of Facial Expressions

No abstract

Movement variability in stroke patients and controls performing two upper limb functional tasks: a new assessment methodology

Background: In the evaluation of upper limb impairment post stroke there remains a gap between detailed kinematic analyses with expensive motion capturing systems and common clinical assessment tests. In particular, although many clinical tests evaluate the performance of functional tasks, metrics to characterise upper limb kinematics are generally not applicable to such tasks and very limited in scope. This paper reports on a novel, user-friendly methodology that allows for the assessment of both signal magnitude and timing variability in upper limb movement trajectories during functional task performance. In order to demonstrate the technique, we report on a study in which the variability in timing and signal magnitude of data collected during the performance of two functional tasks is compared between a group of subjects with stroke and a group of individually matched control subjects. Methods: We employ dynamic time warping for curve registration to quantify two aspects of movement variability: 1) variability of the timing of the accelerometer signals' characteristics and 2) variability of the signals' magnitude. Six stroke patients and six matched controls performed several trials of a unilateral ('drinking') and a bilateral ('moving a plate') functional task on two different days, approximately 1 month apart. Group differences for the two variability metrics were investigated on both days. Results: For 'drinking from a glass' significant group differences were obtained on both days for the timing variability of the acceleration signals' characteristics (p = 0.002 and p = 0.008 for test and retest, respectively); all stroke patients showed increased signal timing variability as compared to their corresponding control subject. 'Moving a plate' provided less distinct group differences. Conclusion: This initial application establishes that movement variability metrics, as determined by our methodology, appear different in stroke patients as compared to matched controls during unilateral task performance ('drinking'). Use of a user-friendly, inexpensive accelerometer makes this methodology feasible for routine clinical evaluations. We are encouraged to perform larger studies to further investigate the metrics' usefulness when quantifying levels of impairment