Timing and correction of stepping movements with a virtual reality avatar

Research into the ability to coordinate one’s movements with external cues has focussed on the use of simple rhythmic, auditory and visual stimuli, or interpersonal coordination with another person. Coordinating movements with a virtual avatar has not been explored, in the context of responses to temporal cues. To determine whether cueing of movements using a virtual avatar is effective, people’s ability to accurately coordinate with the stimuli needs to be investigated. Here we focus on temporal cues, as we know from timing studies that visual cues can be difficult to follow in the timing context. Real stepping movements were mapped onto an avatar using motion capture data. Healthy participants were then motion captured whilst stepping in time with the avatar’s movements, as viewed through a virtual reality headset. The timing of one of the avatar step cycles was accelerated or decelerated by 15% to create a temporal perturbation, for which participants would need to correct to, in order to remain in time. Step onset times of participants relative to the corresponding step-onsets of the avatar were used to measure the timing errors (asynchronies) between them. Participants completed either a visual-only condition, or auditory-visual with footstep sounds included, at two stepping tempo conditions (Fast: 400ms interval, Slow: 800ms interval). Participants’ asynchronies exhibited slow drift in the Visual-Only condition, but became stable in the Auditory-Visual condition. Moreover, we observed a clear corrective response to the phase perturbation in both the fast and slow tempo auditory-visual conditions. We conclude that an avatar’s movements can be used to influence a person’s own motion, but should include relevant auditory cues congruent with the movement to ensure a suitable level of entrainment is achieved. This approach has applications in physiotherapy, where virtual avatars present an opportunity to provide the guidance to assist patients in adhering to prescribed exercises

Regularity and asynchrony when tapping to tactile, auditory and combined pulses

This research is carried out with the aim to develop assistive technology that helps users following the beat in music, which is of interest to cohchlear implant users. The envisioned technology would use tactile feedback on each musical beat. However, this raises fundamental questions about uni- and cross-modal perception which are not addressed in similar context in the literature. The aim of this study was i) to find out how well users are able to follow tactile pulses. ii) To gain insights in the differences between auditory, tactile and combined auditory-tactile feedback. A tapping experiment was organized with 27 subjects. They were requested to tap along with an auditory pulse, a tactile pulse and a combined auditory-tactile pulse in three different tempi. An evaluation with respect to regularity and asynchrony followed. Subjects were found to perform significantly better in terms of reqularity and asynchrony for the auditory and auditory/tactile condition with respect to the tactile only condition. Mean negative asynchrony (MNA) for auditory and combined (auditory and tactile) conditions were in the range of previous studies. The MNA’s for the tactile conditions showed a remarkable dependence on tempo. In the 90BPM condition a clear anticipation (-20ms) was reported, for the 120BPM condition the mean was around zero, the 150BPM condition showed a positive MNA (a reaction vs anticipation). An effect that could be encorporated into the design of an assistive technology

A Tablet-Based Assessment of Rhythmic Ability.

The exponential rise in use of mobile consumer electronics has presented a great potential for research to be conducted remotely, with participants numbering several orders of magnitude greater than a typical research paradigm. Here, we attempt to demonstrate the validity and reliability of using a consumer game-engine to create software presented on a mobile tablet to assess sensorimotor synchronization, a proxy of rhythmic ability. Our goal was to ascertain whether previously observed research results can be replicated, rather than assess whether a mobile tablet achieves comparable performance to a desktop computer. To achieve this, younger (aged 18-35 years) and older (aged 60-80 years) adult musicians and non-musicians were recruited to play a custom-designed sensorimotor synchronization assessment on a mobile tablet in a controlled laboratory environment. To assess reliability, participants performed the assessment twice, separated by a week, and an intra-class correlation coefficient (ICC) was calculated. Results supported the validity of this approach to assessing rhythmic abilities by replicating previously observed results. Specifically, musicians performed better than non-musicians, and younger adults performed better than older adults. Participants also performed best when the tempo was in the range of previously-identified preferred tempos, when the stimuli included both audio and visual information, and when synchronizing on-beat compared to off-beat or continuation (self-paced) synchronization. Additionally, high ICC values (>0.75) suggested excellent test-retest reliability. Together, these results support the notion that consumer electronics running software built with a game engine may serve as a valuable resource for remote, mobile-based data collection of rhythmic abilities

Hatching asynchrony, survival, and the fitness of alternative adult morphs in \u3ci\u3eAmbystoma talpoideum\u3c/i\u3e

The mole salamander, Ambystoma talpoideum, exhibits both aquatic (gilled) and terrestrial (metamorphosed) adult morphologies. Previous studies have shown the existence of body-size advantages associated with the terrestrial morph in A. talpoideum and other polymorphic salamanders (e.g., A. tigrinum). However, aquatic adult A. talpoideum mature at a younger age and often breed earlier than terrestrial adults. We tested the hypothesis that early maturation and reproduction in aquatic adults increase fitness (irrespective of body size). We reared larval A. talpoideum in mesocosms and varied the timing of hatching, with early-hatching larvae representing the offspring from early-breeding aquatic adults, and late-hatching larvae representing the offspring of later-breeding terrestrial adults. Our results demonstrate significantly higher survival rates among early-hatchlings relative to late-hatching conspecifics, supporting the hypothesis that early reproduction may be an important mechanism mediating the polymorphism in A. talpoideum. We discuss our results within the context of size-based models of the fitness of alternative life-cycles

Optimal integration of auditory and vibrotactile information for judgments of temporal order

Recent research that assessed spatial judgments about multisensory stimuli suggests that humans integrate multisensory inputs in a statistically optimal manner by weighting each input by its normalized reciprocal variance. Is integration similarly optimal When humans judge the temporal properties of bimodal stimuli? Twenty-four participants performed temporal order judgments (TOJs,) about 2 spatially separated stimuli. Stimuli were auditory, vibrotactile, or both. The temporal profiles of vibrotactile stimuli were manipulated to produce 3 levels of precision for TOJs. In bimodal conditions, the asynchrony between the 2 unimodal stimuli that comprised it bimodal Stimulus was manipulated to determine the weight given to touch. Bimodal performance on 2 measures-judgment uncertainty and tactile weight-was predicted With unimodal data. A model relying exclusively on audition wits rejected on the basis of both measures. A second model that selected the best input on each trial did not predict the reduced judgment uncertainty observed in bimodal trials. Only the optimal Maximum-likelihood-estimation model predicted both judgment uncertainties and weights the model's validity is extended to TOJs. Alternatives for modeling the process of event sequencing based on integrated multisensory inputs are discussed

Compensating asynchrony effects in the calculation of financial correlations

We present a method to compensate statistical errors in the calculation of correlations on asynchronous time series. The method is based on the assumption of an underlying time series. We set up a model and apply it to financial data to examine the decrease of calculated correlations towards smaller return intervals (Epps effect). We show that this statistical effect is a major cause of the Epps effect. Hence, we are able to quantify and to compensate it using only trading prices and trading times.Comment: 13 pages, 7 figure

Accumulated Gradient Normalization

This work addresses the instability in asynchronous data parallel optimization. It does so by introducing a novel distributed optimizer which is able to efficiently optimize a centralized model under communication constraints. The optimizer achieves this by pushing a normalized sequence of first-order gradients to a parameter server. This implies that the magnitude of a worker delta is smaller compared to an accumulated gradient, and provides a better direction towards a minimum compared to first-order gradients, which in turn also forces possible implicit momentum fluctuations to be more aligned since we make the assumption that all workers contribute towards a single minima. As a result, our approach mitigates the parameter staleness problem more effectively since staleness in asynchrony induces (implicit) momentum, and achieves a better convergence rate compared to other optimizers such as asynchronous EASGD and DynSGD, which we show empirically.Comment: 16 pages, 12 figures, ACML201

A Max-Plus Model of Asynchronous Cellular Automata

This paper presents a new framework for asynchrony. This has its origins in our attempts to better harness the internal decision making process of cellular automata (CA). Thus, we show that a max-plus algebraic model of asynchrony arises naturally from the CA requirement that a cell receives the state of each neighbour before updating. The significant result is the existence of a bijective mapping between the asynchronous system and the synchronous system classically used to update cellular automata. Consequently, although the CA outputs look qualitatively different, when surveyed on "contours" of real time, the asynchronous CA replicates the synchronous CA. Moreover, this type of asynchrony is simple - it is characterised by the underlying network structure of the cells, and long-term behaviour is deterministic and periodic due to the linearity of max-plus algebra. The findings lead us to proffer max-plus algebra as: (i) a more accurate and efficient underlying timing mechanism for models of patterns seen in nature, and (ii) a foundation for promising extensions and applications.Comment: in Complex Systems (Complex Systems Publications Inc), Volume 23, Issue 4, 201

Shifts of criteria or neural timing? The assumptions underlying timing perception studies

In timing perception studies, the timing of one event is usually manipulated relative to another, and participants are asked to judge if the two events were synchronous, or to judge which of the two events occurred first. Responses are analyzed to determine a measure of central tendency, which is taken as an estimate of the timing at which the two events are perceptually synchronous. When these estimates do not coincide with physical synchrony, it is often assumed that the sensory signals are asynchronous, as though the transfer of information concerning one input has been accelerated or decelerated relative to the other. Here we show that, while this is a viable interpretation, it is equally plausible that such effects are driven by shifts in the criteria used to differentiate simultaneous from asynchronous inputs. Our analyses expose important ambiguities concerning the interpretation of simultaneity judgement data, which have hitherto been underappreciated