The critical events for motor-sensory temporal recalibration

Determining if we, or another agent, were responsible for a sensory event can require an accurate sense of timing. Our sense of appropriate timing relationships must, however, be malleable as there is a variable delay between the physical timing of an event and when sensory signals concerning that event are encoded in the brain. One dramatic demonstration of such malleability involves having people repeatedly press a button thereby causing a beep. If a delay is inserted between button presses and beeps, when it is subsequently taken away beeps can seem to precede the button presses that caused them. For this to occur it is important that people feel they were responsible for instigating the beeps. In terms of their timing, as yet it is not clear what combination of events is important for motor-sensory temporal recalibration. Here, by introducing ballistic reaches of short or longer extent before a button press, we varied the delay between the intention to act and the sensory consequence of that action. This manipulation failed to modulate recalibration magnitude. By contrast, introducing a similarly lengthened delay between button presses and consequent beeps eliminated recalibration. Thus it would seem that the critical timing relationship for motor-sensory temporal recalibration is between tactile signals relating to the completion of an action and the subsequent auditory percept

Spatial grouping resolves ambiguity to drive temporal recalibration.

Cross-modal temporal recalibration describes a shift in the point of subjective simultaneity (PSS) between 2 events following repeated exposure to asynchronous cross-modal inputs-the adaptors. Previous research suggested that audiovisual recalibration is insensitive to the spatial relationship between the adaptors. Here we show that audiovisual recalibration can be driven by cross-modal spatial grouping. Twelve participants adapted to alternating trains of lights and tones. Spatial position was manipulated, with alternating sequences of a light then a tone, or a tone then a light, presented on either side of fixation (e.g., left tone-left light-right tone-right light, etc.). As the events were evenly spaced in time, in the absence of spatial-based grouping it would be unclear if tones were leading or lagging lights. However, any grouping of spatially colocalized cross-modal events would result in an unambiguous sense of temporal order. We found that adapting to these stimuli caused the PSS between subsequent lights and tones to shift toward the temporal relationship implied by spatial-based grouping. These data therefore show that temporal recalibration is facilitated by spatial grouping. (PsycINFO Database Record (c) 2011 APA, all rights reserved)

Neural correlates of subjective timing precision and confidence

Humans perceptual judgments are imprecise, as repeated exposures to the same physical stimulation (e.g. audio-visual inputs separated by a constant temporal offset) can result in different decisions. Moreover, there can be marked individual differences – precise judges will repeatedly make the same decision about a given input, whereas imprecise judges will make different decisions. The causes are unclear. We examined this using audio-visual (AV) timing and confidence judgments, in conjunction with electroencephalography (EEG) and multivariate pattern classification analyses. One plausible cause of differences in timing precision is that it scales with variance in the dynamics of evoked brain activity. Another possibility is that equally reliable patterns of brain activity are evoked, but there are systematic differences that scale with precision. Trial-by-trial decoding of input timings from brain activity suggested precision differences may not result from variable dynamics. Instead, precision was associated with evoked responses that were exaggerated (more different from baseline) ~300 ms after initial physical stimulations. We suggest excitatory and inhibitory interactions within a winner-take-all neural code for AV timing might exaggerate responses, such that evoked response magnitudes post-stimulation scale with encoding success

Weighted integration suggests that visual and tactile signals provide independent estimates about duration

Humans might possess either a single (amodal) internal clock, or multiple clocks for different sensory modalities. Sensitivity could be improved by the provision of multiple signals. Such improvements can be predicted quantitatively, assuming estimates are combined by summation, a process described as optimal when summation is weighted in accordance with the variance associated with each of the initially independent estimates. We assessed this possibility for visual and tactile information regarding temporal intervals. In Experiment 1, 12 musicians and 12 nonmusicians judged durations of 300 and 600 ms, compared to test values spanning these standards. Bimodal precision increased relative to unimodal conditions, but not by the extent predicted by optimally weighted summation. In Experiment 2, six musicians and six other participants each judged six standards, ranging from 100 ms to 600 ms, with conflicting cues providing a measure of the weight assigned to each sensory modality. A weighted integration model best fitted these data, with musicians more likely to select near-optimal weights than non-musicians. Overall, data were consistent with the existence of separate visual and tactile clock components at either the counter/integrator or memory stages. Independent estimates are passed to a decisional process, but not always combined in a statistically optimal fashion

A model-based comparison of three theories of audiovisual temporal recalibration

Observers change their audio-visual timing judgements after exposure to asynchronous audiovisual signals. The mechanism underlying this temporal recalibration is currently debated. Three broad explanations have been suggested. According to the first, the time it takes for sensory signals to propagate through the brain has changed. The second explanation suggests that decisional criteria used to interpret signal timing have changed, but not time perception itself. A final possibility is that a population of neurones collectively encode relative times, and that exposure to a repeated timing relationship alters the balance of responses in this population. Here, we simplified each of these explanations to its core features in order to produce three corresponding six-parameter models, which generate contrasting patterns of predictions about how simultaneity judgements should vary across four adaptation conditions: No adaptation, synchronous adaptation, and auditory leading/lagging adaptation. We tested model predictions by fitting data from all four conditions simultaneously, in order to assess which model/explanation best described the complete pattern of results. The latency-shift and criterion-change models were better able to explain results for our sample as a whole. The population-code model did, however, account for improved performance following adaptation to a synchronous adapter, and best described the results of a subset of observers who reported least instances of synchrony

Perceptual confidence demonstrates trial-by-trial insight into the precision of audio-visual timing encoding

Peoples’ subjective feelings of confidence typically correlate positively with objective measures of task performance, even when no performance feedback is provided. This relationship has seldom been investigated in the field of human time perception. Here we find a positive relationship between the precision of human timing perception and decisional confidence. We first demonstrate that subjective audio–visual timing judgements are more precise when people report a high, as opposed to a low, level of confidence. We then find that this relationship is more likely to result from variance in sensory timing estimates than the application of variable decision criteria, as the relationship held when we adopted a measure of timing sensitivity designed to limit the influence of subjective criteria. Our results suggest analyses of timing perception and associated decisional confidence reflect the trial-by-trial variability with which timing has been encoded

Auditory and Visual Durations Load a Unitary Working-Memory Resource

Items in working memory are typically defined by various attributes, such as colour (for visual objects) and pitch (for auditory objects). The attribute of duration can be signalled by multiple modalities, but has received relatively little attention from a working-memory perspective. While the existence of specialist stores (e.g., the phonological loop and visuospatial sketchpad) is often asserted in the wider working-memory literature, the interval-timing literature has more often implied a unitary (amodal) store. Here we combine two modelling frameworks to probe the basis of working memory for duration; a Bayesian-observer framework, previously used to explain behaviour in duration-reproduction tasks, and mixture models, describing distributions of continuous reports about items in working memory. We modelled different storage mechanisms, such as a limited number of fixed-resolution slots or a resource spread between items at a cost to resolution, in order to ask whether items from different sensory modalities are maintained in separate, independent stores. We initially analysed data from 32 participants, who memorised between one and eight items before reproducing the duration of a randomly selected target. In separate blocks, items could be all visual, all auditory, or an alternating mixture of both. A small control experiment included a further condition with precuing of target modality. Certain kinds of slot models, resource models, and combination models incorporating both mechanisms could account for the data. However, looking across all plausible models, the decline in performance with increasing memory load was most consistent with a single store for event durations, regardless of stimulus modality

Sensorimotor temporal recalibration within and across limbs

Deciding precisely when we have acted is challenging, as actions involve a train of neural events spread across both space and time. Repeated delays between actions and consequent events can result in a shift, such that immediate feedback can seem to precede the causative act. Here we examined which neurocognitive representations are affected during such sensorimotor temporal recalibration, by testing if the effect generalizes across limbs and whether it might reflect altered decision criteria for temporal judgments. Hand or foot adaptation phases were interspersed with simultaneity judgments about actions involving the same or opposite limb. Shifts in the distribution of participants' simultaneity responses were quantified using a detection-theoretic model, where a shift of both boundaries together gives a stronger indication that the effect is not simply a result of decision bias. By demonstrating that temporal recalibration occurs in the foot as well as the hand, we confirmed that it is a robust motor phenomenon: Both low and high boundaries shifted reliably in the same-limb conditions. However, in cross-limb conditions only the high boundary shifted reliably. These two patterns are interpreted to reflect a genuine change in how the time of action is represented, and a timing criterion shift, respectively. (PsycINFO Database Record (c) 2013 APA, all rights reserved)