Article thumbnail

Asynchrony adaptation reveals neural population code for audio-visual timing

By Neil W. Roach, James Heron, David Whitaker and Paul V. McGraw

Abstract

The relative timing of auditory and visual stimuli is a critical cue for determining whether sensory signals relate to a common source and for making inferences about causality. However, the way in which the brain represents temporal relationships remains poorly understood. Recent studies indicate that our perception of multisensory timing is flexible—adaptation to a regular inter-modal delay alters the point at which subsequent stimuli are judged to be simultaneous. Here, we measure the effect of audio-visual asynchrony adaptation on the perception of a wide range of sub-second temporal relationships. We find distinctive patterns of induced biases that are inconsistent with the previous explanations based on changes in perceptual latency. Instead, our results can be well accounted for by a neural population coding model in which: (i) relative audio-visual timing is represented by the distributed activity across a relatively small number of neurons tuned to different delays; (ii) the algorithm for reading out this population code is efficient, but subject to biases owing to under-sampling; and (iii) the effect of adaptation is to modify neuronal response gain. These results suggest that multisensory timing information is represented by a dedicated population code and that shifts in perceived simultaneity following asynchrony adaptation arise from analogous neural processes to well-known perceptual after-effects

Topics: Research Articles
Publisher: The Royal Society
OAI identifier: oai:pubmedcentral.nih.gov:3061136
Provided by: PubMed Central

To submit an update or takedown request for this paper, please submit an Update/Correction/Removal Request.

Suggested articles

Citations

  1. (1997). A direct demonstration of perceptual asynchrony in vision. P r o c .R .S o c .L o n d .B264,
  2. (2000). A functional angle on some after-effects in cortical vision.
  3. (2009). A neural model for temporal order judgments and their active recalibration: a common mechanism for space and time?
  4. (1976). Adaptation alters perceived direction of motion.
  5. (2004). Adaptation changes the direction tuning of macaque MT neurons.
  6. (2007). Adaptation minimizes distance-related audiovisual delays.
  7. Adaptation to audiovisual asynchrony modulates the speeded detection of sound.
  8. (2009). Adaptation to sensory-motor temporal misalignment: instrumental or perceptual learning?
  9. (1937). Adaptation, aftereffect and contrast in the perception of tilted lines.
  10. (1993). An introduction to the bootstrap.
  11. Attention regulates the plasticity of multisensory timing.
  12. Auditory-visual interaction in single cells in the cortex of the superior temporal sulcus and the orbital frontal cortex of the macaque monkey.
  13. (1969). Auditory-visual interaction in single units in the orbito-insular cortex of the cat.
  14. (1987). Determinants of multisensory integration in superior colliculus neurons. I. Temporal factors.
  15. (2008). Distortions of perceived auditory and visual space following adaptation to motion.
  16. (2009). Effect before cause: supramodal recalibration of sensorimotor timing.
  17. Errors in perceiving the temporal order of auditory and visual stimuli.
  18. (2000). Information processing with population codes.
  19. (1985). Integration of visual and auditory information in bimodal neurones in the guinea-pig superior colliculus.
  20. (2009). Is the homunculus ‘aware’ of sensory adaptation?
  21. (1908). Lectures on the elementary psychology of feeling and attention.
  22. (2006). Motor-sensory recalibration leads to an illusory reversal of action and sensation.
  23. (2003). Multisensory integration: maintaining the perception of synchrony.
  24. (2006). Neural correlations, population coding and computation.
  25. (2007). No effect of auditoryvisual spatial disparity on temporal recalibration.
  26. (1953). On the brightness of lights and loudness of sounds.
  27. (1999). Optimal decoding of noisy neuronal populations using recurrent networks.
  28. (2006). Optimal representation of sensory information by neural populations.
  29. (1966). Perception of temporal order and relative visual latency.
  30. (2011). Population coding of audio-visual timing
  31. (2008). Probablistic sensory recoding.
  32. (1978). Range and regression effects in magnitude scaling.
  33. (2008). Realignment of temporal simultaneity between vision and touch.
  34. Recalibration of audiovisual simultaneity.
  35. (2009). Recalibration of multisensory simultaneity: cross-modal transfer coincides with a change in perceptual latency.
  36. (2008). Recalibration of perceived time across sensory modalities.
  37. Recalibration of temporal order perception by exposure to audio-visual asynchrony.
  38. (1966). Regression effect in psychophysical judgement.
  39. (1996). Representation and integration of multiple sensory inputs in primate superior colliculus.
  40. (1993). Simple models for reading neuronal population codes.
  41. (2005). Simultaneity constancy: detecting events with touch and vision.
  42. (2007). Space and time in visual context.
  43. (1993). Spatial frequency adaptation and contrast gain control.
  44. Temporal recalibration during asynchronous audiovisual speech perception.
  45. (2008). Temporal recalibration to tactile-visual asynchronous stimuli.
  46. (2008). The effect of exposure to asynchronous audio, visual, and tactile stimulus combinations on the perception of simultaneity.
  47. (1973). The perception of temporal order: fundamental issues and a general model.
  48. (1987). Threshold models of temporal-order judgments evaluated by a ternary response task.
  49. (2005). Tilt aftereffect and adaptation-induced changes in orientation tuning in visual cortex.
  50. (1954). Variations of the latent period of vision.
  51. (2007). Visual adaptation: physiology, mechanisms, and functional benefits.
  52. (1971). Visual feature-analyzers and aftereffects of tilt and curvature.
  53. (2002). Voluntary action and conscious awareness.