Parise C, Spence C. ‘When Birds of a Feather Flock Together’: Synesthetic Correspondences Modulate Audiovisual Integration in Non-Synesthetes. Presented at the 10th International Multisensory Research Forum (IMRF 2009), New York, NY

A Gallace

A Vatakis

A Watson

AB Watson

C Parise

Cesare Valerio Parise

Charles Spence

D Alais

D Burr

D Shore

D Slutsky

David C. Burr

E Sapir

F Wichmann

G Martino

H de Lange Dzn

H Helbig

IH Bernstein

J Bresciani

J Hillis

J Robson

L Marks

LE Marks

M Ernst

MW O'Boyle

P Bertelson

P Walker

PJ Rousseeuw

R Cohen Kadosh

R King

R Welch

RD Melara

S Morein-Zamir

W Dixon

English

PubMed

Background: Synesthesia is a condition in which the stimulation of one sense elicits an additional experience, often in a different (i.e. unstimulated) sense. Although only a small proportion of the population is synesthetic, there is growing evidence to suggest that neurocognitively-normal individuals also experience some form of synesthetic association between the stimuli presented to different sensory modalities (i.e., between auditory pitch and visual size, where lower frequency tones are associated with large objects and higher frequency tones with small objects). While previous research has highlighted crossmodal interactions between synesthetically corresponding dimensions, the possible role of synesthetic association in multisensory integration has not been considered previously. Methodology: Here we investigate the effects of synesthetic associations by presenting pairs of asynchronous or spatially discrepant visual and auditory stimuli that were either synesthetically matched or mismatched. In a series of three psychophysical experiments, participants reported the relative temporal order of presentation or the relative spatial locations of the two stimuli. Principal Findings: The reliability of non-synesthetic participants’ estimates of both audiovisual temporal asynchrony and spatial discrepancy were lower for pairs of synesthetically matched as compared to synesthetically mismatched audiovisual stimuli. Conclusions: Recent studies of multisensory integration have shown that the reduced reliability of perceptual estimates regarding intersensory conflicts constitutes the marker of a stronger coupling between the unisensory signals. Our results therefore indicate a stronger coupling of synesthetically matched vs. mismatched stimuli and provide the first psychophysical evidence that synesthetic congruency can promote multisensory integration. Synesthetic crossmodal correspondences therefore appear to play a crucial (if unacknowledged) role in the multisensory integration of auditory and visual information

Parise, Cesare Valerio

Spence, Charles

ORA - Oxford University Research Archive

'When birds of a feather flock together': synesthetic correspondences modulate audiovisual integration in non-synesthetes

BACKGROUND: Synesthesia is a condition in which the stimulation of one sense elicits an additional experience, often in a different (i.e., unstimulated) sense. Although only a small proportion of the population is synesthetic, there is growing evidence to suggest that neurocognitively-normal individuals also experience some form of synesthetic association between the stimuli presented to different sensory modalities (i.e., between auditory pitch and visual size, where lower frequency tones are associated with large objects and higher frequency tones with small objects). While previous research has highlighted crossmodal interactions between synesthetically corresponding dimensions, the possible role of synesthetic associations in multisensory integration has not been considered previously. METHODOLOGY: Here we investigate the effects of synesthetic associations by presenting pairs of asynchronous or spatially discrepant visual and auditory stimuli that were either synesthetically matched or mismatched. In a series of three psychophysical experiments, participants reported the relative temporal order of presentation or the relative spatial locations of the two stimuli. PRINCIPAL FINDINGS: The reliability of non-synesthetic participants' estimates of both audiovisual temporal asynchrony and spatial discrepancy were lower for pairs of synesthetically matched as compared to synesthetically mismatched audiovisual stimuli. CONCLUSIONS: Recent studies of multisensory integration have shown that the reduced reliability of perceptual estimates regarding intersensory conflicts constitutes the marker of a stronger coupling between the unisensory signals. Our results therefore indicate a stronger coupling of synesthetically matched vs. mismatched stimuli and provide the first psychophysical evidence that synesthetic congruency can promote multisensory integration. Synesthetic crossmodal correspondences therefore appear to play a crucial (if unacknowledged) role in the multisensory integration of auditory and visual information

Parise, CV

Spence, C

'When birds of a feather flock together': synesthetic correspondences modulate audiovisual integration in non-synesthetes.

Oxford University Research Archive (ORA)

Background Synesthesia is a condition in which the stimulation of one sense elicits an additional experience, often in a different (i.e., unstimulated) sense. Although only a small proportion of the population is synesthetic, there is growing evidence to suggest that neurocognitively-normal individuals also experience some form of synesthetic association between the stimuli presented to different sensory modalities (i.e., between auditory pitch and visual size, where lower frequency tones are associated with large objects and higher frequency tones with small objects). While previous research has highlighted crossmodal interactions between synesthetically corresponding dimensions, the possible role of synesthetic associations in multisensory integration has not been considered previously. Methodology Here we investigate the effects of synesthetic associations by presenting pairs of asynchronous or spatially discrepant visual and auditory stimuli that were either synesthetically matched or mismatched. In a series of three psychophysical experiments, participants reported the relative temporal order of presentation or the relative spatial locations of the two stimuli. Principal Findings The reliability of non-synesthetic participants' estimates of both audiovisual temporal asynchrony and spatial discrepancy were lower for pairs of synesthetically matched as compared to synesthetically mismatched audiovisual stimuli. Conclusions Recent studies of multisensory integration have shown that the reduced reliability of perceptual estimates regarding intersensory conflicts constitutes the marker of a stronger coupling between the unisensory signals. Our results therefore indicate a stronger coupling of synesthetically matched vs. mismatched stimuli and provide the first psychophysical evidence that synesthetic congruency can promote multisensory integration. Synesthetic crossmodal correspondences therefore appear to play a crucial (if unacknowledged) role in the multisensory integration of auditory and visual information

Parise, C.

Spence, C.

MPG.PuRe

"When Birds of a Feather Flock Together": Synesthetic Correspondences Modulate Audiovisual Integration in Non-Synesthetes

Parise C, Spence C. 'When Birds of a Feather Flock Together': Synesthetic Correspondences Modulate Audiovisual Integration in Non-Synesthetes. PLoS ONE. 2009;4(5):e5664.Background: Synesthesia is a condition in which the stimulation of one sense elicits an additional experience, often in a different (i.e., unstimulated) sense. Although only a small proportion of the population is synesthetic, there is growing evidence to suggest that neurocognitively-normal individuals also experience some form of synesthetic association between the stimuli presented to different sensory modalities (i.e., between auditory pitch and visual size, where lower frequency tones are associated with large objects and higher frequency tones with small objects). While previous research has highlighted crossmodal interactions between synesthetically corresponding dimensions, the possible role of synesthetic associations in multisensory integration has not been considered previously. Methodology: Here we investigate the effects of synesthetic associations by presenting pairs of asynchronous or spatially discrepant visual and auditory stimuli that were either synesthetically matched or mismatched. In a series of three psychophysical experiments, participants reported the relative temporal order of presentation or the relative spatial locations of the two stimuli. Principal Findings: The reliability of non-synesthetic participants' estimates of both audiovisual temporal asynchrony and spatial discrepancy were lower for pairs of synesthetically matched as compared to synesthetically mismatched audiovisual stimuli. Conclusions: Recent studies of multisensory integration have shown that the reduced reliability of perceptual estimates regarding intersensory conflicts constitutes the marker of a stronger coupling between the unisensory signals. Our results therefore indicate a stronger coupling of synesthetically matched vs. mismatched stimuli and provide the first psychophysical evidence that synesthetic congruency can promote multisensory integration. Synesthetic crossmodal correspondences therefore appear to play a crucial (if unacknowledged) role in the multisensory integration of auditory and visual information

Parise, Cesare

Publications at Bielefeld University

'When Birds of a Feather Flock Together': Synesthetic Correspondences Modulate Audiovisual Integration in Non-Synesthetes

A Bayesian view on multimodal cue integration.

Automatic visual bias of perceived auditory location.

Combining sensory information: Mandatory fusion within, but not between, senses.

Cross-modal interaction between vision and touch: the role of synesthetic correspondence.

Cross-modal interactions in speeded classification.

Crossmodal binding: evaluating the &quot;unity assumption&quot; using audiovisual speech stimuli.

eds (2004) The handbook of multisensory processes.

Effects of some variations in auditory input upon visual choice reaction time.

Evaluating the influence of the ‘unity assumption’on the temporal perception of realistic audiovisual stimuli.

Facilitation of multisensory integration by the ‘‘unity effect’’ reveals that speech is special.

Fitzhugh A

Henik A

Immediate perceptual response to intersensory discrepancy.

Implications for phonetic symbolism: the relationship between pure tones and geometric figures.

Interaction between synesthetically corresponding dimensions.

Kingstone A

Knowledge about a common source can promote visual-haptic integration.

Learning to integrate arbitrary signals from vision and touch.

Mood A

Multisensory synesthetic interactions in the speeded classification of visual size.

On cross-modal similarity: auditory-visual interactions in speeded discrimination.

On cross-modal similarity: the perceptual structure of pitch, loudness, and brightness.

QUEST- A Bayesian adaptive psychometric method.

Relationship between critical flicker-frequency and a set of low-frequency characteristics of the eye.

Spatial and temporal contrast-sensitivity functions of the visual system.

Stroop interference based on the multimodal correlates of haptic size and auditory pitch.

Stroop interference based on the synaesthetic qualities of auditory pitch.

Synesthesia: Strong and weak.

Synesthetic congruency modulates the temporal ventriloquism effect.

Temporal and spatial dependency of the ventriloquism effect.

Temporal mechanisms of multimodal binding.

The bagplot: A bivariate boxplot.

The impact of signal bandwidth on auditory localization: implications for the design of three-dimensional audio displays.

The psychometric function: I. Fitting, sampling, and goodness of fit.

The ventriloquist effect results from near-optimal bimodal integration.

Vision and touch are automatically integrated for the perception of sequences of events.

Visual Prior Entry.

file:///data/core-remote/dit/data/public_library_of_science/pdf/dc5/ZnRwOi8vZnRwLm5jYmkubmxtLm5paC5nb3YvcHViL3BtYy9vYV9wYWNrYWdlLzZmLzg3L1BNQzI2ODA5NTAudGFyLmd6.pdf

‘When Birds of a Feather Flock Together’: Synesthetic Correspondences Modulate Audiovisual Integration in Non-Synesthetes

‘When Birds of a Feather Flock Together’: Synesthetic Correspondences Modulate Audiovisual Integration in Non-Synesthetes

Abstract

Similar works

Full text

Available Versions

ORA - Oxford University Research Archive

ORA - Oxford University Research Archive

Oxford University Research Archive (ORA)

MPG.PuRe

Publications at Bielefeld University