Synesthesia vs. crossmodal illusions

We can discern two opposing viewpoints regarding synesthesia. According to the first, it is an oddity, an outlier, or a disordered condition. According to the second, synesthesia is pervasive, driving creativity, metaphor, or language itself. Which is it? Ultimately, I favor the first perspective, according to which cross-sensory synesthesia is an outlying condition. But the second perspective is not wholly misguided. My discussion has three lessons. First, synesthesia is just one of a variety of effects in which one sense modality causally impacts and reshapes experience associated with another. These effects are utterly common. However, due to their unfamiliarity, and to their conflict with a widespread conception of the role of the senses in perception and perceptual experience, until recently they have been surprising. Second, synesthesia nevertheless must be distinguished from other inter-modal effects that lead to misperception, such as crossmodal illusions. Third, synesthesia also may be distinguished from the potentially much broader class of synesthetic effects, which could be common across the population and within individuals

The genetics of colored sequence synesthesia: Evidence of linkage to chromosome 16q and genetic heterogeneity for the condition

Synesthesia is a perceptual condition in which normal sensory stimulation can trigger anomalous sensory experiences. For example, synesthetes may experience colors in response to sounds, tastes in response to words, or smells in response to touch. We here focus on colored sequence synesthesia, in which color experiences are triggered by learned ordinal sequences such as letters, numbers, weekdays and months. Although synesthesia has been noted in the scientific literature for over a century, it is understood only at the level of the phenomenology, and not at the molecular and neural levels. We have performed a linkage analysis to identify the first genetic loci responsible for the increased neural crosstalk underlying colored sequence synesthesia. Our analysis has identified a 23 MB region on chromosome 16 as a putative locus for the trait. Our data provide the first step in understanding neural crosstalk from its molecular basis to its behavioral consequences, opening a new inroad into the understanding of the multisensory brain

A longitudinal study of grapheme-color synesthesia in childhood:6/7 years to 10/11 years

Grapheme-colour synaesthesia is a condition characterised by enduring and consistent associations between letter/digits and colours. This study is the continuation of longitudinal research begun by Simner, Harrold, Creed, Monro and Foulkes (2009) which aimed to explore the development of this condition in real time within a childhood population. In that earlier study we randomly sampled over 600 children and tested them aged 6/7 years and 7/8 years. We identified the child synaesthetes within that cohort and measured their development over 1 year, in comparison to a group of nonsynaesthetic children with both average and superior memories. We were able to show the beginnings of a developmental progression in which synaesthetic associations (e.g. A = red) mature over time from relatively chaotic pairings into a system of fixed consistent associations. In the current study we return to this same population three years later when participants are now 10/11 years. We used the same paired-association memory task to determine the synaesthetic status of our participants and to also establish synaesthetes’ inventories of grapheme-colour associations. We compared their inventories to those from age 6/7 year and 7/8 years to examine how synaesthesia matures over time. Together with earlier findings, our study shows that grapheme-colour synaesthesia emerges with a protracted lineal trajectory, with 34% of letters/digits fixed at age 6/7 years, 48% fixed at 7/8 years and 71% fixed at 10/11 years. We also show several cases where synaesthesia is not developing in the same time-frame as peers, either because it has died out at an older age, or because it was slower to develop than other cases. Our study paints the first picture of the emergence of synaesthesia in real-time over four years within a randomly sampled population of child synaesthetes

Adults can be trained to acquire synesthetic experiences

Synesthesia is a condition where presentation of one perceptual class consistently evokes additional experiences in different perceptual categories. Synesthesia is widely considered a congenital condition, although an alternative view is that it is underpinned by repeated exposure to combined perceptual features at key developmental stages. Here we explore the potential for repeated associative learning to shape and engender synesthetic experiences. Non-synesthetic adult participants engaged in an extensive training regime that involved adaptive memory and reading tasks, designed to reinforce 13 specific letter-color associations. Following training, subjects exhibited a range of standard behavioral and physiological markers for grapheme-color synesthesia; crucially, most also described perceiving color experiences for achromatic letters, inside and outside the lab, where such experiences are usually considered the hallmark of genuine synesthetes. Collectively our results are consistent with developmental accounts of synesthesia and illuminate a previously unsuspected potential for new learning to shape perceptual experience, even in adulthood

Does binding of synesthetic color to the evoking grapheme require attention?

The official published version can be accessed from the link below.The neural mechanisms involved in binding features such as shape and color are a matter of some debate. Does accurate binding rely on spatial attention functions of the parietal lobe or can it occur without attentional input? One extraordinary phenomenon that may shed light on this question is that of chromatic-graphemic synesthesia, a rare condition in which letter shapes evoke color perceptions. A popular suggestion is that synesthesia results from cross-activation between different functional regions (e.g., between shape and color areas of the ventral pathway). Under such conditions binding may not require parietal involvement and could occur preattentively. We tested this hypothesis in two synesthetes who perceived grayscale letters and digits in color. We found no evidence for preattentive binding using a visual search paradigm in which the target was a synesthetic inducer. In another experiment involving color judgments, we show that the congruency of target color and the synesthetic color of irrelevant digits modulates performance more when the digits are included within the attended region of space. We propose that the mechanisms giving rise to this type of synesthesia appear to follow at least some principles of normal binding, and even synesthetic binding seems to require attention.This work has been supported by a Veterans Administration Senior Research Career Scientist Award and NINDS grant #MH62331 to LCR and the Elizabeth Roboz Einstein fellowship in Neuroscience and Human Development to NS

A predictive processing theory of sensorimotor contingencies: explaining the puzzle of perceptual presence and its absence in synesthesia

Normal perception involves experiencing objects within perceptual scenes as real, as existing in the world. This property of “perceptual presence” has motivated “sensorimotor theories” which understand perception to involve the mastery of sensorimotor contingencies. However, the mechanistic basis of sensorimotor contingencies and their mastery has remained unclear. Sensorimotor theory also struggles to explain instances of perception, such as synesthesia, that appear to lack perceptual presence and for which relevant sensorimotor contingencies are difficult to identify. On alternative “predictive processing” theories, perceptual content emerges from probabilistic inference on the external causes of sensory signals, however, this view has addressed neither the problem of perceptual presence nor synesthesia. Here, I describe a theory of predictive perception of sensorimotor contingencies which (1) accounts for perceptual presence in normal perception, as well as its absence in synesthesia, and (2) operationalizes the notion of sensorimotor contingencies and their mastery. The core idea is that generative models underlying perception incorporate explicitly counterfactual elements related to how sensory inputs would change on the basis of a broad repertoire of possible actions, even if those actions are not performed. These “counterfactually-rich” generative models encode sensorimotor contingencies related to repertoires of sensorimotor dependencies, with counterfactual richness determining the degree of perceptual presence associated with a stimulus. While the generative models underlying normal perception are typically counterfactually rich (reflecting a large repertoire of possible sensorimotor dependencies), those underlying synesthetic concurrents are hypothesized to be counterfactually poor. In addition to accounting for the phenomenology of synesthesia, the theory naturally accommodates phenomenological differences between a range of experiential states including dreaming, hallucination, and the like. It may also lead to a new view of the (in)determinacy of normal perception

The neuronal correlate of bidirectional synesthesia: a combined event-related potential and functional magnetic resonance imaging study

The neuronal correlate of a rare explicit bi-directional synaesthesia was investigated with numerical and physical size comparison tasks using both functional magnetic resonance imaging and event-related potentials. Interestingly, although participant I.S. exhibited similar congruity effects for both tasks at the behavioural level, subsequent analyses of the imaging data revealed that different brain areas were recruited for each task, and in different time windows. The results support: 1) the genuineness of bi-directional synaesthesia at the neuronal level, 2) the possibility that discrepancy in the neuronal correlates of synaesthesia between previous studies might be task-related, and 3) the possibility that synaesthesia might not be a unitary phenomenon