Synesthesia vs. crossmodal illusions

We can discern two opposing viewpoints regarding synesthesia. According to the first, it is an oddity, an outlier, or a disordered condition. According to the second, synesthesia is pervasive, driving creativity, metaphor, or language itself. Which is it? Ultimately, I favor the first perspective, according to which cross-sensory synesthesia is an outlying condition. But the second perspective is not wholly misguided. My discussion has three lessons. First, synesthesia is just one of a variety of effects in which one sense modality causally impacts and reshapes experience associated with another. These effects are utterly common. However, due to their unfamiliarity, and to their conflict with a widespread conception of the role of the senses in perception and perceptual experience, until recently they have been surprising. Second, synesthesia nevertheless must be distinguished from other inter-modal effects that lead to misperception, such as crossmodal illusions. Third, synesthesia also may be distinguished from the potentially much broader class of synesthetic effects, which could be common across the population and within individuals

An extended case study on the phenomenology of sequence-space synesthesia

Investigation of synesthesia phenomenology in adults is needed to constrain accounts of developmental trajectories of this trait. We report an extended phenomenological investigation of sequence-space synesthesia in a single case (AB). We used the Elicitation Interview (EI) method to facilitate repeated exploration of AB's synesthetic experience. During an EI the subject's attention is selectively guided by the interviewer in order to reveal precise details about the experience. Detailed analysis of the resulting 9 h of interview transcripts provided a comprehensive description of AB's synesthetic experience, including several novel observations. For example, we describe a specific spatial reference frame (a "mental room") in which AB's concurrents occur, and which overlays his perception of the real world (the "physical room"). AB is able to switch his attention voluntarily between this mental room and the physical room. Exemplifying the EI method, some of our observations were previously unknown even to AB. For example, AB initially reported to experience concurrents following visual presentation, yet we determined that in the majority of cases the concurrent followed an internal verbalization of the inducer, indicating an auditory component to sequence-space synesthesia. This finding is congruent with typical rehearsal of inducer sequences during development, implicating cross-modal interactions between auditory and visual systems in the genesis of this synesthetic form. To our knowledge, this paper describes the first application of an EI to synesthesia, and the first systematic longitudinal investigation of the first-person experience of synesthesia since the re-emergence of interest in this topic in the 1980's. These descriptions move beyond rudimentary graphical or spatial representations of the synesthetic spatial form, thereby providing new targets for neurobehavioral analysis

Adults can be trained to acquire synesthetic experiences

Synesthesia is a condition where presentation of one perceptual class consistently evokes additional experiences in different perceptual categories. Synesthesia is widely considered a congenital condition, although an alternative view is that it is underpinned by repeated exposure to combined perceptual features at key developmental stages. Here we explore the potential for repeated associative learning to shape and engender synesthetic experiences. Non-synesthetic adult participants engaged in an extensive training regime that involved adaptive memory and reading tasks, designed to reinforce 13 specific letter-color associations. Following training, subjects exhibited a range of standard behavioral and physiological markers for grapheme-color synesthesia; crucially, most also described perceiving color experiences for achromatic letters, inside and outside the lab, where such experiences are usually considered the hallmark of genuine synesthetes. Collectively our results are consistent with developmental accounts of synesthesia and illuminate a previously unsuspected potential for new learning to shape perceptual experience, even in adulthood

A predictive processing theory of sensorimotor contingencies: explaining the puzzle of perceptual presence and its absence in synesthesia

Normal perception involves experiencing objects within perceptual scenes as real, as existing in the world. This property of “perceptual presence” has motivated “sensorimotor theories” which understand perception to involve the mastery of sensorimotor contingencies. However, the mechanistic basis of sensorimotor contingencies and their mastery has remained unclear. Sensorimotor theory also struggles to explain instances of perception, such as synesthesia, that appear to lack perceptual presence and for which relevant sensorimotor contingencies are difficult to identify. On alternative “predictive processing” theories, perceptual content emerges from probabilistic inference on the external causes of sensory signals, however, this view has addressed neither the problem of perceptual presence nor synesthesia. Here, I describe a theory of predictive perception of sensorimotor contingencies which (1) accounts for perceptual presence in normal perception, as well as its absence in synesthesia, and (2) operationalizes the notion of sensorimotor contingencies and their mastery. The core idea is that generative models underlying perception incorporate explicitly counterfactual elements related to how sensory inputs would change on the basis of a broad repertoire of possible actions, even if those actions are not performed. These “counterfactually-rich” generative models encode sensorimotor contingencies related to repertoires of sensorimotor dependencies, with counterfactual richness determining the degree of perceptual presence associated with a stimulus. While the generative models underlying normal perception are typically counterfactually rich (reflecting a large repertoire of possible sensorimotor dependencies), those underlying synesthetic concurrents are hypothesized to be counterfactually poor. In addition to accounting for the phenomenology of synesthesia, the theory naturally accommodates phenomenological differences between a range of experiential states including dreaming, hallucination, and the like. It may also lead to a new view of the (in)determinacy of normal perception

Color and texture associations in voice-induced synesthesia

Voice-induced synesthesia, a form of synesthesia in which synesthetic perceptions are induced by the sounds of people's voices, appears to be relatively rare and has not been systematically studied. In this study we investigated the synesthetic color and visual texture perceptions experienced in response to different types of “voice quality” (e.g., nasal, whisper, falsetto). Experiences of three different groups—self-reported voice synesthetes, phoneticians, and controls—were compared using both qualitative and quantitative analysis in a study conducted online. Whilst, in the qualitative analysis, synesthetes used more color and texture terms to describe voices than either phoneticians or controls, only weak differences, and many similarities, between groups were found in the quantitative analysis. Notable consistent results between groups were the matching of higher speech fundamental frequencies with lighter and redder colors, the matching of “whispery” voices with smoke-like textures, and the matching of “harsh” and “creaky” voices with textures resembling dry cracked soil. These data are discussed in the light of current thinking about definitions and categorizations of synesthesia, especially in cases where individuals apparently have a range of different synesthetic inducers

Can grapheme-color synesthesia be induced by hypnosis?

Grapheme-color synesthesia is a perceptual experience where graphemes, letters or words evoke a specific color, which are experienced either as spatially coincident with the grapheme inducer (projector sub-type) or elsewhere, perhaps without a definite spatial location (associator sub-type). Here, we address the question of whether synesthesia can be rapidly produced using a hypnotic color suggestion to examine the possibility of “hypnotic synesthesia”, i.e., subjectively experienced color hallucinations similar to those experienced by projector synesthetes. We assess the efficacy of this intervention using an “embedded figures” test, in which participants are required to detect a shape (e.g., a square) composed of local graphemic elements. For grapheme-color synesthetes, better performance on the task has been linked to a higher proportion of graphemes perceived as colored.We found no performance benefits on this test when using a hypnotic suggestion, as compared to a no-suggestion control condition. The same result was found when participants were separated according to the degree to which they were susceptible to the suggestion (number of colored trials perceived). However, we found a relationship between accuracy and subjective reports of color in those participants who reported a large proportion of colored trials: trials in which the embedded figure was accurately recognized (relative to trials in which it was not) were associated with reports of more intense colors occupying a greater spatial extent. Collectively, this implies that hypnotic color was only perceived after shape detection rather than aiding in shape detection via color-based perceptual grouping. The results suggest that hypnotically induced colors are not directly comparable to synesthetic ones

MINDtouch: Embodied mobile media ephemeral transference

Copyright @ 2013 ISAST.This article reviews discoveries that emerged from the author's MINDtouch media research project, in which a mobile device was repurposed for visual and non-verbal communication through gestural and visual mobile expressivity. The work revealed new insights from emerging mobile media and participatory performance practices. The author contextualizes her media research on mobile video and networked performance alongside relevant discourse on presence and the embodiment of technology. From the research, an intimate, phenomenological and visual form of mobile expression has emerged. This form has reconfigured the communication device from voice and text/SMS only to a visual and synesthetic mode for deeper expression

Spatial Behaviour and the Socio-Spatial Recognition

The paper explores the relation between the real and the mental space of the inhabitants. The understanding of the interaction between the inhabitants and their houses relies upon the direct observation of the practices of the users and the interpretation of their spatial behaviours shown by the routes they choose in everyday activities. The results show that this study requires the understanding of the relationships between the spatial behaviour of inhabitants and their socio-physical recognition. We were also able to highlight the strategies and the forms of adaptation raised during the fulfilment of the action plans of the inhabitant.Peer Reviewe