Neural Correlates of Visual Aesthetics – Beauty as the Coalescence of Stimulus and Internal State

How do external stimuli and our internal state coalesce to create the distinctive aesthetic pleasures that give vibrance to human experience? Neuroaesthetics has so far focused on the neural correlates of observing beautiful stimuli compared to neutral or ugly stimuli, or on neural correlates of judging for beauty as opposed to other judgments. Our group questioned whether this approach is sufficient. In our view, a brain region that assesses beauty should show beauty-level-dependent activation during the beauty judgment task, but not during other, unrelated tasks. We therefore performed an fMRI experiment in which subjects judged visual textures for beauty, naturalness and roughness. Our focus was on finding brain activation related to the rated beauty level of the stimuli, which would take place exclusively during the beauty judgment. An initial whole-brain analysis did not reveal such interactions, yet a number of the regions showing main effects of the judgment task or the beauty level of stimuli were selectively sensitive to beauty level during the beauty task. Of the regions that were more active during beauty judgments than roughness judgments, the frontomedian cortex and the amygdala demonstrated the hypothesized interaction effect, while the posterior cingulate cortex did not. The latter region, which only showed a task effect, may play a supporting role in beauty assessments, such as attending to one's internal state rather than the external world. Most of the regions showing interaction effects of judgment and beauty level correspond to regions that have previously been implicated in aesthetics using different stimulus classes, but based on either task or beauty effects alone. The fact that we have now shown that task-stimulus interactions are also present during the aesthetic judgment of visual textures implies that these areas form a network that is specifically devoted to aesthetic assessment, irrespective of the stimulus type

Rapid and Reversible Recruitment of Early Visual Cortex for Touch

The loss of vision has been associated with enhanced performance in non-visual tasks such as tactile discrimination and sound localization. Current evidence suggests that these functional gains are linked to the recruitment of the occipital visual cortex for non-visual processing, but the neurophysiological mechanisms underlying these crossmodal changes remain uncertain. One possible explanation is that visual deprivation is associated with an unmasking of non-visual input into visual cortex.We investigated the effect of sudden, complete and prolonged visual deprivation (five days) in normally sighted adult individuals while they were immersed in an intensive tactile training program. Following the five-day period, blindfolded subjects performed better on a Braille character discrimination task. In the blindfold group, serial fMRI scans revealed an increase in BOLD signal within the occipital cortex in response to tactile stimulation after five days of complete visual deprivation. This increase in signal was no longer present 24 hours after blindfold removal. Finally, reversible disruption of occipital cortex function on the fifth day (by repetitive transcranial magnetic stimulation; rTMS) impaired Braille character recognition ability in the blindfold group but not in non-blindfolded controls. This disruptive effect was no longer evident once the blindfold had been removed for 24 hours.Overall, our findings suggest that sudden and complete visual deprivation in normally sighted individuals can lead to profound, but rapidly reversible, neuroplastic changes by which the occipital cortex becomes engaged in processing of non-visual information. The speed and dynamic nature of the observed changes suggests that normally inhibited or masked functions in the sighted are revealed by visual loss. The unmasking of pre-existing connections and shifts in connectivity represent rapid, early plastic changes, which presumably can lead, if sustained and reinforced, to slower developing, but more permanent structural changes, such as the establishment of new neural connections in the blind

Short-Term Visual Deprivation Does Not Enhance Passive Tactile Spatial Acuity

An important unresolved question in sensory neuroscience is whether, and if so with what time course, tactile perception is enhanced by visual deprivation. In three experiments involving 158 normally sighted human participants, we assessed whether tactile spatial acuity improves with short-term visual deprivation over periods ranging from under 10 to over 110 minutes. We used an automated, precisely controlled two-interval forced-choice grating orientation task to assess each participant's ability to discern the orientation of square-wave gratings pressed against the stationary index finger pad of the dominant hand. A two-down one-up staircase (Experiment 1) or a Bayesian adaptive procedure (Experiments 2 and 3) was used to determine the groove width of the grating whose orientation each participant could reliably discriminate. The experiments consistently showed that tactile grating orientation discrimination does not improve with short-term visual deprivation. In fact, we found that tactile performance degraded slightly but significantly upon a brief period of visual deprivation (Experiment 1) and did not improve over periods of up to 110 minutes of deprivation (Experiments 2 and 3). The results additionally showed that grating orientation discrimination tends to improve upon repeated testing, and confirmed that women significantly outperform men on the grating orientation task. We conclude that, contrary to two recent reports but consistent with an earlier literature, passive tactile spatial acuity is not enhanced by short-term visual deprivation. Our findings have important theoretical and practical implications. On the theoretical side, the findings set limits on the time course over which neural mechanisms such as crossmodal plasticity may operate to drive sensory changes; on the practical side, the findings suggest that researchers who compare tactile acuity of blind and sighted participants should not blindfold the sighted participants

Changes in Early Cortical Visual Processing Predict Enhanced Reactivity in Deaf Individuals

Individuals with profound deafness rely critically on vision to interact with their environment. Improvement of visual performance as a consequence of auditory deprivation is assumed to result from cross-modal changes occurring in late stages of visual processing. Here we measured reaction times and event-related potentials (ERPs) in profoundly deaf adults and hearing controls during a speeded visual detection task, to assess to what extent the enhanced reactivity of deaf individuals could reflect plastic changes in the early cortical processing of the stimulus. We found that deaf subjects were faster than hearing controls at detecting the visual targets, regardless of their location in the visual field (peripheral or peri-foveal). This behavioural facilitation was associated with ERP changes starting from the first detectable response in the striate cortex (C1 component) at about 80 ms after stimulus onset, and in the P1 complex (100–150 ms). In addition, we found that P1 peak amplitudes predicted the response times in deaf subjects, whereas in hearing individuals visual reactivity and ERP amplitudes correlated only at later stages of processing. These findings show that long-term auditory deprivation can profoundly alter visual processing from the earliest cortical stages. Furthermore, our results provide the first evidence of a co-variation between modified brain activity (cortical plasticity) and behavioural enhancement in this sensory-deprived population

The Nature of Working Memory for Braille

Blind individuals have been shown on multiple occasions to compensate for their loss of sight by developing exceptional abilities in their remaining senses. While most research has been focused on perceptual abilities per se in the auditory and tactile modalities, recent work has also investigated higher-order processes involving memory and language functions. Here we examined tactile working memory for Braille in two groups of visually challenged individuals (completely blind subjects, CBS; blind with residual vision, BRV). In a first experimental procedure both groups were given a Braille tactile memory span task with and without articulatory suppression, while the BRV and a sighted group performed a visual version of the task. It was shown that the Braille tactile working memory (BrWM) of CBS individuals under articulatory suppression is as efficient as that of sighted individuals' visual working memory in the same condition. Moreover, the results suggest that BrWM may be more robust in the CBS than in the BRV subjects, thus pointing to the potential role of visual experience in shaping tactile working memory. A second experiment designed to assess the nature (spatial vs. verbal) of this working memory was then carried out with two new CBS and BRV groups having to perform the Braille task concurrently with a mental arithmetic task or a mental displacement of blocks task. We show that the disruption of memory was greatest when concurrently carrying out the mental displacement of blocks, indicating that the Braille tactile subsystem of working memory is likely spatial in nature in CBS. The results also point to the multimodal nature of working memory and show how experience can shape the development of its subcomponents

The emergence of synaesthesia in a Neuronal Network Model via changes in perceptual sensitivity and plasticity

Synaesthesia is an unusual perceptual experience in which an inducer stimulus triggers a percept in a different domain in addition to its own. To explore the conditions under which synaesthesia evolves, we studied a neuronal network model that represents two recurrently connected neural systems. The interactions in the network evolve according to learning rules that optimize sensory sensitivity. We demonstrate several scenarios, such as sensory deprivation or heightened plasticity, under which synaesthesia can evolve even though the inputs to the two systems are statistically independent and the initial cross-talk interactions are zero. Sensory deprivation is the known causal mechanism for acquired synaesthesia and increased plasticity is implicated in developmental synaesthesia. The model unifies different causes of synaesthesia within a single theoretical framework and repositions synaesthesia not as some quirk of aberrant connectivity, but rather as a functional brain state that can emerge as a consequence of optimising sensory information processing

The brain is a DJ using neuropeptides as sensory crossfaders

Sensory loss induces cross-modal plasticity, often resulting in altered performance in remaining sensory modalities. Whereas much is known about the macroscopic mechanisms underlying cross-modal plasticity, only scant information exists about its cellular and molecular underpinnings. We found that Caenorhabditis elegans nematodes deprived of a sense of body touch exhibit various changes in behavior, associated with other unimpaired senses. We focused on one such behavioral alteration, enhanced odor sensation, and sought to reveal the neuronal and molecular mechanisms that translate mechanosensory loss into improved olfactory acuity. To this end, we analyzed in mechanosensory mutants food-dependent locomotion patterns that are associated with olfactory responses and found changes that are consistent with enhanced olfaction. The altered locomotion could be reversed in adults by optogenetic stimulation of the touch receptor (mechanosensory) neurons. Furthermore, we revealed that the enhanced odor response is related to a strengthening of inhibitory AWC→AIY synaptic transmission in the olfactory circuit. Consistently, inserting in this circuit an engineered electrical synapse that diminishes AWC inhibition of AIY counteracted the locomotion changes in touch-deficient mutants. We found that this cross-modal signaling between the mechanosensory and olfactory circuits is mediated by neuropeptides, one of which we identified as FLP-20. Our results indicate that under normal function, ongoing touch receptor neuron activation evokes FLP-20 release, suppressing synaptic communication and thus dampening odor sensation. In contrast, in the absence of mechanosensory input, FLP-20 signaling is reduced, synaptic suppression is released, and this enables enhanced olfactory acuity; these changes are long lasting and do not represent ongoing modulation, as revealed by optogenetic experiments. Our work adds to a growing literature on the roles of neuropeptides in cross-modal signaling, by showing how activity-dependent neuropeptide signaling leads to specific cross-modal plastic changes in neural circuit connectivity, enhancing sensory performance.status: publishe

A framework for the first‑person internal sensation of visual perception in mammals and a comparable circuitry for olfactory perception in Drosophila

Perception is a first-person internal sensation induced within the nervous system at the time of arrival of sensory stimuli from objects in the environment. Lack of access to the first-person properties has limited viewing perception as an emergent property and it is currently being studied using third-person observed findings from various levels. One feasible approach to understand its mechanism is to build a hypothesis for the specific conditions and required circuit features of the nodal points where the mechanistic operation of perception take place for one type of sensation in one species and to verify it for the presence of comparable circuit properties for perceiving a different sensation in a different species. The present work explains visual perception in mammalian nervous system from a first-person frame of reference and provides explanations for the homogeneity of perception of visual stimuli above flicker fusion frequency, the perception of objects at locations different from their actual position, the smooth pursuit and saccadic eye movements, the perception of object borders, and perception of pressure phosphenes. Using results from temporal resolution studies and the known details of visual cortical circuitry, explanations are provided for (a) the perception of rapidly changing visual stimuli, (b) how the perception of objects occurs in the correct orientation even though, according to the third-person view, activity from the visual stimulus reaches the cortices in an inverted manner and (c) the functional significance of well-conserved columnar organization of the visual cortex. A comparable circuitry detected in a different nervous system in a remote species-the olfactory circuitry of the fruit fly Drosophila melanogaster-provides an opportunity to explore circuit functions using genetic manipulations, which, along with high-resolution microscopic techniques and lipid membrane interaction studies, will be able to verify the structure-function details of the presented mechanism of perception

Spatial Language Processing in the Blind: Evidence for a Supramodal Representation and Cortical Reorganization

Neuropsychological and imaging studies have shown that the left supramarginal gyrus (SMG) is specifically involved in processing spatial terms (e.g. above, left of), which locate places and objects in the world. The current fMRI study focused on the nature and specificity of representing spatial language in the left SMG by combining behavioral and neuronal activation data in blind and sighted individuals. Data from the blind provide an elegant way to test the supramodal representation hypothesis, i.e. abstract codes representing spatial relations yielding no activation differences between blind and sighted. Indeed, the left SMG was activated during spatial language processing in both blind and sighted individuals implying a supramodal representation of spatial and other dimensional relations which does not require visual experience to develop. However, in the absence of vision functional reorganization of the visual cortex is known to take place. An important consideration with respect to our finding is the amount of functional reorganization during language processing in our blind participants. Therefore, the participants also performed a verb generation task. We observed that only in the blind occipital areas were activated during covert language generation. Additionally, in the first task there was functional reorganization observed for processing language with a high linguistic load. As the visual cortex was not specifically active for spatial contents in the first task, and no reorganization was observed in the SMG, the latter finding further supports the notion that the left SMG is the main node for a supramodal representation of verbal spatial relations