Cognitive Science

Abstract Research on the relation between sound and meaning in language has reported substantial evidence for implicit associations between articulatory?acoustic characteristics of phonemes and emotions. In the present study, we specifically tested the relation between the acoustic properties of a text and its emotional tone as perceived by readers. To this end, we asked participants to assess the emotional tone of single stanzas extracted from a large variety of poems. The selected stanzas had either an extremely high, a neutral, or an extremely low average formant dispersion. To assess the average formant dispersion per stanza, all words were phonetically transcribed and the distance between the first and second formant per vowel was calculated. Building on a long tradition of research on associations between sound frequency on the one hand and non-acoustic concepts such as size, strength, or happiness on the other hand, we hypothesized that stanzas with an extremely high average formant dispersion would be rated lower on items referring to Potency (dominance) and higher on items referring to Activity (arousal) and Evaluation (emotional valence). The results confirmed our hypotheses for the dimensions of Potency and Evaluation, but not for the dimension of Activity. We conclude that, at least in poetic language, extreme values of acoustic features of vowels are a significant predictor for the emotional tone of a text

Contiguity-based sound iconicity: The meaning of words resonates with phonetic properties of their immediate verbal contexts

We tested the hypothesis that phonosemantic iconicity––i.e., a motivated resonance of sound and meaning––might not only be found on the level of individual words or entire texts, but also in word combinations such that the meaning of a target word is iconically expressed, or highlighted, in the phonetic properties of its immediate verbal context. To this end, we extracted single lines from German poems that all include a word designating high or low dominance, such as large or small, strong or weak, etc. Based on insights from previous studies, we expected to find more vowels with a relatively short distance between the first two formants (low formant dispersion) in the immediate context of words expressing high physical or social dominance than in the context of words expressing low dominance. Our findings support this hypothesis, suggesting that neighboring words can form iconic dyads in which the meaning of one word is sound-iconically reflected in the phonetic properties of adjacent words. The construct of a contiguity-based phono-semantic iconicity opens many venues for future research well beyond lines extracted from poems

Neural processing of poems and songs is based on melodic properties

The neural processing of speech and music is still a matter of debate. A long tradition that assumes shared processing capacities for the two domains contrasts with views that assume domain-specific processing. We here contribute to this topic by investigating, in a functional magnetic imaging (fMRI) study, ecologically valid stimuli that are identical in wording and differ only in that one group is typically spoken (or silently read), whereas the other is sung: poems and their respective musical settings. We focus on the melodic properties of spoken poems and their sung musical counterparts by looking at proportions of significant autocorrelations (PSA) based on pitch values extracted from their recordings. Following earlier studies, we assumed a bias of poem-processing towards the left and a bias for song-processing on the right hemisphere. Furthermore, PSA values of poems and songs were expected to explain variance in left- vs. right-temporal brain areas, while continuous liking ratings obtained in the scanner should modulate activity in the reward network. Overall, poem processing compared to song processing relied on left temporal regions, including the superior temporal gyrus, whereas song processing compared to poem processing recruited more right temporal areas, including Heschl's gyrus and the superior temporal gyrus. PSA values co-varied with activation in bilateral temporal regions for poems, and in right-dominant fronto-temporal regions for songs. Continuous liking ratings were correlated with activity in the default mode network for both poems and songs. The pattern of results suggests that the neural processing of poems and their musical settings is based on their melodic properties, supported by bilateral temporal auditory areas and an additional right fronto-temporal network known to be implicated in the processing of melodies in songs. These findings take a middle ground in providing evidence for specific processing circuits for speech and music in the left and right hemisphere, but simultaneously for shared processing of melodic aspects of both poems and their musical settings in the right temporal cortex. Thus, we demonstrate the neurobiological plausibility of assuming the importance of melodic properties in spoken and sung aesthetic language alike, along with the involvement of the default mode network in the aesthetic appreciation of these properties

At the heart of optimal reading experiences: Cardiovascular activity and flow experiences in fiction reading

Fiction reading is a popular leisure activity associated with a variety of pleasurable experiences, including suspense, narrative transportation, and—as indicated by recent empirical studies—also flow. In the context of fiction reading, flow—generally defined as a pleasurable state of mind experienced during an optimally stimulating activity—is specifically related to an optimal balance between text-driven challenges and the reader’s capabilities in constructing a mental story model. The experimental study reported here focused on the psychophysiological underpinnings of flow in the reading context. Cardiovascular data were collected from 84 participants both during a relaxation baseline prior to reading and during reading. Participants were randomly assigned to read one of three versions of a chapter from Homer’s Odyssey. According to statistical readability indices, these versions were low, intermediate, or high in readability, and hence in cognitive challenge. Flow was measured immediately after reading with a self-report scale that was tailored to assess reading-specific flow experiences. Regression analyses revealed that cardiovascular activation patterns measured before reading that are reflective of parasympathetic dominance—that is, an inner state associated with relaxation and cognitive fluency—moderated flow experiences during reading. In line with the stipulations of flow theory in regard to matching challenge levels being the key determinant for flow, this pattern supported subsequent flow experiences only in response to text versions of high or intermediate, but not of low cognitive challenge. Differences in cardiac vagal tone during reading were, however, not sensitive to our experimental modifications and not predictive of flow experiences

Local electrical imaging of tetragonal domains and field-induced ferroelectric twin walls in conducting SrTiO3

This work is supported by the National University of Singapore (NUS) Academic Research Fund (AcRF Tier 1 Grants No. R-144-000-346-112 and No. R-144-000-364-112) and the Singapore National Research Foundation (NRF) under the Competitive Research Programs (CRP Awards No. NRF-CRP 8-2011-06 and No. NRF-CRP10-2012-02) by the Institutional Strategy of the University of Tübingen (Deutsche Forschungsgemeinschaft, Grant No. ZUK 63), and by the EU-FP6-COST Grant No. MP1308.We demonstrate electrical mapping of tetragonal domains and electric field-induced twin walls in SrTiO3 as a function of temperature and gate bias utilizing the conducting LaAlO3/SrTiO3 interface and low-temperature scanning electron microscopy. Conducting twin walls appear below 105 K, and new twin patterns are observed after thermal cycling through the transition or on electric field gating. The nature of the twin walls is confirmed by calculating their intersection angles for different substrate orientations. Numerous walls formed when a large side- or back-gate voltage is applied are identified as field-induced ferroelectric twin walls in the paraelectric tetragonal matrix. The walls persist after switching off the electric field and on thermal cycling below 105 K. These observations point to a new type of ferroelectric functionality in SrTiO3, which could be exploited together with magnetism and superconductivity in a multifunctional context.Publisher PDFPeer reviewe

Interaction of catechol O-methyltransferase and serotonin transporter genes modulates effective connectivity in a facial emotion-processing circuitry

Imaging genetic studies showed exaggerated blood oxygenation level-dependent response in limbic structures in carriers of low activity alleles of serotonin transporter-linked promoter region (5-HTTLPR) as well as catechol O-methyltransferase (COMT) genes. This was suggested to underlie the vulnerability to mood disorders. To better understand the mechanisms of vulnerability, it is important to investigate the genetic modulation of frontal-limbic connectivity that underlies emotional regulation and control. In this study, we have examined the interaction of 5-HTTLPR and COMT genetic markers on effective connectivity within neural circuitry for emotional facial expressions. A total of 91 healthy Caucasian adults underwent functional magnetic resonance imaging experiments with a task presenting dynamic emotional facial expressions of fear, sadness, happiness and anger. The effective connectivity within the facial processing circuitry was assessed with Granger causality method. We have demonstrated that in fear processing condition, an interaction between 5-HTTLPR (S) and COMT (met) low activity alleles was associated with reduced reciprocal connectivity within the circuitry including bilateral fusiform/inferior occipital regions, right superior temporal gyrus/superior temporal sulcus, bilateral inferior/middle prefrontal cortex and right amygdala. We suggest that the epistatic effect of reduced effective connectivity may underlie an inefficient emotion regulation that places these individuals at greater risk for depressive disorders

Sparseness of vowel category structure: Evidence from English dialect comparison

Current models of speech perception tend to emphasize either fine-grained acoustic properties or coarse-grained abstract characteristics of speech sounds. We argue for a particular kind of ‘sparse’ vowel representations and provide new evidence that these representations account for the successful access of the corresponding categories. In an auditory semantic priming experiment, American English listeners made lexical decisions on targets (e.g. load) preceded by semantically related primes (e.g. pack). Changes of the prime vowel that crossed a vowel-category boundary (e.g. peck) were not treated as a tolerable variation, as assessed by a lack of priming, although the phonetic categories of the two different vowels considerably overlap in American English. Compared to the outcome of the same experiment with New Zealand English listeners, where such prime variations were tolerated, our experiment supports the view that phonological representations are important in guiding the mapping process from the acoustic signal to an abstract mental representation. Our findings are discussed with regard to current models of speech perception and recent findings from brain imaging research

Neuromagnetic reflections of harmony and constraint violations in Turkish

Vowel harmony is a phonotactic principle that requires adjacent vowels to agree in certain vowel features. Phonological theory considers this principle to be represented in one's native grammar, but its abstractness and perceptual consequences remain a matter of debate. In this paper, we are interested in the brain's response to violations of harmony in Turkish. For this purpose, we test two acoustically close and two acoustically distant vowel pairs in Turkish, involving different kinds of harmony violations. Our measure is the Mismatch Negativity (MMN), an automatic change detection response of the brain that has previously been applied for the study of native phoneme representations in a variety of languages. The results of our experiment support the view that vowel harmony is a phonological principle with a language-specific long-term memory representation. Asymmetries in MMN responses support a phonological analysis of the pattern of results, but do not provide evidence for a pure acoustic or a pure probabilistic approach. Phonological analyses are given within Optimality Theory (OT) and within an underspecification account

A three-dimensional cortical map of vowel space: Evidence from Turkish

Mammalian cortex is known to contain various kinds of spatial encoding schemes for sensory information including retinotopic, somatosensory, and tonotopic maps. Tonotopic maps are especially interesting for human speech sound processing because they encode linguistically salient acoustic properties. In this study, we mapped the entire vowel space of a language (Turkish) onto cortical locations by using the magnetic N1 (M100), an auditory-evoked component that peaks approximately 100 msec after auditory stimulus onset. We found that dipole locations could be structured into two distinct maps, one for vowels produced with the tongue positioned toward the front of the mouth (front vowels) and one for vowels produced in the back of the mouth (back vowels). Furthermore, we found spatial gradients in lateral–medial, anterior–posterior, and inferior–superior dimensions that encoded the phonetic, categorical distinctions between all the vowels of Turkish. Statistical model comparisons of the dipole locations suggest that the spatial encoding scheme is not entirely based on acoustic bottom–up information but crucially involves featural–phonetic top–down modulation. Thus, multiple areas of excitation along the unidimensional basilar membrane are mapped into higher dimensional representations in auditory cortex