Connectionist Taxonomy Learning

The thesis presents an unsupervised connectionist network using spreading activation mechanism. By means of self-organization, the network is capable of creating a taxonomy of concepts which serves as a backbone for a respective ontology. The system is a biologically inspired constructivist hybrid between connectionist networks using distributed and localist data representation. Unlike most currently developed models it is capable to deal with analog signals and displays cognitive properties of categorization process. The thesis presents the general overview over the system’s architecture and method of network build-up and shows results of several experiments exploring the nature of categorization performed with the use of the described network

Word Knowledge and Word Usage

Word storage and processing define a multi-factorial domain of scientific inquiry whose thorough investigation goes well beyond the boundaries of traditional disciplinary taxonomies, to require synergic integration of a wide range of methods, techniques and empirical and experimental findings. The present book intends to approach a few central issues concerning the organization, structure and functioning of the Mental Lexicon, by asking domain experts to look at common, central topics from complementary standpoints, and discuss the advantages of developing converging perspectives. The book will explore the connections between computational and algorithmic models of the mental lexicon, word frequency distributions and information theoretical measures of word families, statistical correlations across psycho-linguistic and cognitive evidence, principles of machine learning and integrative brain models of word storage and processing. Main goal of the book will be to map out the landscape of future research in this area, to foster the development of interdisciplinary curricula and help single-domain specialists understand and address issues and questions as they are raised in other disciplines

A Neurocognitive Approach

One of the most important hallmarks of human language is the use of symbolic signs in that words just “symbolically” represent the objects they refer to. That is, neither the written word ‘tree’ nor the spoken sequence of sounds /triː/ has any inherent similarity or analogy to a real tree. This is a core assumption of classic linguistics, which states that words are paired with objects, mental images, or concepts in an arbitrary fashion. Thus, the sound of a word per se has no inherent semantic content, nor does it play any contributing role in shaping the meaning of words. The goal of this dissertation is to contemplate, to rethink, and to examine the aforementioned statement, which has dominated language research throughout the last century. Indeed, there are a vast number of counterexamples showing how meaningful single phonemes, or their combination—as in nonwords—can be. Consider the standalone role of sound in poetry, or the use of single syllables or phonemes in various sacred rituals, or the prevalence of onomatopoetic words, i.e., words that sound similar to what they mean (e.g., click, zigzag), across all of the languages in the world, or the tendency of language users toward using harsh-sounding words as swear words, or cross-linguistic phenomena such as a preference to match the nonword BOUBA with a curvy round shape and KIKI with a spiky angular shape: These all constitute excellent examples that could potentially falsify the radical assumption of the sound of words being per se meaningless. The present dissertation now wants to shed new empirical light on this old debate, which dates back to Greek antiquity, yet faces a number of unanswered questions regarding the cognitive and neuropsychological mechanisms underlying the potential effect of sound on the processes of meaning making. More specifically, my focus is on the existence of sound-meaning relationships in the affective domain, termed affective iconicity, and on the investigation of different aspects of this phenomenon in both everyday language and poetry. By taking an interdisciplinary approach, the present work combines a variety of methods and techniques, such as behavioral and neuroimaging experiments, phonological and acoustic analysis of a large-scale lexicon, computational modelling, and corpus analysis, in order to provide comprehensive answers for this multi-faceted phenomenon. The theoretical part of the dissertation explores and integrates linguistic perspectives on the iconic mappings, explaining how a linguistic sign can acquire meaning based on similarities between its form and the object it refers to. A surprising neglect of the role of emotion in empirical models of language in general, and in previous investigations of iconicity in particular, is discussed. Specific hypotheses are formulated via the predictions made by the recently proposed Neurocognitive Poetics Model (NCPM), and through reviewing the previous works on the topic. Accordingly, three main questions are formulated that the present dissertation aims to address: i) Does the sound of words evoke affective responses observable at the behavioral and neural level? ii) Does the sound of words influence the processes of meaning making in the affective domain? iii) Does the sound of words in a poem contribute to its global affective meaning as perceived by readers? Six empirical studies attempt to address these questions which are subdivided into six more precise research questions. Results of the empirical part provide a comprehensive picture of the interplay between sound and meaning at different levels of processing (i.e., rating, semantic decision, and passive listening) for different presentation modalities (i.e., visual, and auditory) and for different textual levels (i.e., single word, and entire text). In short, results of Study 1 and Study 2 indicated a high similarity between the affective potential of the sound of words and other types of affective sounds (e.g., nonverbal emotional vocalization and affective prosody) at both the level of psychological perception (Study 1) and the level of neural correlates and substrates (Study 2). Furthermore, when giving their affective judgments (valence and arousal) about the meaning of words, participants, as shown in Study 1, were implicitly influenced by the sound of words even when words were presented visually and read silently. These results were extended in Study 3 in which iconic words, as operationalized by congruence between affective sound and affective meaning, were evaluated more quickly and more accurately than their non-iconic counterparts, suggesting that a similarity between the form and meaning of a word may help language users to more readily access its meaning through direct form-meaning mappings. Study 4 investigated the neural mechanisms underlying the facilitative effect observed in Study 3. Results showed an enhanced fMRI signal in the left amygdala, known for its role in multimodal emotion integration, for both a comparison between iconic and non-iconic words, as well as functional connectivity between two seed regions representing the sound (superior temporal gyrus) and meaning (inferior frontal gyrus) of words modulated by iconic condition. Lastly, results of Study 5 and Study 6 emphasize the role of foregrounded phonological units in the affective and aesthetic processes of literary reading. This clearly supports the initial hypotheses that iconicity is a feasible indicator of the affective qualities of a literary text as evoked by particular phonemic structures. The presented method for measuring the basic affective tone of the poems investigated could account for a considerable part of the variance in the ratings of their general affective meaning. In summary, this dissertation provides strong psychological and neuroimaging evidence for a device that has long been deployed in poetry and the arts, i.e., evoking affective (and aesthetic) responses by the use of certain words with specific sound patterns. The results were used to upgrade the standard models of visual word processing by conceiving corresponding modules responsible for the evaluation of affective sound and its interaction with the evaluation of the affective meaning of words. Lastly, at the more complex level of the whole text, the findings of this dissertation confirm the central assumption of the NCPM regarding the role of foregrounded elements in enhancing affective perception, although the Panksepp-Jakopson hypothesis might need to be extended to human-specific brain regions which originally evolved for other, more simple, tasks. Also, the literary model of reading may need to be updated by adding feedback loops from resulting reading behavior (e.g., fluent reading) to the perceived emotions (e.g., lust and play) based on the findings concerning the facilitative role of iconicity in language processing

On the effects of English elements in German print advertisements

Diese Arbeit untersucht den Einfluss von englischen Elementen in deutschen Werbeanzeigen auf die Anmutung der Anzeige, die Bewertung des beworbenen Produkts sowie der beworbenen Marke und die Einschätzung der Zielgruppe. In einer quantitativen Onlinestudie wurden vier speziell entwickelte Werbeanzeigen, die sich nur hinsichtlich der Verwendung englischer Elemente unterschieden, von 297 Teilnehmern bewertet. Dabei zeigten sich nur in wenigen Fällen statistisch signifikante Unterschiede zwischen der Bewertung der deutschen Anzeigenversionen und der englisch-deutsch gemischten Anzeigenversionen. Da den Probanden jeweils nur eine Version der Anzeige gezeigt wurde und ihnen der linguistische Hintergrund der Untersuchung unbekannt war, spiegeln die Ergebnisse die Wirkung englischer Elemente in realen Kontaktsituationen wider. Dieser Werbewirkungsstudie ging eine Untersuchung der Sprachzuordung voraus, in der getestet wurde, welche Variablen einen Einfluss darauf haben, ob ein visuell präsentiertes Stimuluswort als Deutsch oder Englisch wahrgenommen wird. Als geeignete Prädiktoren erwiesen sich neben der etymologischen Herkunft des Wortes vor allem die Integration in das deutsche Lexikon (operationalisiert durch Konsultierung des Duden Universalwörterbuchs 7. Aufl.). Des Weiteren zeigte sich ein signifikanter Einfluss graphemischer Fremdheitsmarker auf die Sprachzuordnung der Lexeme. Dieser Einfluss konnte sowohl bei Wörtern englischen Ursprungs als auch bei Wörtern, die nicht-englischen Ursprungs waren (z.B. LINEAL, CREMIG), beobachtet werden und verdeutlicht die Wichtigkeit der visuellen Wortform für die Sprachzuordnung.This thesis studies the influence of English elements in German print advertisements on the emotional appeal of the advertisement, the evaluation of the advertised product and brand, and the evaluation of the implied target group. Four especially designed print advertisements, which only differed in their use of English elements, were evaluated by 297 participants in a quantitative online study. Only in a few cases statistically significant differences between the evaluation of the German advertisement versions and the English-German mixed advertisement versions were found. Since participants were only shown one version of the advertisement and because the linguistic background of the study was disguised, the results mirror the effects of English elements in actual contact situations. Prior to this research, a study on language decisions was conducted to test which variables influence whether a visually presented word is perceived as English or German. Next to the etymological origin of a word, especially the integration into the German lexicon (operationalised by consulting the Duden Universalwörterbuchs 7th ed.) proved to be a good predictor. Moreover, graphemic markers of foreignness significantly influenced to which language lexemes were assigned. This impact was witnessed for words of English origin as well as for words of non-English origin (e.g. LINEAL, CREMIG), which emphasises the importance of visual word form for language decisions

On the effects of English elements in German print advertisements

Diese Arbeit untersucht den Einfluss von englischen Elementen in deutschen Werbeanzeigen auf die Anmutung der Anzeige, die Bewertung des beworbenen Produkts sowie der beworbenen Marke und die Einschätzung der Zielgruppe. In einer quantitativen Onlinestudie wurden vier speziell entwickelte Werbeanzeigen, die sich nur hinsichtlich der Verwendung englischer Elemente unterschieden, von 297 Teilnehmern bewertet. Dabei zeigten sich nur in wenigen Fällen statistisch signifikante Unterschiede zwischen der Bewertung der deutschen Anzeigenversionen und der englisch-deutsch gemischten Anzeigenversionen. Da den Probanden jeweils nur eine Version der Anzeige gezeigt wurde und ihnen der linguistische Hintergrund der Untersuchung unbekannt war, spiegeln die Ergebnisse die Wirkung englischer Elemente in realen Kontaktsituationen wider. Dieser Werbewirkungsstudie ging eine Untersuchung der Sprachzuordung voraus, in der getestet wurde, welche Variablen einen Einfluss darauf haben, ob ein visuell präsentiertes Stimuluswort als Deutsch oder Englisch wahrgenommen wird. Als geeignete Prädiktoren erwiesen sich neben der etymologischen Herkunft des Wortes vor allem die Integration in das deutsche Lexikon (operationalisiert durch Konsultierung des Duden Universalwörterbuchs 7. Aufl.). Des Weiteren zeigte sich ein signifikanter Einfluss graphemischer Fremdheitsmarker auf die Sprachzuordnung der Lexeme. Dieser Einfluss konnte sowohl bei Wörtern englischen Ursprungs als auch bei Wörtern, die nicht-englischen Ursprungs waren (z.B. LINEAL, CREMIG), beobachtet werden und verdeutlicht die Wichtigkeit der visuellen Wortform für die Sprachzuordnung.This thesis studies the influence of English elements in German print advertisements on the emotional appeal of the advertisement, the evaluation of the advertised product and brand, and the evaluation of the implied target group. Four especially designed print advertisements, which only differed in their use of English elements, were evaluated by 297 participants in a quantitative online study. Only in a few cases statistically significant differences between the evaluation of the German advertisement versions and the English-German mixed advertisement versions were found. Since participants were only shown one version of the advertisement and because the linguistic background of the study was disguised, the results mirror the effects of English elements in actual contact situations. Prior to this research, a study on language decisions was conducted to test which variables influence whether a visually presented word is perceived as English or German. Next to the etymological origin of a word, especially the integration into the German lexicon (operationalised by consulting the Duden Universalwörterbuchs 7th ed.) proved to be a good predictor. Moreover, graphemic markers of foreignness significantly influenced to which language lexemes were assigned. This impact was witnessed for words of English origin as well as for words of non-English origin (e.g. LINEAL, CREMIG), which emphasises the importance of visual word form for language decisions

Psychological Engagement in Choice and Judgment Under Risk and Uncertainty

Theories of choice and judgment assume that agents behave rationally, choose the higher expected value option, and evaluate the choice consistently (Expected Utility Theory, Von Neumann, & Morgenstern, 1947). However, researchers in decision-making showed that human behaviour is different in choice and judgement tasks (Slovic & Lichtenstein, 1968; 1971; 1973). In this research, we propose that psychological engagement and control deprivation predict behavioural inconsistencies and utilitarian performance with judgment and choice. Moreover, we explore the influences of engagement and control deprivation on agent’s behaviours, while manipulating content of utility (Kusev et al., 2011, Hertwig & Gigerenzer 1999, Tversky & Khaneman, 1996) and decision reward (Kusev et al, 2013, Shafir et al., 2002)

New insights into the study of english False Friends: Their use and understanding by spanish learners of english

This PhD thesis deals with English false friends. It aims at identifying the difficulties Spanish learners have with these words in their interpretation and use of English. More specifically, it looks into the significance of these lexical items in the spoken and written performance of Spanish learners. This dissertation is also intended to cast some light on the potential comprehension problems derived from the existence of false friends in the English language