Brain Learning, Attention, and Consciousness

The processes whereby our brains continue to learn about a changing world in a stable fashion throughout life are proposed to lead to conscious experiences. These processes include the learning of top-down expectations, the matching of these expectations against bottom-up data, the focusing of attention upon the expected clusters of information, and the development of resonant states between bottom-up and top-down processes as they reach an attentive consensus between what is expected and what is there in the outside world. It is suggested that all conscious states in the brain are resonant states, and that these resonant states trigger learning of sensory and cognitive representations. The model which summarize these concepts are therefore called Adaptive Resonance Theory, or ART, models. Psychophysical and neurobiological data in support of ART are presented from early vision, visual object recognition, auditory streaming, variable-rate speech perception, somatosensory perception, and cognitive-emotional interactions, among others. It is noted that ART mechanisms seem to be operative at all levels of the visual system, and it is proposed how these mechanisms are realized by known laminar circuits of visual cortex. It is predicted that the same circuit realization of ART mechanisms will be found in the laminar circuits of all sensory and cognitive neocortex. Concepts and data are summarized concerning how some visual percepts may be visibly, or modally, perceived, whereas amoral percepts may be consciously recognized even though they are perceptually invisible. It is also suggested that sensory and cognitive processing in the What processing stream of the brain obey top-down matching and learning laws that arc often complementary to those used for spatial and motor processing in the brain's Where processing stream. This enables our sensory and cognitive representations to maintain their stability a.s we learn more about the world, while allowing spatial and motor representations to forget learned maps and gains that are no longer appropriate as our bodies develop and grow from infanthood to adulthood. Procedural memories are proposed to be unconscious because the inhibitory matching process that supports these spatial and motor processes cannot lead to resonance.Defense Advance Research Projects Agency; Office of Naval Research (N00014-95-1-0409, N00014-95-1-0657); National Science Foundation (IRI-97-20333

Semantic radical consistency and character transparency effects in Chinese: an ERP study

BACKGROUND: This event-related potential (ERP) study aims to investigate the representation and temporal dynamics of Chinese orthography-to-semantics mappings by simultaneously manipulating character transparency and semantic radical consistency. Character components, referred to as radicals, make up the building blocks used dur...postprin

The Processing of Emotional Sentences by Young and Older Adults: A Visual World Eye-movement Study

Carminati MN, Knoeferle P. The Processing of Emotional Sentences by Young and Older Adults: A Visual World Eye-movement Study. Presented at the Architectures and Mechanisms of Language and Processing (AMLaP), Riva del Garda, Italy

EVALITA Evaluation of NLP and Speech Tools for Italian Proceedings of the Final Workshop

Editor of the proceedings of EVALITA 2016

Mental simulations in comprehension of direct versus indirect speech quotations

In human communication, direct speech (e.g., Mary said: ‘I’m hungry’) coincides with vivid paralinguistic demonstrations of the reported speech acts whereas indirect speech (e.g., Mary said [that] she was hungry) provides mere descriptions of what was said. Hence, direct speech is usually more vivid and perceptually engaging than indirect speech. This thesis explores how this vividness distinction between the two reporting styles underlies language comprehension. Using functional magnetic resonance imaging (fMRI), we found that in both silent reading and listening, direct speech elicited higher brain activity in the voice-selective areas of the auditory cortex than indirect speech, consistent with the intuition of an ‘inner voice’ experience during comprehension of direct speech. In the follow-up behavioural investigations, we demonstrated that this ‘inner voice’ experience could be characterised in terms of modulations of speaking rate, reflected in both behavioural articulation (oral reading) and eye-movement patterns (silent reading). Moreover, we observed context-concordant modulations of pitch and loudness in oral reading but not straightforwardly in silent reading. Finally, we obtained preliminary results which show that in addition to reported speakers’ voices, their facial expressions may also be encoded in silent reading of direct speech but not indirect speech. The results show that individuals are more likely to mentally simulate or imagine reported speakers’ voices and perhaps also their facial expressions during comprehension of direct as opposed to indirect speech, indicating a more vivid representation of the former. The findings are in line with the demonstration hypothesis of direct speech (Clark & Gerrig, 1990) and the embodied theories of language comprehension (e.g., Barsalou, 1999; Zwaan, 2004), suggesting that sensory experiences with pragmatically distinct reporting styles underlie language comprehension