Event-related Potential Markers of Perceptual and Conceptual Speech Processes in Patients with Disorders of Consciousness.

Vegetative state (VS) and minimally conscious state (MCS) patients behaviorally demonstrate absent or fluctuating levels of awareness. Functional magnetic resonance imaging evidence of covert perceptual and semantic speech processing provides prognostic value for these patients. In this thesis, I examined the utility of high-density electroencephalography (EEG) in this regard. A contrast between event-related potentials (ERPs) elicited by primed and unprimed word pairs was used to isolate conceptual (semantic) processes, while ERPs elicited by signal-correlated noise were contrasted with those elicited by speech to isolate pre-semantic, perceptual aspects of speech processing. These ERP effects were found to be both temporally and spatially dissociable, indicating the contributions of not entirely overlapping regions of cortex. Four out of ten VS/MCS patients demonstrated significant perceptual effects, while no conceptual effects were observed for any patient. It is therefore possible to identify low-level stages of language processing that can now be tested for prognostic value given future follow-up studies

Graph analysis of functional brain networks: practical issues in translational neuroscience

The brain can be regarded as a network: a connected system where nodes, or units, represent different specialized regions and links, or connections, represent communication pathways. From a functional perspective communication is coded by temporal dependence between the activities of different brain areas. In the last decade, the abstract representation of the brain as a graph has allowed to visualize functional brain networks and describe their non-trivial topological properties in a compact and objective way. Nowadays, the use of graph analysis in translational neuroscience has become essential to quantify brain dysfunctions in terms of aberrant reconfiguration of functional brain networks. Despite its evident impact, graph analysis of functional brain networks is not a simple toolbox that can be blindly applied to brain signals. On the one hand, it requires a know-how of all the methodological steps of the processing pipeline that manipulates the input brain signals and extract the functional network properties. On the other hand, a knowledge of the neural phenomenon under study is required to perform physiological-relevant analysis. The aim of this review is to provide practical indications to make sense of brain network analysis and contrast counterproductive attitudes

Response-related potentials during semantic priming: the effect of a speeded button response task on ERPs

This study examines the influence of a button response task on the event-related potential (ERP) in a semantic priming experiment. Of particular interest is the N400 component. In many semantic priming studies, subjects are asked to respond to a stimulus as fast and accurately as possible by pressing a button. Response time (RT) is recorded in parallel with an electroencephalogram (EEG) for ERP analysis. In this case, the response occurs in the time window used for ERP analysis and response-related components may overlap with stimulus-locked ones such as the N400. This has led to a recommendation against such a design, although the issue has not been explored in depth. Since studies keep being published that disregard this issue, a more detailed examination of influence of response-related potentials on the ERP is needed. Two experiments were performed in which subjects pressed one of two buttons with their dominant hand in response to word-pairs with varying association strength (AS), indicating a personal judgement of association between the two words. In the first experiment, subjects were instructed to respond as fast and accurately as possible. In the second experiment, subjects delayed their button response to enforce a one second interval between the onset of the target word and the button response. Results show that in the first experiment a P3 component and motor-related potentials (MRPs) overlap with the N400 component, which can cause a misinterpretation of the latter. In order to study the N400 component, the button response should be delayed to avoid contamination of the ERP with response-related components

The effect of leads on cognitive load and learning in a conceptually rich hypertext environment

The purpose of this experiment was to determine whether leads affect cognitive load and learning from conceptually rich hypertext. Measures of cognitive load included self-report of mental effort, reading time, and event-related desynchronization percentage of alpha, beta, and theta brain wave rhythms. Conceptual and structural knowledge tests, as well as a recall measure were used to determine learning performance. Measures of learners\u27 reading ability, prior knowledge, and metacognitive awareness were employed to establish the effect of individual differences on cognitive load and learning from traditional and lead-augmented hypertext. Results demonstrated that while leads appeared to reduce brain wave activity associated with split attention, processing of redundant information contained in hypertext nodes may have increased extraneous cognitive load, and decreased germane load that is required for learning to take place. Whereas the benefits of leads relative to cognitive load and learning may have been mediated by the redundancy effect, learners with better developed metacognitive skills tended to use leads as a tool to review information in the linked nodes while revisiting content in the primary text passage. Limitations of the currently available cognitive load measures are discussed as applied to direct assessment of this theoretical construct

Attention and speech-processing related functional brain networks activated in a multi-speaker environment

Human listeners can focus on one speech stream out of several concurrent ones. The present study aimed to assess the whole-brain functional networks underlying a) the process of focusing attention on a single speech stream vs. dividing attention between two streams and 2) speech processing on different time-scales and depth. Two spoken narratives were presented simultaneously while listeners were instructed to a) track and memorize the contents of a speech stream and b) detect the presence of numerals or syntactic violations in the same (“focused attended condition”) or in the parallel stream (“divided attended condition”). Speech content tracking was found to be associated with stronger connectivity in lower frequency bands (delta band- 0,5–4 Hz), whereas the detection tasks were linked with networks operating in the faster alpha (8–10 Hz) and beta (13–30 Hz) bands. These results suggest that the oscillation frequencies of the dominant brain networks during speech processing may be related to the duration of the time window within which information is integrated. We also found that focusing attention on a single speaker compared to dividing attention between two concurrent speakers was predominantly associated with connections involving the frontal cortices in the delta (0.5–4 Hz), alpha (8–10 Hz), and beta bands (13–30 Hz), whereas dividing attention between two parallel speech streams was linked with stronger connectivity involving the parietal cortices in the delta and beta frequency bands. Overall, connections strengthened by focused attention may reflect control over information selection, whereas connections strengthened by divided attention may reflect the need for maintaining two streams in parallel and the related control processes necessary for performing the tasks.</div

Syntax through the looking glass: A review on two-word linguistic processing across behavioral, neuroimaging and neurostimulation studies

In recent years a growing number of studies on syntactic processing has employed basic two-word constructions (e.g., “the tree”) to characterize the fundamental aspects of linguistic composition. This large body of evidence allows, for the first time, to closely examine which cognitive processes and neural substrates support the combination of two syntactic units into a more complex one, mirroring the nature of combinatory operations described in theoretical linguistics. The present review comprehensively examines behavioural, neuroimaging and neurostimulation studies investigating basic syntactic composition, covering more than forty years of psycho- and neuro-linguistic research. Across several paradigms, four key features of syntactic composition have emerged: (1) the rule-based and (2) automatic nature of the combinatorial process, (3) a central role of Broca’s area and the posterior temporal lobe in representing and combining syntactic features, and (4) the reliance on efficient bottom-up integration rather than top-down prediction

Correlates of programmer efficacy and their link to experience: a combined EEG and eye-tracking study

Background: Despite similar education and background, programmers can exhibit vast differences in efficacy. While research has identified some potential factors, such as programming experience and domain knowledge, the effect of these factors on programmers’ efficacy is not well understood. Aims: We aim at unraveling the relationship between efficacy (speed and correctness) and measures of programming experience. We further investigate the correlates of programmer efficacy in terms of reading behavior and cognitive load. Method: For this purpose, we conducted a controlled experiment with 37 participants using electroencephalography (EEG) and eye tracking. We asked participants to comprehend up to 32 Java sourcecode snippets and observed their eye gaze and neural correlates of cognitive load. We analyzed the correlation of participants’ efficacy with popular programming experience measures. Results: We found that programmers with high efficacy read source code more targeted and with lower cognitive load. Commonly used experience levels do not predict programmer efficacy well, but selfestimation and indicators of learning eagerness are fairly accurate. Implications: The identified correlates of programmer efficacy can be used for future research and practice (e.g., hiring). Future research should also consider efficacy as a group sampling method, rather than using simple experience measures

Functional Magnetic Resonance Imaging as an Assessment Tool in Critically Ill Patients

Little is known about whether residual cognitive function occurs in the earliest stages of brain injury. The overarching goal of the work presented in this dissertation was to elucidate the role of functional neuroimaging in assessing brain activity in critically ill patients. The overall objective was addressed in the following four empirical chapters: In Chapter 2, three versions of a hierarchically-designed auditory task were developed and their ability to detect various levels of auditory language processing was assessed in individual healthy participants. The same procedure was then applied in two acutely comatose patients. In Chapter 3, a hierarchical auditory task was employed in a heterogeneous cohort of acutely comatose patients. The results revealed that the level of auditory processing in coma may be predictive of subsequent functional recovery. In Chapter 4, two mental imagery paradigms were utilized to assess covert command-following in coma. The findings demonstrate, for the first time, preserved awareness in an acutely comatose patient. In Chapter 5, functional neuroimaging techniques were used for covert communication with two completely locked-in, critically ill patients. The results suggest that this methodology could be used as an augmentative communication tool to allow patients to be involved in their own medical decision-making. Taken together, the proceeding chapters of this work demonstrate that functional neuroimaging can detect preserved cognitive functions in some acutely comatose patients, which has both diagnostic and prognostic relevance. Moreover, these techniques may be extended even further to be used as a communication tool in critically ill patients

Event related spectral perturbations of gesture congruity: Visuospatial resources are recruited for multimodal discourse comprehension.

Here we examine the role of visuospatial working memory (WM) during the comprehension of multimodal discourse with co-speech iconic gestures. EEG was recorded as healthy adults encoded either a sequence of one (low load) or four (high load) dot locations on a grid and rehearsed them until a free recall response was collected later in the trial. During the rehearsal period of the WM task, participants observed videos of a speaker describing objects in which half of the trials included semantically related co-speech gestures (congruent), and the other half included semantically unrelated gestures (incongruent). Discourse processing was indexed by oscillatory EEG activity in the alpha and beta bands during the videos. Across all participants, effects of speech and gesture incongruity were more evident in low load trials than in high load trials. Effects were also modulated by individual differences in visuospatial WM capacity. These data suggest visuospatial WM resources are recruited in the comprehension of multimodal discourse