Reconstructing ERP amplitude effects after compensating for trial-to-trial latency jitter: A solution based on a novel application of residue iteration decomposition

© 2016 The Authors Stimulus-locked averaged event-related potentials (ERPs) are among the most frequently used signals in Cognitive Neuroscience. However, the late, cognitive or endogenous ERP components are often variable in latency from trial to trial in a component-specific way, compromising the stability assumption underlying the averaging scheme. Here we show that trial-to-trial latency variability of ERP components not only blurs the average ERP waveforms, but may also attenuate existing or artificially induce condition effects in amplitude. Hitherto this problem has not been well investigated. To tackle this problem, a method to measure and compensate component-specific trial-to-trial latency variability is required. Here we first systematically analyze the problem of single trial latency variability for condition effects based on simulation. Then, we introduce a solution by applying residue iteration decomposition (RIDE) to experimental data. RIDE separates different clusters of ERP components according to their time-locking to stimulus onsets, response times, or neither, based on an algorithm of iterative subtraction. We suggest to reconstruct ERPs by re-aligning the component clusters to their most probable single trial latencies. We demonstrate that RIDE-reconstructed ERPs may recover amplitude effects that are diminished or exaggerated in conventional averages by trial-to-trial latency jitter. Hence, RIDE-corrected ERPs may be a valuable tool in conditions where ERP effects may be compromised by latency variability.Link_to_subscribed_fulltex

Re-examination of chinese semantic processing and syntactic processing: Evidence from conventional ERPs and reconstructed ERPs by residue iteration decomposition (RIDE)

© 2015 Wang et al. A number of studies have explored the time course of Chinese semantic and syntactic processing. However, whether syntactic processing occurs earlier than semantics during Chinese sentence reading is still under debate. To further explore this issue, an event-related potentials (ERPs) experiment was conducted on 21 native Chinese speakers who read individually-presented Chinese simple sentences (NP1+VP+NP2) word-by-word for comprehension and made semantic plausibility judgments. The transitivity of the verbs was manipulated to form three types of stimuli: congruent sentences (CON), sentences with a semantically violated NP2 following a transitive verb (semantic violation, SEM), and sentences with a semantically violated NP2 following an intransitive verb (combined semantic and syntactic violation, SEM+SYN). The ERPs evoked from the target NP2 were analyzed by using the Residue Iteration Decomposition (RIDE) method to reconstruct the ERP waveform blurred by trial-to-trial variability, as well as by using the conventional ERP method based on stimulus-locked averaging. The conventional ERP analysis showed that, compared with the critical words in CON, those in SEM and SEM+SYN elicited an N400-P600 biphasic pattern. The N400 effects in both violation conditions were of similar size and distribution, but the P600 in SEM+SYN was bigger than that in SEM. Compared with the conventional ERP analysis, RIDE analysis revealed a larger N400 effect and an earlier P600 effect (in the time window of 500-800 ms instead of 570-810ms). Overall, the combination of conventional ERP analysis and the RIDE method for compensating for trial-to-trial variability confirmed the non-significant difference between SEM and SEM+SYN in the earlier N400 time window. Converging with previous findings on other Chinese structures, the currentstudy provides further precise evidence that syntactic processing in Chinese does not occur earlier than semantic processing.Link_to_subscribed_fulltex

ERP Markers of Auditory Go/NoGo Processing

The Sequential Processing Schema is a data-driven model that uses event-related potential (ERP) components to chart the important psychophysiological processes activated when completing auditory equiprobable Go/NoGo tasks. This model is useful for measuring experimental effects on basic cognitive processes and provides a valuable framework to synthesise and test ERP component theories. Determining the cognitive and behavioural correlates of ERP components is critical for understanding their functional significance and utility in psychology. Additional research is also needed to refine the conceptualisation of the ERP components and cognitive processing requirements in equiprobable Go/NoGo tasks, which are commonly used in psychophysiological research. To do that, robust data-driven methods such as temporal Principal Components Analysis (PCA) are needed for effective ERP component quantification and analyses of the Go/NoGo ERP component ‘processing’ series. This doctoral thesis aimed to clarify ERP component functionality and refine our understanding of equiprobable Go/NoGo tasks by developing the Sequential Processing Schema and exploring how ERP/PCA components relate to cognitive and behavioural processing under different Go/NoGo task conditions. Study 1 compared the ERP component processing series associated with auditory equiprobable and oddball variants of the Go/NoGo task. The manipulation of probability and the relevant modulation of the ERP component series reflected a shift in particular cognitive demands or task requirements, which promoted the conceptual development of component functionality and the generalisability of the Schema. The results of Study 1 questioned the identity of a core ERP component (i.e., Processing Negativity) previously linked to auditory Go/NoGo processing; this was pursued in detail in Study 2, which aimed to clarify the ERP components associated with early information processing in auditory equiprobable and ‘frequent Go’ variants of the Go/NoGo task. Stimulus probability differences (this time the inverse of Study 1) were again used to elucidate component functionality and provide insight into the cognitive task demands. Study 3 and 4 explored ERP component functionality by examining Go stimulus- and response-locked ERP averaging effects, and the link between the equiprobable NoGo P3a and motor response inhibition. Studies 1–4 provided insight into the sequential processing requirements in auditory equiprobable Go/NoGo tasks, and the associated ERP/PCA components, promoting the development of common ERP components as indices of cognitive processes. These outcomes clarified the utility of the equiprobable Go/NoGo task, and highlight important similarities and differences between Go/NoGo and oddball processing, encouraging ERP theory development and integration between those common research paradigms. An update to the Schema was proposed to accommodate the ERP findings and reflect the refined interpretation of equiprobable Go/NoGo processing developed in this thesis, including a shift in the conceptualisation of the sensory processing and inhibitory requirements in the equiprobable task. This was considered to improve the conceptual framework of the Schema and its utility for charting the cognitive and behavioural processing in different task conditions. The outcomes also provide novel insight into how healthy young adults process information and encourage further studies of sequential processing to help delineate abnormalities in cognitive processing related to different psychopathologie

On the Neurophysiological Mechanisms Underlying the Adaptability to Varying Cognitive Control Demands

Cognitive control processes are advantageous when routines would not lead to the desired outcome, but this can be ill-advised when automated behavior is advantageous. The aim of this study was to identify neural dynamics related to the ability to adapt to different cognitive control demands – a process that has been referred to as ‘metacontrol.’ A sample of N = 227 healthy subjects that was split in a ‘high’ and ‘low adaptability’ group based on the behavioral performance in a task with varying control demands. To examine the neurophysiological mechanisms, we combined event-related potential (ERP) recordings with source localization and machine learning approaches. The results show that individuals who are better at strategically adapting to different cognitive control demands benefit from automatizing their response processes in situations where little cognitive control is needed. On a neurophysiological level, neither perceptual/attentional selection processes nor conflict monitoring processes paralleled the behavioral data, although the latter showed a descriptive trend. Behavioral differences in metacontrol abilities were only significantly mirrored by the modulation of response-locked P3 amplitudes, which were accompanied by activation differences in insula (BA13) and middle frontal gyrus (BA9). The machine learning result corroborated this by identifying a predictive/classification feature near the peak of the response-locked P3, which arose from the anterior cingulate cortex (BA24; BA33). In short, we found that metacontrol is associated to the ability to manage response selection processes, especially the ability to effectively downregulate cognitive control under low cognitive control requirements, rather than the ability to upregulate cognitive control

Action Real-Time Strategy Gaming Experience Related to Increased Attentional Resources: An Attentional Blink Study

Action real-time strategy gaming (ARSG) is a cognitively demanding task which requires attention, sensorimotor skills, team cooperation, and strategy-making abilities. A recent study found that ARSG experts had superior visual selective attention (VSA) for detecting the location of a moving object that could appear in one of 24 different peripheral locations (Qiu et al., 2018), suggesting that ARSG experience is related to improvements in the spatial component of VSA. However, the influence of ARSG experience on the temporal component of VSA—the detection of an item among a sequence of items presented consecutively and quickly at a single location—still remains understudied. Using behavioral and electrophysiological measures, this study examined whether ARSG experts had superior temporal VSA performance compared to non-experts in an attentional blink (AB) task, which is typically used to examine temporal VSA. The results showed that the experts outperformed the non-experts in their detection rates of targets. Furthermore, compared to the non-experts, the experts had faster information processing as indicated by earlier P3 peak latencies in an AB period, more attentional resources distributed to targets as indicated by stronger P3 amplitudes, and a more flexible deployment of attentional resources. These findings suggest that experts were less prone to the AB effect. Thus, long-term ARSG experience is related to improvements in temporal VSA. The current findings support the benefit of video gaming experience on the development of VSA

On Why Targets Evoke P3 Components in Prediction Tasks: Drawing an Analogy between Prediction and Matching Tasks

P3 is the most conspicuous component in recordings of stimulus-evoked EEG potentials from the human scalp, occurring whenever some task has to be performed with the stimuli. The process underlying P3 has been assumed to be the updating of expectancies. More recently, P3 has been related to decision processing and to activation of established stimulus-response associations (S/R-link hypothesis). However, so far this latter approach has not provided a conception about how to explain the occurrence of P3 with predicted stimuli, although P3 was originally discovered in a prediction task. The present article proposes such a conception. We assume that the internal responses right or wrong both become associatively linked to each predicted target and that one of these two response alternatives gets activated as a function of match or mismatch of the target to the preceding prediction. This seems similar to comparison tasks where responses depend on the matching of the target stimulus with a preceding first stimulus (S1). Based on this idea, this study compared the effects of frequencies of first events (predictions or S1) on target-evoked P3s in prediction and comparison tasks. Indeed, frequencies not only of targets but also of first events had similar effects across tasks on target-evoked P3s. These results support the notion that P3 evoked by predicted stimuli reflects activation of appropriate internal “match” or “mismatch” responses, which is compatible with S/R-link hypothesis

On the locus of the effect of alerting on response conflict : an event-related EEG study with a speed-accuracy tradeoff manipulation

The present study investigated the locus of the effect of alerting on response conflict, and examined whether this effect may be interpreted as an alerting-triggered imbalance of speed-accuracy tradeoff (SAT). Participants performed the flanker task with an alerting tone in half of the trials and SAT manipulation. Behavioral results showed the usual increase of the conflict effect (incongruent-congruent flankers) in the alerting trials. This interaction was not affected by SAT manipulation in response times, although accuracy emphasis abolished alerting effects in error rates. Event-related potential (ERP) results showed that alerting increased the conflict by facilitating the selection and activation of stimulus-response links, reflected in modulations of the P3b component, and by enhancing the activation of incorrect response evoked by incongruent flankers, reflected in an increased initial incorrect activation in the lateralized readiness potential (LRP). Time-frequency analysis showed that the alerting-triggered increase of conflict entailed stronger response of executive mechanisms, reflected in a larger conflict-related midfrontal theta-band power. These EEG effects were not affected by SAT manipulation. In conclusion, alerting affects both the emergence of conflict and conflict control, and this alerting-conflict interaction could not be explained in terms of SAT

Error processing during the online retrieval of probabilistic sequence knowledge

Adaptive behavior involves rapid error processing and action evaluation. However, it has not been clarified how errors contribute to automatic behaviors that can be retrieved to successfully adapt to our complex environment. Automatic behaviors strongly rely on the process of probabilistic sequence learning and memory. Therefore, the present study investigated error processing during the online retrieval of probabilistic sequence knowledge. Twenty-four healthy young adults acquired and continuously retrieved a repeating stimulus sequence reflected by reaction time (RT) changes on a rapid forced-choice RT task. Performance was compared with a baseline that denoted the processing of random stimuli embedded in the probabilistic sequence. At the neurophysiological level, event-related brain potentials synchronized to responses were measured. Error processing was tracked by the error negativity (Ne) and the error positivity (Pe). The mean amplitude of the Ne gradually decreased as the task progressed, similarly for the sequence retrieval and the embedded baseline process. The mean amplitude of the Pe increased over time, likewise, irrespective of the type of the stimuli. Accordingly, we propose that automatic error detection (Ne) and conscious error evaluation (Pe) are not sensitive to sequence learning and retrieval. Overall, the present study provides insight into how error processing takes place for the retrieval of sequence knowledge in a probabilistic environment

The neurophysiology of continuous action monitoring.

Monitoring actions is essential for goal-directed behavior. However, as opposed to short-lasting, and regularly reinstating monitoring functions, the neural processes underlying continuous action monitoring are poorly understood. We investigate this using a pursuit-tracking paradigm. We show that beta band activity likely maintains the sensorimotor program, while theta and alpha bands probably support attentional sampling and information gating, respectively. Alpha and beta band activity are most relevant during the initial tracking period, when sensorimotor calibrations are most intense. Theta band shifts from parietal to frontal cortices throughout tracking, likely reflecting a shift in the functional relevance from attentional sampling to action monitoring. This study shows that resource allocation mechanisms in prefrontal areas and stimulus-response mapping processes in the parietal cortex are crucial for adapting sensorimotor processes. It fills a knowledge gap in understanding the neural processes underlying action monitoring and suggests new directions for examining sensorimotor integration in more naturalistic experiments. [Abstract copyright: © 2023 The Author(s).

Rôle de l’attention lors de la recherche visuelle : mesures électrophysiologiques

Le but principal de cette thèse était de mieux comprendre la relation entre le déploiement de l’attention visuo-spatiale et la réponse lors de la recherche visuelle. Nous avons combiné des mesures de chronométrie mentale (les temps de réponse; TR) et d’électrophysiologie, permettant le suivi du décours temporel des évènements et la séparation des processus en sous-phases. Trois études ont été effectuées. Dans les deux premières études, la N2pc, un potentiel relié à un événement (PRE), a été utilisé comme indice électrophysiologique de l’attention visuelle vers un stimulus latéral lors d’une tâche de recherche visuelle ayant une cible facilement repérable (qui saute aux yeux) parmi des distracteurs. Cette composante est caractérisée, en électrophysiologie, par une plus grande négativité environ 200 ms suivant la présentation de la stimulation aux sites postérieurs et controlatéraux du champ visuel ciblé. Dans la première étude, la relation entre la composante N2pc et la réponse a été examinée. Pour ce faire, les données électrophysiologiques ont été scindées selon le TR médian. La N2pc était plus ample pour les essais et les participants plus rapides comparés à ceux qui étaient plus lents, suggérant qu’un déploiement attentionnel plus efficace (N2pc plus ample) avait accéléré les processus subséquents (TR plus court). Dans l’étude 2, le traitement depuis le moment du déploiement attentionnel jusqu’à la réponse a été élucidé en examinant le déclenchement de la N2pc par rapport à la réponse et non au stimulus (ce qui est plus utilisé dans les paradigmes classiques). Nous avons été les premiers à utiliser la RLpcN (response-locked posterior contralateral negativity), composée de la composante N2pc et la SPCN (une composante suivant la N2pc reflétant le traitement en mémoire visuelle à court terme). Les résultats ont démontré une augmentation du temps entre le début de la RLpcN et la réponse pour les TR plus lents, reflétant un traitement plus long suivant le déploiement de l’attention spatiale. Nous avons par la suite utilisé cette composante (la RLpcN) pour étudier la recherche visuelle difficile (Étude 3), où la cible n’était pas facilement identifiable parmi des distracteurs, à l’aide de manipulations expérimentales modulant la RLpcN, soit le nombre d’items et de réponses possibles. Plus il y avait d’items dans le champ visuel ou de possibilités de réponses, plus longue était la durée entre le début de la RLpcN et la réponse, démontrant ainsi qu’il est possible d’observer l’activité associée avec les processus sous-jacents à ces manipulations lors d’une recherche difficile. En somme, nous avons montré (1) qu’un déploiement attentionnel plus efficace accélère les processus subséquents, (2) que le traitement déterminant les TR se produit, en majorité, suivant le déploiement de l’attention et, enfin, (3) qu’il est possible d’identifier des marqueurs électrophysiologiques de la sélection de la cible ainsi que de la réponse lors d’une recherche difficile. Dans l’ensemble, les résultats des études constituant la présente thèse vont au-delà des études électrophysiologiques de recherche visuelle typiques, qui utilisent généralement des cibles qui sautent aux yeux, et élucident le décours temporel du traitement lors de recherches plus complexes.The overarching thesis was to understand better the relationship between the deployment of visual spatial attention and the eventual response during visual search. We combined mental chronometry with electrophysiological measures, allowing us to track the temporal sequence of events and bisect processing into sub-phases. The two first studies used the N2pc, an event-related potential (ERP) component, as an electrophysiological marker of visual attention to laterally presented stimuli using a pop-out (i.e., the target stands out) visual search task. The N2pc is characterised by an enhanced negativity emerging around 200 ms after the display onset at posterior sites contralateral to the attended visual field. In Study 1, we first evaluated the relationship between the N2pc component and the moment of response. Electrophysiological data were split according to the response time (RT) median. The N2pc was larger for both fast compared with slow trials and participants, suggesting that a more efficient deployment of attention (larger N2pc) sped up downstream processing (shorter RTs). In Study 2, processing from the deployment of attention to the response was elucidated by examining N2pc onset relative to the response instead of to the display onset. We pioneered the use of the RLpcN (response-locked contralateral negativity), composed of the N2pc and the SPCN (a component following the N2pc and reflecting processing of task-relevant stimuli in visual short-term memory). Importantly, more time passed between RLpcN onset and the response for longer RTs, reflecting more processing time following the onset of visual spatial attention. We then used this component to study difficult search (Study 3), where the target was not easily located, using experimental manipulations designed to modulate the RLpcN. We showed that when there were more items present in the visual field or response selection was more difficult, there was a longer duration between RLpcN onset and the response, demonstrating that it is possible to observe activity associated with specific processes during difficult visual search. In summary, we provide evidence that (1) a more efficient deployment of attention speeds up downstream processing, (2) processing determining RTs occurs, in majority, following the deployment of attention, and (3) it is possible to identify electrophysiological markers of target and response selection during difficult search. Together, the results of these experiments go beyond typical electrophysiological experiments of visual search, which use pop-out targets, and elucidate the time course of processing during more complex search